Compare commits

Home / Compare 95ef81db .. bdf3f6ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.059-73.063=-0.003
σ0.052-0.053=-0.001
min73.030-73.037=-0.008
max73.205-73.213=-0.008
mean415.700-412.000=3.700
σ0.483-0.000=0.483
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.159-0.163=-0.005
σ0.004-0.003=0.001
min0.150-0.161=-0.011
max0.164-0.170=-0.007
cache=y
dps=1
iters=10
policies=100
mean23.754-23.755=-0.001
σ0.002-0.003=-0.000
min23.751-23.750=0.001
max23.757-23.759=-0.002
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.067-0.069=-0.002
σ0.004-0.003=0.001
min0.062-0.066=-0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.820-1755.819=0.000
σ0.362-0.361=0.000
min1755.250-1755.252=-0.002
max1756.405-1756.405=-0.000
mean1634.800-1656.150=-21.350
σ598.336-636.606=-38.271
min624.000-616.000=8.000
max2418.000-2784.000=-366.000
mean2.816-2.879=-0.063
σ0.175-0.154=0.022
min2.229-2.629=-0.400
max3.016-3.354=-0.338

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.045-321.043=0.001
σ0.050-0.055=-0.005
min320.956-320.945=0.011
max321.074-321.073=0.001
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean0.423-0.425=-0.002
σ0.001-0.002=-0.001
min0.422-0.421=0.001
max0.424-0.428=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1981.626-1981.613=0.014
σ0.013-0.015=-0.003
min1981.605-1981.586=0.019
max1981.637-1981.625=0.012
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean2.635-2.671=-0.036
σ0.144-0.134=0.010
min2.517-2.531=-0.014
max2.883-2.852=0.031
iters=5
new-facts=6402
prior-facts=1
mean4805.248-4805.125=0.123
σ7.738-7.791=-0.053
min4801.700-4801.192=0.508
max4819.091-4819.054=0.036
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean8.948-8.752=0.196
σ0.269-0.229=0.040
min8.725-8.523=0.202
max9.414-9.038=0.376
iters=5
new-facts=6402
prior-facts=6402
mean4992.759-4992.830=-0.071
σ0.149-0.025=0.124
min4992.495-4992.802=-0.307
max4992.854-4992.859=-0.004
mean2991.200-3071.600=-80.400
σ286.755-297.743=-10.988
min2604.000-2784.000=-180.000
max3329.000-3378.000=-49.000
mean8.576-8.676=-0.100
σ0.106-0.203=-0.097
min8.469-8.431=0.038
max8.716-8.924=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.755-1.073=0.682
σ0.068-0.218=-0.149
min1.671-0.908=0.763
max1.833-1.441=0.392

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.392-462.418=-0.027
σ574.224-574.242=-0.019
min175.274-175.293=-0.019
max1323.727-1323.782=-0.055
mean86.250
σ8.500
min82.000
max99.000
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean0.546-0.427=0.119
σ0.544-0.299=0.244
min0.272-0.272=-0.001
max1.361-0.876=0.485
policies=20
mean1753.006-1753.224=-0.218
σ0.350-0.376=-0.027
min1752.816-1752.972=-0.157
max1753.530-1753.784=-0.254
mean820.000
σ0.000
min820.000
max820.000
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean2.717-2.769=-0.052
σ0.035-0.009=0.027
min2.682-2.758=-0.076
max2.765-2.778=-0.013
policies=200
mean17537.521-17537.564=-0.043
σ0.590-0.635=-0.045
min17537.146-17537.191=-0.045
max17538.391-17538.514=-0.122
mean8200.000
σ0.000
min8200.000
max8200.000
mean2418.000-2784.000=-366.000
σ0.000
min2418.000-2784.000=-366.000
max2418.000-2784.000=-366.000
mean27.432-27.443=-0.011
σ0.088-0.147=-0.059
min27.323-27.236=0.087
max27.505-27.570=-0.065