Compare commits

Home / Compare 9cf246e2 .. 672b08bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.799=-0.005
σ0.108-0.107=0.001
min35.750-35.748=0.001
max36.100-36.102=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.073-0.073=-0.000
σ0.004-0.004=0.000
min0.069-0.068=0.001
max0.081-0.081=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.002
σ0.003-0.003=-0.000
min26.061-26.058=0.003
max26.072-26.070=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.060-0.061=-0.001
σ0.003-0.001=0.002
min0.056-0.059=-0.003
max0.066-0.063=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1755.922=-4.687
σ0.363-0.364=-0.001
min1750.670-1755.350=-4.681
max1751.809-1756.508=-4.700
mean1624.650-1666.400=-41.750
σ591.533-635.575=-44.042
min631.000-666.000=-35.000
max2412.000-2630.000=-218.000
mean2.834-2.818=0.016
σ0.219-0.151=0.068
min2.205-2.396=-0.191
max3.113-3.036=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.195=-1.627
σ0.006-0.006=0.000
min275.561-277.187=-1.627
max275.576-277.203=-1.627
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean0.397-0.397=-0.000
σ0.011-0.007=0.004
min0.388-0.391=-0.004
max0.411-0.409=0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.087-2174.418=-6.331
σ0.021-0.038=-0.016
min2168.056-2174.353=-6.298
max2168.107-2174.452=-6.344
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean2.884-3.095=-0.211
σ0.124-0.313=-0.189
min2.753-2.776=-0.023
max3.023-3.585=-0.562
iters=5
new-facts=6402
prior-facts=1
mean5047.903-5052.635=-4.732
σ0.897-0.988=-0.092
min5047.344-5052.041=-4.696
max5049.496-5054.390=-4.894
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean8.804-8.708=0.095
σ0.460-0.590=-0.130
min8.094-8.260=-0.166
max9.274-9.660=-0.386
iters=5
new-facts=6402
prior-facts=6402
mean5179.045-5188.358=-9.313
σ0.086-0.121=-0.035
min5178.968-5188.174=-9.206
max5179.139-5188.515=-9.376
mean3252.200-3288.600=-36.400
σ518.143-417.183=100.960
min2625.000-2706.000=-81.000
max3878.000-3675.000=203.000
mean9.893-9.040=0.853
σ0.196-0.503=-0.307
min9.657-8.711=0.946
max10.083-9.933=0.150

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.843-1.315=0.528
σ0.061-0.340=-0.279
min1.782-0.944=0.837
max1.933-1.816=0.117

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.195-464.852=-1.657
σ572.654-572.660=-0.007
min176.865-178.515=-1.650
max1322.175-1323.842=-1.667
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean0.551-0.568=-0.017
σ0.547-0.570=-0.023
min0.275-0.274=0.001
max1.371-1.423=-0.052
policies=20
mean1768.968-1785.464=-16.496
σ0.340-0.353=-0.012
min1768.738-1785.237=-16.498
max1769.473-1785.989=-16.516
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean2.760-2.785=-0.024
σ0.017-0.025=-0.008
min2.736-2.758=-0.021
max2.774-2.816=-0.042
policies=200
mean17696.102-17861.568=-165.466
σ0.463-0.529=-0.066
min17695.784-17861.299=-165.515
max17696.782-17862.362=-165.579
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2412.000-2630.000=-218.000
σ0.000
min2412.000-2630.000=-218.000
max2412.000-2630.000=-218.000
mean27.700-28.246=-0.546
σ0.131-0.145=-0.013
min27.529-28.107=-0.579
max27.821-28.418=-0.597