Compare commits

Home / Compare e72aa6c0 .. b1bef11d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.799=-0.004
σ0.108-0.107=0.002
min35.752-35.748=0.004
max36.102-36.102=0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.077-0.073=0.004
σ0.004-0.004=0.000
min0.073-0.068=0.006
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.001
σ0.003-0.003=-0.000
min26.060-26.058=0.002
max26.069-26.070=-0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.058-0.061=-0.002
σ0.003-0.001=0.002
min0.056-0.059=-0.003
max0.066-0.063=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.922=-4.686
σ0.362-0.364=-0.002
min1750.670-1755.350=-4.680
max1751.822-1756.508=-4.687
mean1661.300-1666.400=-5.100
σ635.382-635.575=-0.193
min620.000-666.000=-46.000
max2779.000-2630.000=149.000
mean2.887-2.818=0.069
σ0.106-0.151=-0.045
min2.655-2.396=0.260
max3.112-3.036=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-277.195=-1.626
σ0.006-0.006=-0.000
min275.561-277.187=-1.626
max275.575-277.203=-1.628
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean0.405-0.397=0.008
σ0.012-0.007=0.005
min0.395-0.391=0.004
max0.422-0.409=0.013
iters=5
new-facts=1
prior-facts=6402
mean2168.088-2174.418=-6.330
σ0.014-0.038=-0.024
min2168.068-2174.353=-6.286
max2168.104-2174.452=-6.347
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean3.026-3.095=-0.069
σ0.136-0.313=-0.177
min2.818-2.776=0.043
max3.187-3.585=-0.398
iters=5
new-facts=6402
prior-facts=1
mean5047.934-5052.635=-4.701
σ0.897-0.988=-0.092
min5047.346-5052.041=-4.694
max5049.501-5054.390=-4.889
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean9.191-8.708=0.483
σ0.589-0.590=-0.001
min8.485-8.260=0.225
max10.020-9.660=0.360
iters=5
new-facts=6402
prior-facts=6402
mean5179.055-5188.358=-9.303
σ0.084-0.121=-0.038
min5178.969-5188.174=-9.204
max5179.149-5188.515=-9.366
mean3258.000-3288.600=-30.600
σ354.970-417.183=-62.213
min2779.000-2706.000=73.000
max3703.000-3675.000=28.000
mean10.000-9.040=0.960
σ0.259-0.503=-0.245
min9.577-8.711=0.866
max10.226-9.933=0.294

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.315=-0.252
σ0.127-0.340=-0.213
min0.945-0.944=0.001
max1.258-1.816=-0.558

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-464.852=-1.650
σ572.665-572.660=0.004
min176.863-178.515=-1.652
max1322.199-1323.842=-1.644
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean0.439-0.568=-0.130
σ0.300-0.570=-0.270
min0.288-0.274=0.014
max0.889-1.423=-0.535
policies=20
mean1768.976-1785.464=-16.488
σ0.315-0.353=-0.037
min1768.766-1785.237=-16.470
max1769.437-1785.989=-16.552
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean2.794-2.785=0.010
σ0.126-0.025=0.101
min2.727-2.758=-0.031
max2.984-2.816=0.168
policies=200
mean17695.966-17861.568=-165.602
σ0.500-0.529=-0.029
min17695.664-17861.299=-165.634
max17696.714-17862.362=-165.647
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2779.000-2630.000=149.000
σ0.000
min2779.000-2630.000=149.000
max2779.000-2630.000=149.000
mean27.715-28.246=-0.531
σ0.081-0.145=-0.064
min27.637-28.107=-0.470
max27.820-28.418=-0.598