Compare commits

Home / Compare 0051fbe3 .. 51ce0826

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.107=-0.000
min35.754-35.748=0.006
max36.099-36.102=-0.003
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.073-0.073=0.000
σ0.003-0.004=-0.001
min0.069-0.068=0.001
max0.077-0.081=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.066-26.064=0.002
σ0.003-0.003=-0.000
min26.062-26.058=0.004
max26.071-26.070=0.001
mean410.600-412.000=-1.400
σ0.516-0.000=0.516
min410.000-412.000=-2.000
max411.000-412.000=-1.000
mean0.061-0.061=0.000
σ0.003-0.001=0.002
min0.059-0.059=0.000
max0.069-0.063=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.922=-4.687
σ0.361-0.364=-0.003
min1750.670-1755.350=-4.681
max1751.803-1756.508=-4.706
mean1651.550-1666.400=-14.850
σ643.493-635.575=7.918
min624.000-666.000=-42.000
max2844.000-2630.000=214.000
mean2.810-2.818=-0.008
σ0.147-0.151=-0.004
min2.462-2.396=0.066
max3.012-3.036=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.195=-1.627
σ0.007-0.006=0.001
min275.557-277.187=-1.630
max275.575-277.203=-1.628
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean0.404-0.397=0.007
σ0.007-0.007=-0.000
min0.397-0.391=0.006
max0.411-0.409=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2174.418=-6.317
σ0.010-0.038=-0.028
min2168.089-2174.353=-6.265
max2168.113-2174.452=-6.339
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean3.050-3.095=-0.044
σ0.172-0.313=-0.141
min2.811-2.776=0.035
max3.223-3.585=-0.362
iters=5
new-facts=6402
prior-facts=1
mean5047.888-5052.635=-4.747
σ0.878-0.988=-0.110
min5047.414-5052.041=-4.627
max5049.450-5054.390=-4.940
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean8.830-8.708=0.121
σ0.374-0.590=-0.215
min8.214-8.260=-0.045
max9.122-9.660=-0.538
iters=5
new-facts=6402
prior-facts=6402
mean5178.908-5188.358=-9.449
σ0.263-0.121=0.142
min5178.625-5188.174=-9.549
max5179.149-5188.515=-9.366
mean3250.600-3288.600=-38.000
σ328.141-417.183=-89.041
min2844.000-2706.000=138.000
max3695.000-3675.000=20.000
mean9.855-9.040=0.815
σ0.323-0.503=-0.180
min9.463-8.711=0.752
max10.222-9.933=0.289

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.315=-0.238
σ0.109-0.340=-0.230
min0.944-0.944=0.000
max1.249-1.816=-0.567

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-464.852=-1.647
σ572.653-572.660=-0.008
min176.873-178.515=-1.641
max1322.184-1323.842=-1.659
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean0.435-0.568=-0.133
σ0.304-0.570=-0.266
min0.282-0.274=0.008
max0.891-1.423=-0.532
policies=20
mean1769.005-1785.464=-16.460
σ0.331-0.353=-0.021
min1768.773-1785.237=-16.463
max1769.494-1785.989=-16.495
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean2.824-2.785=0.039
σ0.009-0.025=-0.016
min2.811-2.758=0.054
max2.831-2.816=0.015
policies=200
mean17696.164-17861.568=-165.404
σ0.533-0.529=0.004
min17695.728-17861.299=-165.570
max17696.910-17862.362=-165.452
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2844.000-2630.000=214.000
σ0.000
min2844.000-2630.000=214.000
max2844.000-2630.000=214.000
mean28.069-28.246=-0.177
σ0.545-0.145=0.400
min27.509-28.107=-0.598
max28.609-28.418=0.191