Compare commits

Home / Compare 9eae634d .. cd98de84

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.797-35.800=-0.002
σ0.108-0.107=0.001
min35.749-35.752=-0.003
max36.103-36.103=-0.001
mean415.200-412.800=2.400
σ0.422
min415.000-412.000=3.000
max416.000-413.000=3.000
mean0.073-0.075=-0.002
σ0.005-0.003=0.002
min0.069-0.073=-0.004
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.003=0.001
min26.060-26.059=0.001
max26.072-26.069=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.000
min0.057-0.059=-0.003
max0.066-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.922=-0.001
σ0.368-0.367=0.000
min1755.355-1755.349=0.006
max1756.515-1756.507=0.008
mean1669.700-1662.900=6.800
σ631.599-630.089=1.511
min669.000-671.000=-2.000
max2627.000-2664.000=-37.000
mean2.740-2.806=-0.066
σ0.237-0.185=0.052
min2.195-2.283=-0.087
max3.066-3.037=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.193=0.003
σ0.005-0.004=0.000
min277.190-277.187=0.003
max277.201-277.199=0.002
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean0.402-0.402=0.000
σ0.004-0.003=0.001
min0.400-0.399=0.001
max0.409-0.406=0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.448-2174.431=0.017
σ0.023-0.023=0.000
min2174.424-2174.399=0.025
max2174.471-2174.456=0.015
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean3.020-2.936=0.084
σ0.100-0.129=-0.029
min2.876-2.740=0.137
max3.140-3.035=0.105
iters=5
new-facts=6402
prior-facts=1
mean5052.618-5052.611=0.008
σ0.985-1.006=-0.021
min5052.035-5051.994=0.041
max5054.371-5054.392=-0.021
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean8.596-9.075=-0.479
σ0.620-0.720=-0.099
min7.943-7.854=0.089
max9.490-9.689=-0.199
iters=5
new-facts=6402
prior-facts=6402
mean5188.431-5188.354=0.077
σ0.085-0.212=-0.127
min5188.351-5188.001=0.350
max5188.528-5188.525=0.003
mean3218.600-3226.000=-7.400
σ388.678-365.849=22.829
min2682.000-2696.000=-14.000
max3706.000-3682.000=24.000
mean8.927-8.987=-0.059
σ0.437-0.445=-0.007
min8.550-8.653=-0.103
max9.670-9.745=-0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.270-1.109=0.161
σ0.280-0.172=0.108
min0.940-0.938=0.002
max1.647-1.321=0.326

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.856=0.001
σ572.658-572.670=-0.012
min178.523-178.520=0.003
max1323.844-1323.861=-0.017
mean79.500
σ7.000
min76.000
max90.000
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean0.554-0.576=-0.022
σ0.538-0.592=-0.054
min0.266-0.278=-0.013
max1.361-1.464=-0.103
policies=20
mean1785.460-1785.462=-0.002
σ0.349-0.341=0.008
min1785.230-1785.244=-0.014
max1785.979-1785.970=0.010
mean760.000
σ0.000
min760.000
max760.000
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean2.767-2.783=-0.016
σ0.013-0.004=0.008
min2.752-2.779=-0.028
max2.782-2.789=-0.007
policies=200
mean17861.498-17861.292=0.206
σ0.544-0.547=-0.003
min17861.110-17860.981=0.128
max17862.302-17862.109=0.193
mean7600.000
σ0.000
min7600.000
max7600.000
mean2627.000-2664.000=-37.000
σ0.000
min2627.000-2664.000=-37.000
max2627.000-2664.000=-37.000
mean28.036-28.045=-0.009
σ0.128-0.141=-0.013
min27.907-27.895=0.012
max28.155-28.193=-0.038