Compare commits

Home / Compare 63a081e9 .. ae86932d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.379=0.002
σ0.047-0.047=0.000
min70.352-70.348=0.004
max70.513-70.511=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.160=-0.001
σ0.003-0.003=0.000
min0.154-0.158=-0.004
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.002=0.001
min21.140-21.139=0.000
max21.150-21.147=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.062=0.002
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1714.464-1752.388=-37.924
σ169.525-0.362=169.162
min994.236-1751.819=-757.583
max1752.999-1752.975=0.025
mean1639.800-1661.000=-21.200
σ607.630-637.473=-29.843
min668.000-626.000=42.000
max2468.000-2791.000=-323.000
mean2.738-2.727=0.012
σ0.346-0.206=0.140
min1.403-2.270=-0.867
max3.119-3.008=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.124-270.124=0.000
σ0.010-0.006=0.004
min270.113-270.114=-0.001
max270.135-270.130=0.005
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean0.371-0.372=-0.001
σ0.002-0.002=0.000
min0.369-0.369=-0.000
max0.373-0.373=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.581=0.013
σ0.007-0.021=-0.014
min1930.583-1930.552=0.031
max1930.600-1930.602=-0.001
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean2.520-2.550=-0.030
σ0.111-0.147=-0.036
min2.387-2.425=-0.038
max2.693-2.771=-0.078
iters=5
new-facts=6402
prior-facts=1
mean4750.939-4750.913=0.026
σ0.966-0.969=-0.003
min4749.993-4749.972=0.020
max4752.571-4752.537=0.034
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean8.608-8.832=-0.224
σ0.653-0.297=0.356
min7.645-8.561=-0.916
max9.227-9.326=-0.100
iters=5
new-facts=6402
prior-facts=6402
mean4941.249-4941.528=-0.279
σ0.377-0.092=0.285
min4940.759-4941.455=-0.696
max4941.634-4941.632=0.003
mean2977.000-2996.600=-19.600
σ283.447-208.729=74.718
min2592.000-2791.000=-199.000
max3314.000-3304.000=10.000
mean8.511-8.506=0.005
σ0.165-0.125=0.040
min8.250-8.370=-0.121
max8.698-8.655=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.624-1.086=0.538
σ0.259-0.106=0.153
min1.255-0.953=0.302
max1.929-1.251=0.678

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.354-466.362=-0.007
σ575.920-575.928=-0.009
min178.385-178.394=-0.009
max1330.234-1330.254=-0.020
mean84.000
σ8.000
min80.000
max96.000
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean0.555-0.444=0.111
σ0.551-0.310=0.241
min0.278-0.283=-0.005
max1.382-0.910=0.473
policies=20
mean1784.216-1784.263=-0.046
σ0.365-0.382=-0.018
min1783.973-1784.003=-0.030
max1784.758-1784.828=-0.070
mean800.000
σ0.000
min800.000
max800.000
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean2.775-2.852=-0.077
σ0.014-0.106=-0.092
min2.754-2.775=-0.021
max2.784-3.006=-0.222
policies=200
mean17848.792-17848.769=0.023
σ0.328-0.356=-0.028
min17848.571-17848.542=0.029
max17849.276-17849.295=-0.018
mean8000.000
σ0.000
min8000.000
max8000.000
mean2468.000-2791.000=-323.000
σ0.000
min2468.000-2791.000=-323.000
max2468.000-2791.000=-323.000
mean28.093-28.025=0.069
σ0.154-0.109=0.045
min27.895-27.932=-0.037
max28.272-28.168=0.104