Compare commits

Home / Compare 53fe5e20 .. f705c60c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.696=-0.001
σ0.049-0.046=0.003
min70.667-70.670=-0.003
max70.832-70.826=0.006
mean412.000-413.900=-1.900
σ0.000-0.316=-0.316
min412.000-413.000=-1.000
max412.000-414.000=-2.000
mean0.157-0.158=-0.001
σ0.005-0.005=-0.000
min0.151-0.151=-0.000
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.424-21.421=0.002
σ0.013-0.002=0.010
min21.417-21.418=-0.002
max21.459-21.424=0.035
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.061=0.003
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.460-1754.458=0.001
σ0.362-0.361=0.001
min1753.888-1753.889=-0.001
max1755.038-1755.035=0.002
mean1670.300-1642.050=28.250
σ650.561-627.502=23.059
min622.000-623.000=-1.000
max2867.000-2850.000=17.000
mean2.786-2.765=0.021
σ0.166-0.204=-0.037
min2.364-2.267=0.098
max2.968-3.044=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.503-273.503=0.001
σ0.009-0.007=0.002
min273.493-273.495=-0.002
max273.515-273.514=0.001
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean0.377-0.376=0.000
σ0.004-0.006=-0.002
min0.373-0.372=0.001
max0.384-0.386=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.902-1933.901=0.001
σ0.014-0.009=0.006
min1933.887-1933.893=-0.006
max1933.925-1933.914=0.011
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean2.878-2.949=-0.071
σ0.310-0.172=0.138
min2.373-2.675=-0.302
max3.198-3.148=0.050
iters=5
new-facts=6402
prior-facts=1
mean4754.559-4754.534=0.025
σ0.889-0.984=-0.095
min4753.859-4753.681=0.178
max4756.111-4756.237=-0.126
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean8.421-8.664=-0.243
σ0.500-0.225=0.275
min7.637-8.414=-0.777
max8.874-8.947=-0.073
iters=5
new-facts=6402
prior-facts=6402
mean4945.121-4945.050=0.072
σ0.023-0.165=-0.142
min4945.104-4944.757=0.347
max4945.148-4945.144=0.004
mean3073.600-3058.600=15.000
σ209.423-226.190=-16.767
min2867.000-2850.000=17.000
max3360.000-3397.000=-37.000
mean8.683-8.604=0.078
σ0.301-0.166=0.134
min8.402-8.425=-0.023
max9.126-8.871=0.256

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-0.999=-0.011
σ0.144-0.139=0.005
min0.920-0.936=-0.016
max1.245-1.248=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.079-473.071=0.008
σ575.910-575.912=-0.002
min185.114-185.111=0.003
max1336.943-1336.939=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean0.440-0.483=-0.043
σ0.281-0.368=-0.087
min0.295-0.292=0.003
max0.862-1.035=-0.173
policies=20
mean1851.454-1851.457=-0.003
σ0.372-0.378=-0.007
min1851.179-1851.163=0.016
max1851.994-1852.003=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean2.940-2.961=-0.021
σ0.011-0.024=-0.013
min2.929-2.934=-0.005
max2.951-2.987=-0.037
policies=200
mean18519.766-18519.755=0.012
σ0.853-0.839=0.014
min18519.038-18519.065=-0.027
max18520.749-18520.895=-0.147
mean8400.000
σ0.000
min8400.000
max8400.000
mean2867.000-2850.000=17.000
σ0.000
min2867.000-2850.000=17.000
max2867.000-2850.000=17.000
mean29.133-29.110=0.023
σ0.472-0.437=0.035
min28.783-28.747=0.036
max29.799-29.724=0.075