Compare commits

Home / Compare a3598aa9 .. aba8e4e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.822=0.001
σ0.368-0.369=-0.001
min53.679-53.680=-0.001
max54.869-54.871=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.137-0.136=0.000
σ0.005-0.005=0.000
min0.130-0.130=0.000
max0.144-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.005-0.007=-0.002
min43.200-43.195=0.005
max43.217-43.219=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.120-0.123=-0.003
σ0.005-0.004=0.001
min0.113-0.118=-0.005
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.180=-0.004
σ1.165-1.140=0.024
min1015.605-1015.604=0.001
max1021.051-1020.942=0.110
mean1045.600-1051.300=-5.700
σ308.530-307.321=1.209
min584.000-586.000=-2.000
max1650.000-1614.000=36.000
mean1.549-1.514=0.035
σ0.091-0.087=0.004
min1.454-1.328=0.126
max1.793-1.728=0.065

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.379-301.245=0.134
σ0.207-0.263=-0.056
min301.242-300.965=0.278
max301.959-301.952=0.007
mean1949.000-1941.000=8.000
σ0.000
min1949.000-1941.000=8.000
max1949.000-1941.000=8.000
mean0.552-0.533=0.019
σ0.033-0.030=0.003
min0.511-0.505=0.006
max0.583-0.586=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.706-300.698=0.008
σ0.014-0.031=-0.017
min300.691-300.657=0.034
max300.727-300.736=-0.009
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean0.392-0.397=-0.005
σ0.005-0.007=-0.003
min0.388-0.388=-0.000
max0.397-0.404=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1322.865-1322.874=-0.010
σ0.092-0.094=-0.002
min1322.812-1322.814=-0.003
max1323.026-1323.036=-0.010
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean1.921-1.912=0.009
σ0.073-0.064=0.009
min1.827-1.820=0.006
max2.023-1.994=0.029
iters=5
new-facts=6402
prior-facts=1
mean1561.308-1561.298=0.009
σ6.881-6.887=-0.005
min1557.957-1557.977=-0.020
max1573.611-1573.612=-0.001
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean2.358-2.249=0.109
σ0.293-0.215=0.078
min2.050-2.130=-0.080
max2.685-2.632=0.053
iters=5
new-facts=6402
prior-facts=6402
mean1890.801-1890.802=-0.001
σ0.028-0.034=-0.006
min1890.784-1890.783=0.002
max1890.851-1890.863=-0.011
mean1782.600-1770.800=11.800
σ111.713-119.347=-7.634
min1650.000-1614.000=36.000
max1949.000-1941.000=8.000
mean2.984-3.012=-0.028
σ0.232-0.185=0.047
min2.655-2.825=-0.170
max3.296-3.297=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.181=-0.064
σ0.216-0.334=-0.118
min0.919-0.915=0.004
max1.356-1.730=-0.374

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.332-443.336=-0.004
σ573.982-573.993=-0.011
min156.336-156.334=0.002
max1304.305-1304.325=-0.020
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean0.537-0.545=-0.008
σ0.550-0.566=-0.016
min0.260-0.259=0.000
max1.362-1.395=-0.032
policies=20
mean1563.632-1563.633=-0.002
σ0.316-0.314=0.002
min1563.457-1563.465=-0.008
max1564.105-1564.104=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean2.608-2.606=0.002
σ0.022-0.010=0.011
min2.589-2.591=-0.002
max2.632-2.615=0.018
policies=200
mean15643.985-15644.090=-0.105
σ0.077-0.049=0.028
min15643.936-15644.021=-0.085
max15644.099-15644.135=-0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1614.000=36.000
σ0.000
min1650.000-1614.000=36.000
max1650.000-1614.000=36.000
mean26.400-26.403=-0.003
σ0.163-0.216=-0.053
min26.270-26.210=0.061
max26.637-26.601=0.036