Compare commits

Home / Compare ab3ae8ec .. d0ba15c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.708-53.647=0.062
σ0.365-0.367=-0.002
min53.570-53.510=0.060
max54.747-54.691=0.056
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.138-0.139=-0.001
σ0.004-0.003=0.001
min0.132-0.135=-0.003
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.942=0.039
σ0.004-0.009=-0.005
min42.974-42.926=0.048
max42.987-42.954=0.033
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.126-0.121=0.005
σ0.011-0.004=0.008
min0.114-0.118=-0.004
max0.145-0.127=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.221-991.860=3.361
σ1.186-1.211=-0.025
min994.680-991.331=3.348
max1000.196-996.938=3.259
mean1062.000-1069.950=-7.950
σ312.268-319.470=-7.203
min612.000-606.000=6.000
max1633.000-1647.000=-14.000
mean1.470-1.500=-0.030
σ0.068-0.072=-0.004
min1.369-1.428=-0.059
max1.601-1.730=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.320-285.435=11.884
σ0.007-0.007=-0.000
min297.310-285.424=11.886
max297.330-285.442=11.888
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean0.386-0.377=0.009
σ0.001-0.007=-0.006
min0.386-0.373=0.013
max0.388-0.389=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1299.038-1285.524=13.514
σ0.038-0.076=-0.038
min1298.970-1285.388=13.581
max1299.060-1285.566=13.494
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean2.019-2.045=-0.026
σ0.221-0.248=-0.027
min1.861-1.813=0.048
max2.368-2.435=-0.066
iters=5
new-facts=6402
prior-facts=1
mean1719.177-1705.822=13.356
σ6.914-6.846=0.068
min1715.961-1702.625=13.336
max1731.542-1718.064=13.478
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean3.021-3.082=-0.061
σ0.434-0.252=0.183
min2.525-2.741=-0.216
max3.582-3.327=0.255
iters=5
new-facts=6402
prior-facts=6402
mean1981.918-1968.418=13.500
σ0.029-0.026=0.003
min1981.872-1968.372=13.500
max1981.948-1968.436=13.512
mean1802.800-1800.200=2.600
σ198.093-159.089=39.004
min1633.000-1647.000=-14.000
max2096.000-2021.000=75.000
mean3.424-3.346=0.078
σ0.373-0.393=-0.020
min3.084-3.067=0.016
max4.049-4.039=0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.181=0.014
σ0.306-0.232=0.074
min0.903-0.913=-0.010
max1.647-1.512=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.462-436.774=3.688
σ573.040-572.364=0.676
min153.937-150.590=3.348
max1300.023-1295.321=4.702
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean0.530-0.528=0.002
σ0.541-0.557=-0.016
min0.257-0.246=0.012
max1.341-1.363=-0.022
policies=20
mean1539.614-1506.180=33.435
σ0.294-0.231=0.063
min1539.434-1506.033=33.401
max1540.052-1506.524=33.528
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean2.559-2.505=0.054
σ0.008-0.014=-0.005
min2.550-2.488=0.062
max2.568-2.521=0.047
policies=200
mean15404.117-15069.517=334.601
σ0.045-0.047=-0.002
min15404.072-15069.465=334.607
max15404.180-15069.579=334.601
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1633.000-1647.000=-14.000
σ0.000
min1633.000-1647.000=-14.000
max1633.000-1647.000=-14.000
mean25.948-25.339=0.609
σ0.111-0.137=-0.026
min25.850-25.161=0.689
max26.071-25.465=0.606