Compare commits

Home / Compare a1a1b1b6 .. ef3bf56f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.823=-0.001
σ0.368-0.369=-0.001
min53.677-53.677=-0.001
max54.868-54.872=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.134-0.139=-0.004
σ0.005-0.005=-0.001
min0.130-0.130=-0.001
max0.141-0.147=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.005-0.007=-0.002
min43.201-43.196=0.005
max43.217-43.220=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.118-0.122=-0.004
σ0.003-0.004=-0.001
min0.114-0.119=-0.005
max0.122-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-1016.178=0.000
σ1.167-1.166=0.001
min1015.630-1015.603=0.027
max1021.062-1021.058=0.005
mean1044.100-1047.350=-3.250
σ292.924-296.972=-4.048
min577.000-576.000=1.000
max1430.000-1444.000=-14.000
mean1.555-1.560=-0.005
σ0.066-0.051=0.015
min1.469-1.503=-0.035
max1.753-1.655=0.098

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.366-301.228=0.138
σ0.251-0.241=0.010
min301.210-301.052=0.158
max302.062-301.890=0.172
mean2012.000-2009.000=3.000
σ0.000
min2012.000-2009.000=3.000
max2012.000-2009.000=3.000
mean0.560-0.544=0.017
σ0.037-0.027=0.010
min0.502-0.501=0.000
max0.603-0.578=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.698-300.699=-0.001
σ0.024-0.022=0.002
min300.667-300.666=0.001
max300.728-300.726=0.002
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean0.392-0.395=-0.003
σ0.005-0.009=-0.004
min0.389-0.389=0.000
max0.401-0.409=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1322.875-1322.874=0.002
σ0.096-0.096=-0.001
min1322.817-1322.818=-0.001
max1323.041-1323.043=-0.001
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean1.891-1.901=-0.009
σ0.076-0.074=0.002
min1.808-1.813=-0.005
max1.997-1.996=0.000
iters=5
new-facts=6402
prior-facts=1
mean1561.333-1561.302=0.032
σ6.830-6.874=-0.044
min1558.039-1558.012=0.027
max1573.547-1573.593=-0.046
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean2.368-2.294=0.074
σ0.205-0.245=-0.041
min2.020-2.062=-0.042
max2.538-2.624=-0.085
iters=5
new-facts=6402
prior-facts=6402
mean1890.779-1890.803=-0.024
σ0.024-0.024=0.000
min1890.742-1890.775=-0.033
max1890.809-1890.834=-0.025
mean1711.200-1716.200=-5.000
σ234.537-227.211=7.327
min1430.000-1444.000=-14.000
max2012.000-2009.000=3.000
mean2.988-3.074=-0.085
σ0.303-0.274=0.029
min2.709-2.866=-0.157
max3.450-3.500=-0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.660-1.664=-0.004
σ0.176-0.106=0.071
min1.372-1.522=-0.150
max1.810-1.790=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.323-443.324=-0.001
σ573.978-573.979=-0.002
min156.329-156.330=-0.001
max1304.290-1304.293=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean0.555-0.529=0.026
σ0.585-0.531=0.054
min0.259-0.263=-0.003
max1.432-1.325=0.106
policies=20
mean1563.608-1563.609=-0.002
σ0.335-0.344=-0.009
min1563.398-1563.387=0.011
max1564.108-1564.122=-0.014
mean920.000
σ0.000
min920.000
max920.000
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean2.602-2.616=-0.013
σ0.012-0.020=-0.008
min2.585-2.596=-0.011
max2.611-2.643=-0.032
policies=200
mean15644.076-15644.066=0.011
σ0.083-0.065=0.018
min15643.961-15643.969=-0.009
max15644.144-15644.114=0.030
mean9200.000
σ0.000
min9200.000
max9200.000
mean1430.000-1444.000=-14.000
σ0.000
min1430.000-1444.000=-14.000
max1430.000-1444.000=-14.000
mean26.445-26.534=-0.089
σ0.073-0.125=-0.053
min26.400-26.429=-0.029
max26.553-26.714=-0.161