Compare commits

Home / Compare dd3d23a7 .. 76cc0fbf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.836=0.001
σ0.369-0.370=-0.001
min53.692-53.692=0.000
max54.886-54.888=-0.002
mean422.000-416.000=6.000
σ0.000
min422.000-416.000=6.000
max422.000-416.000=6.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.001
min0.132-0.136=-0.004
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.001
σ0.006-0.006=-0.001
min43.200-43.197=0.003
max43.220-43.222=-0.002
mean422.000-416.000=6.000
σ0.000
min422.000-416.000=6.000
max422.000-416.000=6.000
mean0.119-0.121=-0.002
σ0.003-0.003=-0.001
min0.113-0.117=-0.004
max0.123-0.127=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.204=0.003
σ1.168-1.167=0.000
min1015.631-1015.651=-0.020
max1021.095-1021.092=0.003
mean1053.600-1050.900=2.700
σ311.247-303.538=7.709
min562.000-574.000=-12.000
max1517.000-1452.000=65.000
mean1.537-1.573=-0.036
σ0.049-0.080=-0.031
min1.472-1.510=-0.038
max1.634-1.780=-0.146

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.222-301.478=-0.257
σ0.180-0.210=-0.030
min301.096-301.230=-0.135
max301.706-301.967=-0.261
mean2008.000-2017.000=-9.000
σ0.000
min2008.000-2017.000=-9.000
max2008.000-2017.000=-9.000
mean0.563-0.543=0.020
σ0.031-0.046=-0.015
min0.500-0.496=0.004
max0.605-0.607=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-301.482=-0.007
σ0.057-0.042=0.015
min301.383-301.430=-0.047
max301.531-301.526=0.005
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean0.390-0.390=-0.000
σ0.001-0.002=-0.001
min0.389-0.388=0.001
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1324.065-1324.053=0.011
σ0.113-0.102=0.011
min1323.925-1323.923=0.003
max1324.204-1324.187=0.017
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean1.872-1.960=-0.088
σ0.055-0.129=-0.074
min1.815-1.833=-0.018
max1.954-2.135=-0.181
iters=5
new-facts=6402
prior-facts=1
mean1562.072-1562.102=-0.030
σ6.898-6.918=-0.020
min1558.755-1558.801=-0.046
max1574.405-1574.472=-0.067
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean2.262-2.384=-0.123
σ0.185-0.328=-0.143
min2.029-2.057=-0.029
max2.503-2.784=-0.281
iters=5
new-facts=6402
prior-facts=6402
mean1891.970-1891.967=0.003
σ0.066-0.069=-0.003
min1891.854-1891.846=0.008
max1892.009-1892.008=0.001
mean1725.800-1713.600=12.200
σ207.106-221.093=-13.988
min1517.000-1452.000=65.000
max2008.000-2017.000=-9.000
mean3.027-2.976=0.050
σ0.367-0.146=0.221
min2.816-2.843=-0.027
max3.680-3.137=0.543

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.476-1.715=-0.239
σ0.327-0.132=0.195
min1.049-1.544=-0.495
max1.787-1.850=-0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.478-443.476=0.002
σ574.230-574.225=0.005
min156.362-156.358=0.005
max1304.824-1304.814=0.010
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean0.533-0.528=0.005
σ0.549-0.532=0.017
min0.256-0.261=-0.005
max1.356-1.326=0.029
policies=20
mean1563.892-1563.911=-0.019
σ0.346-0.345=0.001
min1563.675-1563.680=-0.006
max1564.409-1564.425=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean2.625-2.626=-0.001
σ0.010-0.004=0.005
min2.613-2.622=-0.009
max2.636-2.632=0.003
policies=200
mean15646.948-15646.920=0.028
σ0.147-0.120=0.027
min15646.820-15646.797=0.023
max15647.093-15647.082=0.011
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1452.000=65.000
σ0.000
min1517.000-1452.000=65.000
max1517.000-1452.000=65.000
mean26.497-26.655=-0.158
σ0.113-0.216=-0.103
min26.397-26.507=-0.110
max26.615-26.969=-0.354