Compare commits

Home / Compare 1526f2db .. 1ae6764b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.838-53.838=0.000
σ0.368-0.366=0.002
min53.698-53.696=0.002
max54.885-54.880=0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.142-0.139=0.004
σ0.010-0.004=0.005
min0.132-0.135=-0.003
max0.159-0.146=0.013
cache=y
dps=1
iters=10
policies=100
mean43.207-43.208=-0.001
σ0.008-0.006=0.002
min43.196-43.201=-0.006
max43.223-43.218=0.005
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.123=-0.004
σ0.005-0.004=0.001
min0.114-0.120=-0.006
max0.132-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.208-1016.204=0.004
σ1.183-1.178=0.005
min1015.629-1015.656=-0.026
max1021.162-1021.142=0.020
mean1047.400-1048.650=-1.250
σ311.298-297.982=13.316
min555.000-580.000=-25.000
max1511.000-1457.000=54.000
mean1.524-1.583=-0.059
σ0.079-0.097=-0.018
min1.363-1.495=-0.133
max1.723-1.820=-0.097

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.320-301.288=0.032
σ0.262-0.218=0.044
min301.027-301.095=-0.068
max301.929-301.843=0.086
mean2013.000-2017.000=-4.000
σ0.000
min2013.000-2017.000=-4.000
max2013.000-2017.000=-4.000
mean0.543-0.559=-0.016
σ0.036-0.029=0.007
min0.502-0.501=0.001
max0.592-0.579=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.469-301.485=-0.016
σ0.065-0.046=0.019
min301.365-301.418=-0.052
max301.526-301.531=-0.005
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean0.389-0.400=-0.010
σ0.001-0.011=-0.010
min0.389-0.388=0.001
max0.390-0.411=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1324.057-1324.057=-0.000
σ0.105-0.102=0.003
min1323.927-1323.928=-0.002
max1324.184-1324.180=0.004
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean1.940-1.934=0.006
σ0.107-0.093=0.014
min1.832-1.831=0.001
max2.057-2.074=-0.017
iters=5
new-facts=6402
prior-facts=1
mean1562.121-1562.144=-0.022
σ6.862-6.866=-0.004
min1558.870-1558.934=-0.064
max1574.392-1574.422=-0.030
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean2.379-2.430=-0.051
σ0.213-0.289=-0.076
min2.068-2.062=0.007
max2.614-2.732=-0.118
iters=5
new-facts=6402
prior-facts=6402
mean1891.977-1891.976=0.002
σ0.067-0.075=-0.008
min1891.860-1891.847=0.013
max1892.025-1892.039=-0.014
mean1717.600-1715.800=1.800
σ206.237-226.984=-20.747
min1511.000-1457.000=54.000
max2013.000-2017.000=-4.000
mean3.027-2.933=0.094
σ0.215-0.132=0.083
min2.861-2.859=0.003
max3.348-3.169=0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.489-1.616=-0.127
σ0.333-0.157=0.177
min1.043-1.454=-0.412
max1.783-1.813=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.730-443.728=0.002
σ574.729-574.724=0.004
min156.361-156.362=-0.001
max1305.822-1305.814=0.009
mean96.250
σ8.500
min92.000
max109.000
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean0.537-0.548=-0.011
σ0.550-0.576=-0.026
min0.259-0.258=0.001
max1.363-1.413=-0.050
policies=20
mean1563.887-1563.901=-0.014
σ0.336-0.327=0.009
min1563.666-1563.680=-0.014
max1564.387-1564.387=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean2.612-2.593=0.019
σ0.009-0.013=-0.004
min2.604-2.582=0.022
max2.624-2.611=0.014
policies=200
mean15646.943-15646.890=0.054
σ0.116-0.185=-0.070
min15646.806-15646.706=0.100
max15647.087-15647.141=-0.054
mean9200.000
σ0.000
min9200.000
max9200.000
mean1511.000-1457.000=54.000
σ0.000
min1511.000-1457.000=54.000
max1511.000-1457.000=54.000
mean26.410-26.376=0.034
σ0.206-0.153=0.053
min26.187-26.206=-0.018
max26.628-26.533=0.095