Compare commits

Home / Compare 3dd8105a .. d6de9e9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.837=0.000
σ0.368-0.368=-0.001
min53.690-53.698=-0.008
max54.883-54.885=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.137-0.140=-0.004
σ0.005-0.004=0.001
min0.130-0.137=-0.006
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.209-43.207=0.002
σ0.005-0.007=-0.001
min43.200-43.197=0.003
max43.217-43.221=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.123=-0.000
σ0.006-0.004=0.002
min0.116-0.118=-0.002
max0.135-0.129=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.209-1016.204=0.005
σ1.175-1.158=0.017
min1015.633-1015.629=0.004
max1021.130-1021.050=0.080
mean1050.350-1042.100=8.250
σ316.252-310.466=5.786
min547.000-588.000=-41.000
max1628.000-1630.000=-2.000
mean1.535-1.512=0.023
σ0.111-0.078=0.033
min1.449-1.430=0.020
max1.790-1.760=0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.506-301.272=0.235
σ0.210-0.274=-0.064
min301.358-301.087=0.271
max302.078-302.022=0.056
mean2049.000-2025.000=24.000
σ0.000
min2049.000-2025.000=24.000
max2049.000-2025.000=24.000
mean0.570-0.560=0.011
σ0.031-0.032=-0.001
min0.510-0.511=-0.001
max0.605-0.590=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.485-301.486=-0.001
σ0.043-0.045=-0.002
min301.426-301.418=0.009
max301.535-301.537=-0.002
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean0.389-0.391=-0.002
σ0.001-0.001=-0.001
min0.388-0.390=-0.002
max0.389-0.393=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1324.062-1324.066=-0.005
σ0.113-0.117=-0.004
min1323.930-1323.925=0.004
max1324.214-1324.213=0.001
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean1.931-1.916=0.015
σ0.109-0.104=0.005
min1.829-1.838=-0.009
max2.083-2.086=-0.002
iters=5
new-facts=6402
prior-facts=1
mean1562.082-1562.064=0.017
σ6.923-6.910=0.014
min1558.779-1558.733=0.046
max1574.462-1574.419=0.042
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean2.289-2.199=0.089
σ0.268-0.217=0.051
min2.123-2.065=0.058
max2.763-2.583=0.180
iters=5
new-facts=6402
prior-facts=6402
mean1891.969-1891.939=0.030
σ0.067-0.066=0.001
min1891.852-1891.859=-0.008
max1892.015-1892.016=-0.000
mean1771.000-1772.600=-1.600
σ177.413-170.414=7.000
min1628.000-1630.000=-2.000
max2049.000-2025.000=24.000
mean2.907-2.876=0.031
σ0.076-0.125=-0.050
min2.824-2.701=0.123
max3.028-3.040=-0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.245=-0.041
σ0.360-0.370=-0.010
min0.910-0.919=-0.009
max1.817-1.848=-0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.940-443.943=-0.003
σ575.145-575.148=-0.003
min156.361-156.362=-0.001
max1306.658-1306.665=-0.007
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean0.520-0.537=-0.017
σ0.518-0.551=-0.033
min0.260-0.261=-0.001
max1.297-1.363=-0.067
policies=20
mean1563.909-1563.896=0.013
σ0.329-0.318=0.011
min1563.719-1563.707=0.012
max1564.403-1564.372=0.031
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean2.600-2.599=0.001
σ0.014-0.010=0.004
min2.589-2.586=0.003
max2.620-2.609=0.011
policies=200
mean15646.928-15647.009=-0.081
σ0.060-0.121=-0.061
min15646.849-15646.854=-0.005
max15646.986-15647.130=-0.144
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1630.000=-2.000
σ0.000
min1628.000-1630.000=-2.000
max1628.000-1630.000=-2.000
mean26.375-26.369=0.006
σ0.149-0.152=-0.002
min26.235-26.192=0.043
max26.560-26.536=0.024