Compare commits

Home / Compare 85e64a8c .. 7ae80c0a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.970-53.837=0.133
σ0.368-0.368=0.000
min53.827-53.690=0.137
max55.017-54.883=0.134
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.136-0.139=-0.003
σ0.005-0.004=0.001
min0.130-0.136=-0.005
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.341-43.208=0.133
σ0.007-0.005=0.002
min43.328-43.202=0.126
max43.354-43.216=0.139
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.121=0.001
σ0.003-0.005=-0.002
min0.119-0.114=0.005
max0.127-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.894-1016.205=0.689
σ1.181-1.192=-0.011
min1016.332-1015.658=0.674
max1021.832-1021.207=0.625
mean1059.200-1055.750=3.450
σ315.878-317.380=-1.502
min555.000-548.000=7.000
max1516.000-1631.000=-115.000
mean1.526-1.557=-0.031
σ0.106-0.098=0.008
min1.371-1.475=-0.104
max1.789-1.785=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.028-301.307=0.722
σ0.196-0.198=-0.002
min301.861-301.163=0.699
max302.542-301.836=0.706
mean2025.000-2039.000=-14.000
σ0.000
min2025.000-2039.000=-14.000
max2025.000-2039.000=-14.000
mean0.598-0.563=0.035
σ0.007-0.034=-0.026
min0.584-0.499=0.085
max0.608-0.592=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.520-301.483=2.038
σ0.048-0.045=0.003
min303.448-301.416=2.032
max303.573-301.533=2.040
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean0.392-0.390=0.002
σ0.005-0.002=0.004
min0.389-0.389=0.000
max0.401-0.392=0.009
iters=5
new-facts=1
prior-facts=6402
mean1326.059-1324.050=2.009
σ0.108-0.096=0.012
min1325.924-1323.929=1.994
max1326.199-1324.174=2.025
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean1.926-1.915=0.012
σ0.084-0.109=-0.025
min1.827-1.820=0.007
max2.016-2.083=-0.066
iters=5
new-facts=6402
prior-facts=1
mean1564.106-1562.115=1.991
σ6.931-6.903=0.028
min1560.758-1558.836=1.922
max1576.498-1574.460=2.039
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean2.267-2.405=-0.138
σ0.277-0.327=-0.051
min2.123-2.076=0.047
max2.760-2.751=0.009
iters=5
new-facts=6402
prior-facts=6402
mean1894.005-1891.975=2.030
σ0.067-0.067=0.000
min1893.885-1891.857=2.027
max1894.041-1892.022=2.018
mean1746.600-1773.200=-26.600
σ204.713-172.720=31.993
min1516.000-1631.000=-115.000
max2025.000-2039.000=-14.000
mean2.952-2.926=0.027
σ0.080-0.123=-0.043
min2.875-2.865=0.010
max3.071-3.146=-0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.516-1.179=0.337
σ0.314-0.278=0.036
min1.158-0.910=0.249
max1.819-1.634=0.184

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.700-443.941=0.760
σ575.139-575.145=-0.006
min157.125-156.367=0.758
max1307.409-1306.658=0.751
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean0.544-0.531=0.013
σ0.557-0.538=0.019
min0.264-0.260=0.003
max1.379-1.338=0.042
policies=20
mean1571.548-1563.918=7.630
σ0.346-0.326=0.020
min1571.328-1563.736=7.592
max1572.064-1564.406=7.658
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean2.655-2.617=0.038
σ0.054-0.021=0.034
min2.605-2.589=0.016
max2.715-2.634=0.081
policies=200
mean15723.263-15646.926=76.337
σ0.130-0.153=-0.023
min15723.153-15646.745=76.408
max15723.425-15647.109=76.316
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1631.000=-115.000
σ0.000
min1516.000-1631.000=-115.000
max1516.000-1631.000=-115.000
mean26.511-26.551=-0.039
σ0.192-0.239=-0.047
min26.342-26.320=0.022
max26.752-26.774=-0.022