Compare commits

Home / Compare 6aca0daf .. a05bf2f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.970-53.835=0.134
σ0.368-0.367=0.001
min53.827-53.689=0.138
max55.017-54.879=0.138
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.136-0.138=-0.003
σ0.005-0.005=0.000
min0.130-0.132=-0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.341-43.209=0.132
σ0.007-0.006=0.001
min43.328-43.200=0.128
max43.354-43.220=0.134
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.121=0.002
σ0.003-0.003=0.000
min0.119-0.116=0.003
max0.127-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.894-1016.208=0.686
σ1.181-1.165=0.017
min1016.332-1015.630=0.703
max1021.832-1021.082=0.751
mean1059.200-1047.450=11.750
σ315.878-311.884=3.994
min555.000-561.000=-6.000
max1516.000-1513.000=3.000
mean1.526-1.512=0.014
σ0.106-0.056=0.050
min1.371-1.448=-0.076
max1.789-1.625=0.164

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.028-301.385=0.644
σ0.196-0.234=-0.038
min301.861-301.259=0.602
max302.542-302.041=0.500
mean2025.000-2028.000=-3.000
σ0.000
min2025.000-2028.000=-3.000
max2025.000-2028.000=-3.000
mean0.598-0.560=0.038
σ0.007-0.037=-0.029
min0.584-0.512=0.071
max0.608-0.597=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.520-300.723=2.797
σ0.048-0.034=0.014
min303.448-300.672=2.776
max303.573-300.761=2.812
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean0.392-0.401=-0.009
σ0.005-0.005=-0.000
min0.389-0.392=-0.003
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1326.059-1322.890=3.169
σ0.108-0.089=0.019
min1325.924-1322.836=3.088
max1326.199-1323.044=3.155
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean1.926-1.932=-0.006
σ0.084-0.120=-0.036
min1.827-1.835=-0.009
max2.016-2.067=-0.051
iters=5
new-facts=6402
prior-facts=1
mean1564.106-1561.385=2.721
σ6.931-6.834=0.097
min1560.758-1558.154=2.604
max1576.498-1573.607=2.891
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean2.267-2.402=-0.135
σ0.277-0.255=0.022
min2.123-2.037=0.085
max2.760-2.678=0.082
iters=5
new-facts=6402
prior-facts=6402
mean1894.005-1890.814=3.191
σ0.067-0.019=0.048
min1893.885-1890.787=3.098
max1894.041-1890.839=3.202
mean1746.600-1736.600=10.000
σ204.713-217.153=-12.440
min1516.000-1513.000=3.000
max2025.000-2028.000=-3.000
mean2.952-3.029=-0.077
σ0.080-0.328=-0.248
min2.875-2.855=0.021
max3.071-3.615=-0.543

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.516-1.558=-0.041
σ0.314-0.359=-0.044
min1.158-1.094=0.064
max1.819-1.847=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.700-443.478=1.223
σ575.139-574.232=0.907
min157.125-156.360=0.765
max1307.409-1304.826=2.583
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean0.544-0.544=-0.000
σ0.557-0.561=-0.004
min0.264-0.261=0.002
max1.379-1.385=-0.006
policies=20
mean1571.548-1563.886=7.662
σ0.346-0.333=0.013
min1571.328-1563.676=7.652
max1572.064-1564.383=7.681
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean2.655-2.610=0.045
σ0.054-0.014=0.040
min2.605-2.598=0.006
max2.715-2.630=0.085
policies=200
mean15723.263-15646.987=76.276
σ0.130-0.144=-0.014
min15723.153-15646.790=76.363
max15723.425-15647.095=76.330
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1513.000=3.000
σ0.000
min1516.000-1513.000=3.000
max1516.000-1513.000=3.000
mean26.511-26.528=-0.016
σ0.192-0.315=-0.123
min26.342-26.241=0.101
max26.752-26.953=-0.201