Compare commits

Home / Compare ba46ca3a .. b3d29f6e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.653=0.000
σ0.367-0.367=0.001
min53.518-53.516=0.003
max54.698-54.696=0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.136-0.136=0.001
σ0.004-0.006=-0.002
min0.130-0.128=0.002
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.984=-0.004
σ0.006-0.009=-0.003
min42.971-42.971=0.000
max42.991-42.999=-0.008
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.129=-0.008
σ0.003-0.010=-0.007
min0.118-0.119=-0.001
max0.128-0.144=-0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.973-1013.981=-0.007
σ1.171-1.172=-0.001
min1013.431-1013.422=0.009
max1018.872-1018.888=-0.015
mean1048.700-1053.100=-4.400
σ319.687-318.152=1.536
min585.000-586.000=-1.000
max1655.000-1661.000=-6.000
mean1.623-1.638=-0.016
σ0.077-0.115=-0.038
min1.492-1.560=-0.067
max1.852-2.021=-0.169

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.250-299.020=0.230
σ0.183-0.264=-0.082
min299.047-298.871=0.177
max299.694-299.755=-0.061
mean2081.000-1945.000=136.000
σ0.000
min2081.000-1945.000=136.000
max2081.000-1945.000=136.000
mean0.564-0.620=-0.056
σ0.018-0.044=-0.026
min0.545-0.587=-0.042
max0.600-0.741=-0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.683=-0.005
σ0.010-0.015=-0.006
min294.665-294.665=-0.001
max294.690-294.706=-0.016
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean0.384-0.385=-0.001
σ0.001-0.001=-0.000
min0.382-0.384=-0.001
max0.385-0.386=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1316.953-1316.943=0.010
σ0.077-0.089=-0.011
min1316.901-1316.896=0.005
max1317.089-1317.102=-0.013
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean1.937-1.950=-0.013
σ0.079-0.080=-0.002
min1.845-1.862=-0.017
max2.032-2.068=-0.037
iters=5
new-facts=6402
prior-facts=1
mean1555.320-1555.329=-0.009
σ6.807-6.818=-0.011
min1552.052-1552.019=0.033
max1567.493-1567.520=-0.027
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean2.309-2.360=-0.051
σ0.273-0.245=0.028
min2.067-2.102=-0.035
max2.711-2.630=0.082
iters=5
new-facts=6402
prior-facts=6402
mean1884.782-1884.777=0.005
σ0.044-0.023=0.021
min1884.746-1884.755=-0.009
max1884.859-1884.817=0.042
mean1813.000-1794.000=19.000
σ186.971-143.419=43.552
min1655.000-1661.000=-6.000
max2081.000-1945.000=136.000
mean3.044-2.958=0.086
σ0.139-0.062=0.077
min2.856-2.880=-0.024
max3.204-3.025=0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.186=0.004
σ0.330-0.367=-0.037
min0.921-0.929=-0.008
max1.743-1.796=-0.054

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.582-440.581=0.001
σ573.053-573.048=0.005
min154.048-154.055=-0.007
max1300.161-1300.154=0.008
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean0.573-0.537=0.037
σ0.608-0.532=0.076
min0.267-0.269=-0.002
max1.486-1.335=0.151
policies=20
mean1540.730-1540.706=0.024
σ0.297-0.258=0.039
min1540.562-1540.552=0.010
max1541.175-1541.092=0.083
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean2.573-2.595=-0.022
σ0.017-0.016=0.001
min2.554-2.578=-0.024
max2.595-2.615=-0.021
policies=200
mean15415.331-15415.236=0.095
σ0.064-0.230=-0.167
min15415.280-15414.916=0.363
max15415.424-15415.451=-0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1661.000=-6.000
σ0.000
min1655.000-1661.000=-6.000
max1655.000-1661.000=-6.000
mean26.201-26.231=-0.030
σ0.096-0.198=-0.102
min26.113-25.995=0.118
max26.323-26.450=-0.127