Compare commits

Home / Compare 57bb4f36 .. 6bb4fbc1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.969=0.002
σ0.368-0.367=0.001
min53.826-53.829=-0.002
max55.018-55.014=0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.137-0.139=-0.002
σ0.006-0.004=0.003
min0.131-0.131=-0.000
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.343-43.342=0.000
σ0.007-0.007=0.000
min43.333-43.336=-0.003
max43.353-43.360=-0.006
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.123-0.123=-0.001
σ0.003-0.004=-0.001
min0.119-0.120=-0.000
max0.131-0.131=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.898-1016.892=0.006
σ1.181-1.180=0.001
min1016.318-1016.331=-0.013
max1021.844-1021.837=0.008
mean1061.450-1049.400=12.050
σ310.031-310.361=-0.329
min598.000-559.000=39.000
max1619.000-1511.000=108.000
mean1.534-1.538=-0.004
σ0.082-0.049=0.033
min1.460-1.481=-0.021
max1.809-1.635=0.174

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.989-302.066=-0.077
σ0.222-0.227=-0.005
min301.855-301.943=-0.088
max302.593-302.697=-0.103
mean1950.000-1962.000=-12.000
σ0.000
min1950.000-1962.000=-12.000
max1950.000-1962.000=-12.000
mean0.600-0.590=0.010
σ0.007-0.032=-0.024
min0.586-0.504=0.082
max0.609-0.617=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.508-303.513=-0.005
σ0.062-0.060=0.002
min303.407-303.418=-0.010
max303.566-303.569=-0.003
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean0.391-0.393=-0.002
σ0.001-0.004=-0.003
min0.390-0.390=0.000
max0.392-0.399=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1326.053-1326.099=-0.045
σ0.098-0.133=-0.035
min1325.926-1325.918=0.008
max1326.178-1326.267=-0.089
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean1.984-1.976=0.008
σ0.092-0.136=-0.044
min1.888-1.815=0.073
max2.093-2.186=-0.093
iters=5
new-facts=6402
prior-facts=1
mean1564.143-1564.136=0.007
σ6.925-6.917=0.009
min1560.782-1560.779=0.003
max1576.524-1576.502=0.022
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean2.424-2.387=0.037
σ0.354-0.287=0.067
min2.083-2.144=-0.061
max2.893-2.758=0.135
iters=5
new-facts=6402
prior-facts=6402
mean1894.011-1894.008=0.003
σ0.077-0.070=0.008
min1893.873-1893.884=-0.011
max1894.052-1894.053=-0.001
mean1776.400-1736.800=39.600
σ119.094-168.916=-49.823
min1619.000-1512.000=107.000
max1950.000-1962.000=-12.000
mean2.938-2.946=-0.008
σ0.125-0.117=0.009
min2.814-2.789=0.026
max3.137-3.088=0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.185-1.506=-0.321
σ0.380-0.242=0.139
min0.892-1.225=-0.333
max1.816-1.809=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.706-444.701=0.005
σ575.148-575.140=0.007
min157.125-157.125=0.001
max1307.427-1307.411=0.016
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean0.536-0.541=-0.005
σ0.545-0.561=-0.017
min0.260-0.259=0.002
max1.353-1.383=-0.030
policies=20
mean1571.561-1571.532=0.029
σ0.337-0.335=0.002
min1571.374-1571.312=0.062
max1572.066-1572.031=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean2.640-2.613=0.026
σ0.011-0.017=-0.006
min2.629-2.599=0.031
max2.655-2.635=0.020
policies=200
mean15723.329-15723.370=-0.041
σ0.076-0.081=-0.005
min15723.235-15723.324=-0.089
max15723.420-15723.491=-0.071
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1511.000=108.000
σ0.000
min1619.000-1511.000=108.000
max1619.000-1511.000=108.000
mean26.626-26.471=0.155
σ0.161-0.135=0.026
min26.467-26.343=0.124
max26.806-26.617=0.188