Compare commits

Home / Compare 4461bd8e .. 9bea6ce3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.656-53.655=0.001
σ0.372-0.370=0.003
min53.515-53.516=-0.001
max54.714-54.706=0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.139-0.140=-0.001
σ0.003-0.002=0.001
min0.136-0.138=-0.002
max0.145-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean42.980-42.981=-0.001
σ0.006-0.006=0.001
min42.970-42.975=-0.004
max42.992-42.993=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.120=-0.000
σ0.003-0.004=-0.001
min0.115-0.115=-0.001
max0.124-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.701-1013.697=0.004
σ1.203-1.217=-0.014
min1013.162-1013.160=0.002
max1018.740-1018.791=-0.052
mean1060.700-1055.000=5.700
σ316.371-315.877=0.493
min595.000-593.000=2.000
max1637.000-1658.000=-21.000
mean1.636-1.640=-0.005
σ0.104-0.096=0.008
min1.488-1.498=-0.010
max1.917-1.893=0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.168-334.075=0.094
σ0.203-0.215=-0.012
min334.020-333.820=0.200
max334.721-334.618=0.103
mean2096.000-2108.000=-12.000
σ0.000
min2096.000-2108.000=-12.000
max2096.000-2108.000=-12.000
mean0.738-0.745=-0.008
σ0.025-0.025=0.001
min0.696-0.706=-0.010
max0.763-0.779=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.411-294.412=-0.001
σ0.020-0.020=0.000
min294.389-294.387=0.002
max294.444-294.440=0.004
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean0.387-0.389=-0.002
σ0.010-0.010=0.000
min0.382-0.379=0.002
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1316.725-1316.727=-0.003
σ0.091-0.092=-0.001
min1316.562-1316.563=-0.001
max1316.777-1316.781=-0.005
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean1.875-1.899=-0.023
σ0.034-0.046=-0.012
min1.834-1.852=-0.018
max1.926-1.956=-0.031
iters=5
new-facts=6402
prior-facts=1
mean1736.956-1736.952=0.004
σ6.911-6.901=0.010
min1733.770-1733.711=0.058
max1749.317-1749.292=0.025
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean2.932-3.042=-0.110
σ0.408-0.391=0.017
min2.609-2.466=0.143
max3.602-3.517=0.084
iters=5
new-facts=6402
prior-facts=6402
mean1999.643-1999.631=0.012
σ0.026-0.045=-0.019
min1999.614-1999.567=0.047
max1999.669-1999.680=-0.011
mean1837.200-1844.600=-7.400
σ190.375-191.470=-1.095
min1637.000-1658.000=-21.000
max2096.000-2108.000=-12.000
mean3.299-3.263=0.036
σ0.095-0.087=0.008
min3.213-3.141=0.072
max3.452-3.381=0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.186=-0.018
σ0.274-0.340=-0.066
min0.908-0.917=-0.009
max1.616-1.758=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.090-441.093=-0.004
σ573.035-573.035=-0.000
min154.567-154.570=-0.003
max1300.642-1300.646=-0.004
mean94.250
σ8.500
min90.000
max107.000
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean0.564-0.557=0.007
σ0.597-0.595=0.002
min0.262-0.239=0.023
max1.459-1.449=0.010
policies=20
mean1545.920-1545.930=-0.009
σ0.347-0.330=0.016
min1545.718-1545.733=-0.015
max1546.439-1546.424=0.015
mean900.000
σ0.000
min900.000
max900.000
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean2.644-2.656=-0.012
σ0.026-0.023=0.003
min2.621-2.636=-0.015
max2.678-2.689=-0.011
policies=200
mean15467.038-15467.030=0.008
σ0.061-0.118=-0.057
min15466.950-15466.927=0.023
max15467.081-15467.164=-0.082
mean9000.000
σ0.000
min9000.000
max9000.000
mean1637.000-1658.000=-21.000
σ0.000
min1637.000-1658.000=-21.000
max1637.000-1658.000=-21.000
mean26.665-26.811=-0.146
σ0.116-0.129=-0.013
min26.533-26.673=-0.140
max26.808-26.984=-0.176