Compare commits

Home / Compare 13dff867 .. ca3a480e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.108-0.107=0.001
min35.753-35.752=0.001
max36.106-36.102=0.003
mean411.200-415.300=-4.100
σ0.422-0.483=-0.061
min411.000-415.000=-4.000
max412.000-416.000=-4.000
mean0.076-0.072=0.003
σ0.003-0.003=0.000
min0.073-0.069=0.004
max0.083-0.079=0.004
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.004=0.000
min26.061-26.059=0.003
max26.074-26.072=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.060-0.061=-0.001
σ0.003-0.003=0.000
min0.057-0.057=0.000
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.925=-0.001
σ0.365-0.368=-0.003
min1755.351-1755.353=-0.001
max1756.497-1756.517=-0.020
mean1650.200-1672.800=-22.600
σ648.354-630.758=17.596
min609.000-668.000=-59.000
max2741.000-2628.000=113.000
mean2.866-2.784=0.081
σ0.189-0.229=-0.040
min2.199-2.272=-0.073
max3.091-3.395=-0.304

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.176=0.020
σ0.006-0.010=-0.004
min277.191-277.162=0.028
max277.206-277.190=0.016
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean0.405-0.402=0.004
σ0.009-0.007=0.001
min0.400-0.392=0.008
max0.421-0.411=0.009
iters=5
new-facts=1
prior-facts=6402
mean2174.427-2174.434=-0.007
σ0.010-0.009=0.001
min2174.415-2174.425=-0.010
max2174.441-2174.446=-0.005
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean2.808-3.024=-0.216
σ0.158-0.180=-0.022
min2.670-2.762=-0.093
max3.007-3.224=-0.217
iters=5
new-facts=6402
prior-facts=1
mean5052.602-5052.644=-0.043
σ0.992-0.986=0.006
min5051.993-5052.064=-0.070
max5054.360-5054.397=-0.036
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean8.989-8.913=0.076
σ0.629-0.659=-0.030
min8.091-8.295=-0.204
max9.619-9.953=-0.334
iters=5
new-facts=6402
prior-facts=6402
mean5188.255-5188.362=-0.107
σ0.106-0.126=-0.020
min5188.131-5188.167=-0.036
max5188.366-5188.516=-0.150
mean3227.400-3280.200=-52.800
σ463.644-436.529=27.115
min2741.000-2674.000=67.000
max3874.000-3684.000=190.000
mean8.772-9.086=-0.315
σ0.157-0.601=-0.444
min8.648-8.723=-0.076
max9.022-10.154=-1.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.214=-0.188
σ0.135-0.336=-0.201
min0.937-0.937=-0.001
max1.247-1.756=-0.509

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.859=-0.004
σ572.648-572.662=-0.015
min178.524-178.526=-0.002
max1323.827-1323.853=-0.026
mean79.500
σ7.000
min76.000
max90.000
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean0.539-0.568=-0.029
σ0.517-0.559=-0.042
min0.279-0.285=-0.007
max1.315-1.407=-0.092
policies=20
mean1785.479-1785.490=-0.011
σ0.342-0.347=-0.006
min1785.264-1785.255=0.009
max1785.988-1786.004=-0.016
mean760.000
σ0.000
min760.000
max760.000
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean2.790-2.815=-0.026
σ0.016-0.036=-0.020
min2.767-2.772=-0.005
max2.802-2.857=-0.055
policies=200
mean17861.553-17861.399=0.154
σ0.489-0.536=-0.048
min17861.288-17861.051=0.237
max17862.285-17862.188=0.097
mean7600.000
σ0.000
min7600.000
max7600.000
mean2741.000-2628.000=113.000
σ0.000
min2741.000-2628.000=113.000
max2741.000-2628.000=113.000
mean28.073-28.218=-0.145
σ0.146-0.142=0.005
min27.940-28.056=-0.116
max28.214-28.347=-0.133