Compare commits

Home / Compare 1c31cc64 .. 0aa75d9f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.107-0.107=0.000
min35.751-35.749=0.002
max36.104-36.102=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.075=0.001
σ0.004-0.003=0.000
min0.074-0.071=0.003
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.000
σ0.002-0.003=-0.002
min26.062-26.060=0.002
max26.067-26.069=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.061-0.061=0.001
σ0.003-0.003=-0.000
min0.059-0.057=0.002
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=-0.000
σ0.368-0.365=0.002
min1755.351-1755.345=0.006
max1756.514-1756.517=-0.002
mean1669.750-1672.000=-2.250
σ634.755-639.372=-4.617
min669.000-673.000=-4.000
max2632.000-2700.000=-68.000
mean2.823-2.815=0.008
σ0.152-0.109=0.044
min2.446-2.576=-0.130
max3.074-3.000=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-277.194=-0.001
σ0.005-0.007=-0.003
min277.189-277.184=0.006
max277.200-277.203=-0.003
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean0.396-0.395=0.001
σ0.009-0.010=-0.001
min0.391-0.390=0.001
max0.411-0.412=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2174.445-2174.433=0.012
σ0.022-0.014=0.009
min2174.421-2174.415=0.006
max2174.471-2174.450=0.021
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean2.931-3.032=-0.101
σ0.125-0.229=-0.104
min2.779-2.775=0.004
max3.105-3.325=-0.220
iters=5
new-facts=6402
prior-facts=1
mean5052.479-5052.635=-0.156
σ1.077-0.986=0.091
min5051.514-5052.051=-0.537
max5054.334-5054.387=-0.053
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean8.802-8.639=0.163
σ0.557-0.676=-0.118
min8.125-7.979=0.146
max9.451-9.706=-0.254
iters=5
new-facts=6402
prior-facts=6402
mean5188.333-5188.426=-0.093
σ0.131-0.083=0.048
min5188.180-5188.365=-0.185
max5188.516-5188.520=-0.004
mean3293.000-3236.400=56.600
σ417.447-381.299=36.148
min2709.000-2700.000=9.000
max3679.000-3698.000=-19.000
mean8.986-8.957=0.029
σ0.409-0.511=-0.102
min8.676-8.653=0.023
max9.704-9.863=-0.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.317-1.100=0.218
σ0.393-0.122=0.271
min0.947-0.933=0.014
max1.820-1.248=0.573

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.858=-0.003
σ572.660-572.660=0.000
min178.521-178.524=-0.003
max1323.845-1323.848=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean0.557-0.560=-0.003
σ0.543-0.560=-0.017
min0.280-0.274=0.006
max1.371-1.400=-0.029
policies=20
mean1785.484-1785.487=-0.003
σ0.352-0.348=0.004
min1785.257-1785.253=0.004
max1786.008-1786.004=0.004
mean760.000
σ0.000
min760.000
max760.000
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean2.783-2.786=-0.002
σ0.017-0.012=0.004
min2.759-2.772=-0.013
max2.794-2.800=-0.006
policies=200
mean17861.485-17861.396=0.089
σ0.404-0.597=-0.193
min17861.245-17861.054=0.190
max17862.090-17862.287=-0.198
mean7600.000
σ0.000
min7600.000
max7600.000
mean2632.000-2700.000=-68.000
σ0.000
min2632.000-2700.000=-68.000
max2632.000-2700.000=-68.000
mean28.220-28.061=0.160
σ0.137-0.145=-0.008
min28.095-27.934=0.161
max28.352-28.206=0.146