Compare commits

Home / Compare bff51cda .. 692262d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.884-34.868=0.016
σ0.107-0.106=0.001
min34.837-34.823=0.014
max35.187-35.169=0.018
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.077-0.072=0.006
σ0.004-0.004=-0.000
min0.074-0.068=0.006
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean26.066-26.052=0.013
σ0.003-0.003=-0.000
min26.060-26.045=0.015
max26.070-26.057=0.013
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.061-0.061=0.001
σ0.002-0.002=-0.000
min0.058-0.059=-0.000
max0.067-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.028-1756.041=-0.013
σ0.366-0.365=0.000
min1755.456-1755.463=-0.007
max1756.640-1756.629=0.012
mean1650.700-1670.850=-20.150
σ630.814-630.612=0.202
min609.000-670.000=-61.000
max2672.000-2626.000=46.000
mean2.853-2.830=0.023
σ0.199-0.127=0.072
min2.345-2.527=-0.182
max3.142-3.070=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.301-277.330=-0.029
σ0.005-0.005=0.000
min277.294-277.326=-0.033
max277.306-277.337=-0.032
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean0.404-0.406=-0.002
σ0.001-0.008=-0.007
min0.403-0.401=0.002
max0.405-0.421=-0.016
iters=5
new-facts=1
prior-facts=6402
mean2174.484-2174.575=-0.091
σ0.038-0.020=0.017
min2174.438-2174.560=-0.121
max2174.519-2174.609=-0.090
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean3.004-3.028=-0.023
σ0.159-0.125=0.034
min2.826-2.849=-0.023
max3.193-3.150=0.043
iters=5
new-facts=6402
prior-facts=1
mean5052.712-5052.612=0.100
σ1.002-1.069=-0.067
min5052.110-5051.879=0.231
max5054.495-5054.493=0.001
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean8.953-8.978=-0.025
σ0.613-0.564=0.048
min8.195-8.166=0.029
max9.733-9.526=0.207
iters=5
new-facts=6402
prior-facts=6402
mean5188.441-5188.558=-0.117
σ0.121-0.084=0.037
min5188.280-5188.488=-0.208
max5188.610-5188.651=-0.041
mean3198.600-3240.600=-42.000
σ454.105-372.602=81.503
min2672.000-2717.000=-45.000
max3809.000-3693.000=116.000
mean8.875-9.030=-0.155
σ0.141-0.371=-0.230
min8.729-8.727=0.002
max9.087-9.676=-0.589

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.339=-0.202
σ0.261-0.281=-0.019
min0.942-1.082=-0.141
max1.479-1.640=-0.161

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.002-465.058=-0.056
σ572.672-572.659=0.013
min178.665-178.726=-0.062
max1324.009-1324.046=-0.037
mean79.500
σ7.000
min76.000
max90.000
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean0.563-0.564=-0.002
σ0.564-0.561=0.003
min0.277-0.281=-0.004
max1.408-1.405=0.002
policies=20
mean1786.915-1787.530=-0.616
σ0.350-0.343=0.007
min1786.687-1787.297=-0.610
max1787.435-1788.039=-0.604
mean760.000
σ0.000
min760.000
max760.000
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean2.808-2.795=0.013
σ0.012-0.016=-0.004
min2.792-2.776=0.016
max2.820-2.814=0.005
policies=200
mean17875.998-17881.890=-5.892
σ0.505-0.467=0.038
min17875.699-17881.562=-5.863
max17876.754-17882.576=-5.821
mean7600.000
σ0.000
min7600.000
max7600.000
mean2672.000-2626.000=46.000
σ0.000
min2672.000-2626.000=46.000
max2672.000-2626.000=46.000
mean28.414-28.256=0.159
σ0.144-0.083=0.062
min28.295-28.179=0.115
max28.585-28.331=0.255