Compare commits

Home / Compare 4b91172e .. f1465ab4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.952-30.951=0.001
σ0.050-0.049=0.001
min30.914-30.920=-0.006
max31.091-31.088=0.003
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.077-0.078=-0.001
σ0.002-0.004=-0.002
min0.075-0.075=0.000
max0.084-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.205-21.204=0.000
σ0.003-0.002=0.001
min21.200-21.199=0.000
max21.210-21.208=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.063-0.060=0.003
σ0.005-0.003=0.001
min0.058-0.057=0.000
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.380-1758.379=0.002
σ0.368-0.371=-0.003
min1757.802-1757.804=-0.003
max1758.974-1758.959=0.015
mean1644.850-1652.750=-7.900
σ634.045-632.003=2.042
min631.000-627.000=4.000
max2819.000-2787.000=32.000
mean2.348-2.342=0.007
σ0.074-0.130=-0.056
min2.265-2.158=0.108
max2.517-2.779=-0.262

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.541-279.540=0.002
σ0.007-0.004=0.003
min279.534-279.535=-0.001
max279.551-279.545=0.007
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean0.407-0.410=-0.002
σ0.007-0.006=0.001
min0.403-0.405=-0.002
max0.419-0.421=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.482-2178.464=0.018
σ0.015-0.013=0.002
min2178.467-2178.451=0.017
max2178.505-2178.480=0.025
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean3.441-3.397=0.044
σ0.173-0.122=0.051
min3.271-3.281=-0.011
max3.722-3.557=0.165
iters=5
new-facts=6402
prior-facts=1
mean5056.398-5056.244=0.154
σ0.966-0.988=-0.022
min5055.849-5055.484=0.365
max5058.121-5057.965=0.156
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean9.105-8.890=0.215
σ0.614-0.405=0.209
min8.136-8.228=-0.093
max9.656-9.291=0.366
iters=5
new-facts=6402
prior-facts=6402
mean5193.771-5193.718=0.053
σ0.096-0.203=-0.106
min5193.675-5193.380=0.295
max5193.881-5193.884=-0.003
mean3246.200-3241.000=5.200
σ325.159-326.677=-1.518
min2819.000-2787.000=32.000
max3670.000-3675.000=-5.000
mean8.935-8.969=-0.034
σ0.412-0.349=0.062
min8.617-8.654=-0.037
max9.630-9.547=0.084

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-0.994=0.064
σ0.126-0.066=0.059
min0.940-0.935=0.006
max1.252-1.074=0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.536-465.543=-0.007
σ572.660-572.657=0.003
min179.198-179.205=-0.008
max1324.527-1324.529=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean0.441-0.443=-0.002
σ0.304-0.295=0.009
min0.284-0.292=-0.008
max0.897-0.885=0.012
policies=20
mean1792.320-1792.331=-0.010
σ0.367-0.345=0.022
min1792.067-1792.100=-0.033
max1792.859-1792.830=0.029
mean760.000
σ0.000
min760.000
max760.000
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean2.879-2.842=0.037
σ0.006-0.110=-0.104
min2.871-2.776=0.095
max2.885-3.007=-0.121
policies=200
mean17929.591-17929.553=0.038
σ0.469-0.525=-0.056
min17929.273-17929.223=0.050
max17930.287-17930.336=-0.048
mean7600.000
σ0.000
min7600.000
max7600.000
mean2819.000-2787.000=32.000
σ0.000
min2819.000-2787.000=32.000
max2819.000-2787.000=32.000
mean28.448-28.204=0.244
σ0.391-0.146=0.246
min28.037-28.027=0.010
max28.963-28.356=0.607