Compare commits

Home / Compare 82b98209 .. 4a7a7cc7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.971=0.004
σ0.107-0.106=0.001
min35.929-35.923=0.005
max36.279-36.272=0.007
mean410.300-414.000=-3.700
σ0.483-0.000=0.483
min410.000-414.000=-4.000
max411.000-414.000=-3.000
mean0.077-0.079=-0.002
σ0.004-0.004=-0.000
min0.074-0.076=-0.002
max0.084-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.209-26.205=0.004
σ0.003-0.002=0.001
min26.205-26.201=0.004
max26.213-26.208=0.005
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.060-0.059=0.002
σ0.002-0.002=-0.000
min0.058-0.057=0.001
max0.066-0.065=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1758.364=0.001
σ0.375-0.372=0.003
min1757.786-1757.785=0.001
max1758.961-1758.963=-0.003
mean1648.650-1661.750=-13.100
σ643.859-629.657=14.201
min670.000-687.000=-17.000
max2734.000-2811.000=-77.000
mean2.345-2.366=-0.021
σ0.092-0.103=-0.012
min2.190-2.243=-0.053
max2.520-2.621=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.512=-0.001
σ0.005-0.005=0.000
min279.505-279.505=-0.001
max279.515-279.518=-0.003
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean0.405-0.409=-0.003
σ0.001-0.007=-0.006
min0.404-0.404=-0.000
max0.407-0.421=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2178.438-2178.434=0.004
σ0.020-0.026=-0.006
min2178.414-2178.390=0.023
max2178.468-2178.458=0.010
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean3.400-3.390=0.010
σ0.227-0.140=0.086
min3.167-3.190=-0.023
max3.770-3.551=0.219
iters=5
new-facts=6402
prior-facts=1
mean5056.386-5056.364=0.022
σ0.990-0.981=0.009
min5055.779-5055.772=0.007
max5058.147-5058.106=0.041
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean8.880-9.147=-0.268
σ0.708-0.354=0.354
min8.096-8.536=-0.441
max9.724-9.450=0.274
iters=5
new-facts=6402
prior-facts=6402
mean5193.754-5193.664=0.089
σ0.087-0.199=-0.111
min5193.685-5193.364=0.321
max5193.853-5193.844=0.009
mean3279.400-3238.000=41.400
σ405.250-434.630=-29.379
min2734.000-2811.000=-77.000
max3666.000-3855.000=-189.000
mean8.847-8.929=-0.082
σ0.169-0.472=-0.303
min8.672-8.651=0.021
max9.086-9.751=-0.666

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.974=0.058
σ0.138-0.053=0.085
min0.937-0.943=-0.006
max1.255-1.068=0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.482-465.494=-0.012
σ572.661-572.655=0.006
min179.140-179.158=-0.018
max1324.474-1324.476=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean0.558-0.443=0.115
σ0.556-0.304=0.252
min0.278-0.288=-0.010
max1.391-0.900=0.492
policies=20
mean1791.671-1791.763=-0.092
σ0.352-0.315=0.037
min1791.456-1791.592=-0.136
max1792.196-1792.235=-0.039
mean760.000
σ0.000
min760.000
max760.000
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean2.773-2.881=-0.108
σ0.016-0.107=-0.091
min2.749-2.787=-0.038
max2.783-3.031=-0.248
policies=200
mean17923.529-17923.497=0.032
σ0.495-0.493=0.002
min17923.273-17923.220=0.052
max17924.271-17924.235=0.037
mean7600.000
σ0.000
min7600.000
max7600.000
mean2734.000-2811.000=-77.000
σ0.000
min2734.000-2811.000=-77.000
max2734.000-2811.000=-77.000
mean28.140-28.336=-0.197
σ0.093-0.120=-0.026
min28.028-28.166=-0.138
max28.243-28.426=-0.183