Compare commits

Home / Compare 62e6e4e9 .. 4b91172e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.951-30.952=-0.001
σ0.049-0.050=-0.001
min30.920-30.916=0.003
max31.088-31.092=-0.004
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.078-0.078=0.001
σ0.004-0.004=0.001
min0.075-0.074=0.000
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.204-21.204=-0.000
σ0.002-0.003=-0.001
min21.199-21.201=-0.002
max21.208-21.211=-0.003
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.060-0.064=-0.004
σ0.003-0.004=-0.001
min0.057-0.062=-0.004
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.379-1758.381=-0.002
σ0.371-0.371=0.000
min1757.804-1757.804=0.000
max1758.959-1758.979=-0.020
mean1652.750-1655.400=-2.650
σ632.003-620.385=11.618
min627.000-686.000=-59.000
max2787.000-2743.000=44.000
mean2.342-2.337=0.004
σ0.130-0.118=0.012
min2.158-2.152=0.006
max2.779-2.576=0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.540-279.540=-0.000
σ0.004-0.003=0.001
min279.535-279.535=-0.000
max279.545-279.545=0.000
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean0.410-0.406=0.003
σ0.006-0.001=0.005
min0.405-0.405=-0.000
max0.421-0.409=0.012
iters=5
new-facts=1
prior-facts=6402
mean2178.464-2178.482=-0.018
σ0.013-0.015=-0.003
min2178.451-2178.471=-0.021
max2178.480-2178.509=-0.029
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean3.397-3.338=0.059
σ0.122-0.072=0.049
min3.281-3.249=0.032
max3.557-3.412=0.144
iters=5
new-facts=6402
prior-facts=1
mean5056.244-5056.196=0.047
σ0.988-1.124=-0.136
min5055.484-5055.370=0.114
max5057.965-5058.143=-0.178
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean8.890-8.880=0.009
σ0.405-0.776=-0.371
min8.228-8.181=0.047
max9.291-9.798=-0.507
iters=5
new-facts=6402
prior-facts=6402
mean5193.718-5193.794=-0.076
σ0.203-0.081=0.122
min5193.380-5193.723=-0.343
max5193.884-5193.886=-0.002
mean3241.000-3286.800=-45.800
σ326.677-406.440=-79.763
min2787.000-2743.000=44.000
max3675.000-3676.000=-1.000
mean8.969-8.860=0.109
σ0.349-0.176=0.174
min8.654-8.662=-0.008
max9.547-9.108=0.439

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-0.975=0.019
σ0.066-0.049=0.017
min0.935-0.948=-0.014
max1.074-1.063=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.543-465.537=0.006
σ572.657-572.658=-0.000
min179.205-179.205=0.001
max1324.529-1324.524=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean0.443-0.489=-0.046
σ0.295-0.400=-0.106
min0.292-0.287=0.005
max0.885-1.089=-0.205
policies=20
mean1792.331-1792.285=0.045
σ0.345-0.336=0.009
min1792.100-1792.090=0.010
max1792.830-1792.788=0.042
mean760.000
σ0.000
min760.000
max760.000
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean2.842-2.799=0.043
σ0.110-0.010=0.100
min2.776-2.789=-0.013
max3.007-2.813=0.194
policies=200
mean17929.553-17929.462=0.091
σ0.525-0.581=-0.056
min17929.223-17929.086=0.137
max17930.336-17930.321=0.014
mean7600.000
σ0.000
min7600.000
max7600.000
mean2787.000-2743.000=44.000
σ0.000
min2787.000-2743.000=44.000
max2787.000-2743.000=44.000
mean28.204-28.255=-0.051
σ0.146-0.155=-0.009
min28.027-28.081=-0.054
max28.356-28.458=-0.102