Compare commits

Home / Compare ed6c2df7 .. b162d705

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.002
σ0.108-0.107=0.001
min35.924-35.925=-0.001
max36.282-36.276=0.006
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.076-0.075=0.000
σ0.004-0.004=-0.000
min0.071-0.071=-0.000
max0.083-0.082=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.003=0.000
min26.204-26.204=0.000
max26.213-26.213=-0.001
mean410.000-416.000=-6.000
σ0.000
min410.000-416.000=-6.000
max410.000-416.000=-6.000
mean0.059-0.059=-0.000
σ0.003-0.003=-0.001
min0.056-0.057=-0.000
max0.064-0.067=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.364=-0.001
σ0.372-0.371=0.002
min1757.785-1757.787=-0.002
max1758.964-1758.954=0.009
mean1654.750-1665.000=-10.250
σ623.838-631.149=-7.311
min683.000-690.000=-7.000
max2765.000-2814.000=-49.000
mean2.381-2.408=-0.027
σ0.111-0.154=-0.043
min2.257-2.188=0.069
max2.610-2.908=-0.298

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-279.513=-0.001
σ0.008-0.007=0.001
min279.504-279.506=-0.002
max279.519-279.522=-0.003
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean0.411-0.417=-0.006
σ0.007-0.008=-0.001
min0.405-0.406=-0.002
max0.421-0.426=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2178.428-2178.446=-0.018
σ0.014-0.031=-0.017
min2178.410-2178.404=0.005
max2178.439-2178.491=-0.052
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean3.400-3.215=0.185
σ0.279-0.297=-0.018
min3.082-2.730=0.352
max3.749-3.540=0.209
iters=5
new-facts=6402
prior-facts=1
mean5056.410-5056.367=0.043
σ1.040-0.994=0.046
min5055.774-5055.811=-0.037
max5058.259-5058.135=0.124
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean8.985-8.973=0.012
σ0.803-0.555=0.249
min8.122-8.138=-0.016
max10.091-9.507=0.584
iters=5
new-facts=6402
prior-facts=6402
mean5193.751-5193.714=0.038
σ0.087-0.150=-0.063
min5193.679-5193.493=0.185
max5193.847-5193.858=-0.011
mean3214.600-3186.400=28.200
σ440.895-378.827=62.068
min2765.000-2853.000=-88.000
max3829.000-3744.000=85.000
mean8.798-8.718=0.080
σ0.121-0.121=0.000
min8.715-8.580=0.134
max9.003-8.895=0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.066=-0.082
σ0.059-0.279=-0.220
min0.945-0.939=0.006
max1.087-1.565=-0.478

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.480-465.477=0.004
σ572.653-572.654=-0.001
min179.142-179.142=0.000
max1324.459-1324.457=0.002
mean79.500
σ7.000
min76.000
max90.000
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean0.485-0.444=0.041
σ0.289-0.302=-0.014
min0.292-0.289=0.003
max0.903-0.898=0.006
policies=20
mean1791.700-1791.695=0.006
σ0.325-0.356=-0.032
min1791.457-1791.452=0.005
max1792.177-1792.221=-0.044
mean760.000
σ0.000
min760.000
max760.000
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean2.807-2.868=-0.061
σ0.004-0.102=-0.098
min2.802-2.787=0.015
max2.811-3.012=-0.202
policies=200
mean17923.514-17923.387=0.127
σ0.497-0.521=-0.024
min17923.252-17922.984=0.268
max17924.260-17924.152=0.108
mean7600.000
σ0.000
min7600.000
max7600.000
mean2765.000-2814.000=-49.000
σ0.000
min2765.000-2814.000=-49.000
max2765.000-2814.000=-49.000
mean28.282-28.266=0.016
σ0.167-0.144=0.023
min28.107-28.100=0.008
max28.431-28.430=0.001