Compare commits

Home / Compare 75052ac9 .. bd1502de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.107-0.106=0.001
min35.925-35.924=0.001
max36.276-36.275=0.001
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.078-0.078=-0.000
σ0.004-0.003=0.001
min0.075-0.075=-0.001
max0.086-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.208=0.001
σ0.003-0.003=0.001
min26.204-26.205=-0.001
max26.213-26.213=0.000
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.061-0.062=-0.001
σ0.003-0.003=-0.000
min0.059-0.060=-0.000
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.377-1758.379=-0.002
σ0.371-0.369=0.003
min1757.801-1757.803=-0.002
max1758.968-1758.976=-0.008
mean1653.250-1661.150=-7.900
σ620.541-623.507=-2.966
min684.000-690.000=-6.000
max2743.000-2771.000=-28.000
mean2.393-2.394=-0.001
σ0.113-0.105=0.008
min2.272-2.270=0.002
max2.644-2.599=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-279.556=-0.014
σ0.005-0.004=0.001
min279.535-279.550=-0.016
max279.547-279.560=-0.012
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean0.410-0.409=0.001
σ0.005-0.004=0.001
min0.405-0.406=-0.001
max0.417-0.415=0.002
iters=5
new-facts=1
prior-facts=6402
mean2178.471-2178.494=-0.023
σ0.003-0.015=-0.012
min2178.466-2178.474=-0.008
max2178.474-2178.509=-0.035
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean3.414-3.249=0.165
σ0.156-0.282=-0.126
min3.284-2.783=0.500
max3.678-3.525=0.153
iters=5
new-facts=6402
prior-facts=1
mean5056.260-5056.443=-0.183
σ0.753-0.897=-0.144
min5055.790-5055.975=-0.185
max5057.594-5058.045=-0.451
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean9.054-8.938=0.116
σ0.515-0.459=0.056
min8.305-8.378=-0.073
max9.725-9.490=0.235
iters=5
new-facts=6402
prior-facts=6402
mean5193.708-5193.655=0.053
σ0.201-0.284=-0.083
min5193.381-5193.162=0.219
max5193.897-5193.898=-0.001
mean3228.200-3273.800=-45.600
σ376.190-422.829=-46.639
min2743.000-2771.000=-28.000
max3584.000-3850.000=-266.000
mean8.888-8.823=0.065
σ0.105-0.274=-0.169
min8.705-8.620=0.085
max8.964-9.280=-0.317

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.145-0.973=0.172
σ0.209-0.057=0.152
min0.944-0.939=0.005
max1.437-1.074=0.363

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.551-465.539=0.011
σ572.688-572.657=0.031
min179.201-179.199=0.002
max1324.582-1324.524=0.058
mean79.500
σ7.000
min76.000
max90.000
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean0.474-0.484=-0.010
σ0.384-0.291=0.093
min0.280-0.279=0.001
max1.049-0.899=0.150
policies=20
mean1792.287-1792.313=-0.026
σ0.346-0.318=0.028
min1792.049-1792.071=-0.022
max1792.800-1792.779=0.021
mean760.000
σ0.000
min760.000
max760.000
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean2.799-2.810=-0.011
σ0.005-0.018=-0.013
min2.793-2.787=0.006
max2.805-2.830=-0.025
policies=200
mean17929.549-17929.489=0.060
σ0.508-0.403=0.106
min17929.241-17929.205=0.036
max17930.309-17930.085=0.224
mean7600.000
σ0.000
min7600.000
max7600.000
mean2743.000-2771.000=-28.000
σ0.000
min2743.000-2771.000=-28.000
max2743.000-2771.000=-28.000
mean28.296-28.244=0.052
σ0.115-0.094=0.022
min28.162-28.110=0.051
max28.401-28.324=0.077