Compare commits

Home / Compare bfff1f56 .. d65502b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.047-0.049=-0.002
min33.953-33.946=0.006
max34.108-34.113=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.000
min0.081-0.082=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.001-0.003=-0.001
min23.315-23.313=0.003
max23.319-23.320=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.062=0.002
σ0.003-0.003=0.000
min0.061-0.060=0.001
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.303=-0.002
σ0.366-0.366=-0.000
min1756.727-1756.728=-0.001
max1757.889-1757.896=-0.007
mean1651.950
σ627.084-627.598=-0.514
min676.000-675.000=1.000
max2599.000-2600.000=-1.000
mean2.338-2.335=0.003
σ0.168-0.127=0.041
min2.084-2.202=-0.117
max2.692-2.644=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.440-326.453=-0.012
σ0.060-0.032=0.028
min326.335-326.399=-0.064
max326.477-326.475=0.001
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean0.438-0.423=0.015
σ0.014-0.002=0.012
min0.422-0.420=0.002
max0.449-0.425=0.024
iters=5
new-facts=1
prior-facts=6402
mean1988.613-1988.602=0.012
σ0.009-0.032=-0.023
min1988.601-1988.549=0.052
max1988.621-1988.626=-0.004
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean2.692-2.700=-0.009
σ0.134-0.178=-0.044
min2.512-2.581=-0.068
max2.868-3.015=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4813.335-4813.508=-0.172
σ7.816-7.706=0.110
min4809.354-4809.898=-0.544
max4827.308-4827.291=0.017
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean8.776-8.407=0.369
σ0.214-0.609=-0.394
min8.540-7.710=0.830
max9.095-9.314=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.022=-0.012
σ0.022-0.031=-0.009
min5000.984-5000.987=-0.003
max5001.038-5001.056=-0.018
mean3006.600-2961.200=45.400
σ326.292-266.229=60.063
min2599.000-2626.000=-27.000
max3318.000-3323.000=-5.000
mean9.725-9.927=-0.202
σ0.096-0.188=-0.092
min9.611-9.706=-0.095
max9.844-10.219=-0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.162=0.075
σ0.437-0.334=0.102
min0.919-0.917=0.001
max1.846-1.731=0.115

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.437=0.000
σ574.790-574.785=0.005
min177.039-177.039=-0.000
max1326.622-1326.614=0.007
mean88.250
σ8.500
min84.000
max101.000
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean0.559-0.550=0.009
σ0.572-0.553=0.019
min0.271-0.271=0.000
max1.417-1.380=0.037
policies=20
mean1770.758-1770.769=-0.011
σ0.347-0.358=-0.011
min1770.533-1770.533=-0.000
max1771.274-1771.301=-0.026
mean840.000
σ0.000
min840.000
max840.000
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean2.705-2.724=-0.020
σ0.008-0.025=-0.017
min2.693-2.694=-0.001
max2.710-2.753=-0.042
policies=200
mean17714.946-17714.788=0.158
σ0.483-0.609=-0.126
min17714.663-17714.352=0.310
max17715.668-17715.686=-0.018
mean8400.000
σ0.000
min8400.000
max8400.000
mean2599.000-2600.000=-1.000
σ0.000
min2599.000-2600.000=-1.000
max2599.000-2600.000=-1.000
mean27.434-27.398=0.036
σ0.121-0.127=-0.005
min27.325-27.224=0.101
max27.553-27.507=0.046