Compare commits

Home / Compare 24ba4725 .. d8dd38aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.002
σ0.049-0.047=0.002
min33.950-33.953=-0.003
max34.113-34.108=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.084-0.084=-0.000
σ0.003-0.003=0.000
min0.081-0.081=0.000
max0.090-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.001=0.002
min23.312-23.315=-0.003
max23.322-23.319=0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.001
min0.064-0.061=0.003
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.304-1757.301=0.002
σ0.364-0.366=-0.002
min1756.729-1756.727=0.002
max1757.897-1757.889=0.008
mean1664.000-1651.950=12.050
σ623.011-627.084=-4.073
min671.000-676.000=-5.000
max2598.000-2599.000=-1.000
mean2.368-2.338=0.030
σ0.168-0.168=-0.000
min2.217-2.084=0.133
max2.769-2.692=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-326.440=-0.001
σ0.060-0.060=0.000
min326.333-326.335=-0.002
max326.476-326.477=-0.001
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean0.425-0.438=-0.013
σ0.003-0.014=-0.011
min0.422-0.422=0.000
max0.431-0.449=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1988.606-1988.613=-0.007
σ0.012-0.009=0.004
min1988.591-1988.601=-0.010
max1988.621-1988.621=-0.000
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean2.771-2.692=0.079
σ0.170-0.134=0.036
min2.624-2.512=0.112
max3.018-2.868=0.150
iters=5
new-facts=6402
prior-facts=1
mean4813.386-4813.335=0.050
σ7.757-7.816=-0.059
min4809.643-4809.354=0.289
max4827.257-4827.308=-0.051
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean8.320-8.776=-0.457
σ0.556-0.214=0.342
min7.762-8.540=-0.778
max8.985-9.095=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean5001.007-5001.010=-0.003
σ0.021-0.022=-0.001
min5000.983-5000.984=-0.001
max5001.033-5001.038=-0.005
mean2975.000-3006.600=-31.600
σ410.627-326.292=84.335
min2598.000-2599.000=-1.000
max3551.000-3318.000=233.000
mean9.531-9.725=-0.194
σ0.225-0.096=0.129
min9.239-9.611=-0.372
max9.775-9.844=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.311-1.237=0.074
σ0.353-0.437=-0.084
min0.910-0.919=-0.008
max1.783-1.846=-0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.427-464.437=-0.010
σ574.777-574.790=-0.013
min177.033-177.039=-0.006
max1326.592-1326.622=-0.030
mean88.250
σ8.500
min84.000
max101.000
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean0.573-0.559=0.014
σ0.601-0.572=0.029
min0.271-0.271=0.000
max1.475-1.417=0.057
policies=20
mean1770.741-1770.758=-0.018
σ0.362-0.347=0.015
min1770.495-1770.533=-0.038
max1771.278-1771.274=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean2.729-2.705=0.024
σ0.050-0.008=0.042
min2.687-2.693=-0.006
max2.798-2.710=0.087
policies=200
mean17714.848-17714.946=-0.098
σ0.557-0.483=0.074
min17714.454-17714.663=-0.208
max17715.668-17715.668=0.000
mean8400.000
σ0.000
min8400.000
max8400.000
mean2598.000-2599.000=-1.000
σ0.000
min2598.000-2599.000=-1.000
max2598.000-2599.000=-1.000
mean27.392-27.434=-0.043
σ0.064-0.121=-0.058
min27.331-27.325=0.006
max27.452-27.553=-0.101