Compare commits

Home / Compare c308828d .. 05af0fd7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.985=0.001
σ0.055-0.054=0.001
min33.959-33.958=0.002
max34.142-34.138=0.004
mean417.900-415.000=2.900
σ0.316-0.000=0.316
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.083-0.085=-0.002
σ0.005-0.004=0.001
min0.078-0.082=-0.004
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.003-0.002=0.001
min23.319-23.322=-0.003
max23.327-23.327=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.066-0.066=0.000
σ0.003-0.002=0.001
min0.064-0.065=-0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.727-1756.727=0.000
σ0.365-0.364=0.001
min1756.151-1756.152=-0.001
max1757.310-1757.311=-0.000
mean1648.350-1665.750=-17.400
σ623.593-623.021=0.572
min645.000-618.000=27.000
max2838.000-2687.000=151.000
mean2.373-2.358=0.015
σ0.100-0.087=0.013
min2.280-2.270=0.010
max2.653-2.627=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.320-325.311=0.009
σ0.047-0.058=-0.010
min325.235-325.208=0.027
max325.346-325.343=0.003
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean0.425-0.428=-0.003
σ0.001-0.008=-0.006
min0.423-0.422=0.001
max0.427-0.442=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.869-1985.868=0.001
σ0.019-0.015=0.004
min1985.841-1985.859=-0.018
max1985.891-1985.894=-0.003
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean2.755-2.803=-0.048
σ0.127-0.111=0.015
min2.667-2.641=0.026
max2.961-2.922=0.038
iters=5
new-facts=6402
prior-facts=1
mean4809.652-4809.629=0.023
σ7.688-7.702=-0.014
min4806.121-4806.150=-0.029
max4823.403-4823.407=-0.004
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean8.544-8.933=-0.389
σ0.492-0.102=0.390
min7.979-8.832=-0.853
max8.921-9.086=-0.165
iters=5
new-facts=6402
prior-facts=6402
mean4997.107-4997.193=-0.087
σ0.169-0.023=0.147
min4996.808-4997.166=-0.358
max4997.211-4997.226=-0.015
mean3073.600-3015.600=58.000
σ311.286-277.304=33.982
min2838.000-2687.000=151.000
max3556.000-3274.000=282.000
mean8.579-9.006=-0.427
σ0.130-0.328=-0.198
min8.489-8.643=-0.154
max8.808-9.455=-0.647

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-0.936=0.011
σ0.064-0.057=0.007
min0.897-0.891=0.007
max1.057-1.033=0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.381-463.375=0.006
σ574.770-574.770=0.001
min175.985-175.976=0.009
max1325.536-1325.530=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean0.470-0.542=-0.072
σ0.372-0.540=-0.168
min0.281-0.271=0.010
max1.028-1.352=-0.324
policies=20
mean1760.150-1760.120=0.030
σ0.346-0.349=-0.003
min1759.918-1759.902=0.016
max1760.663-1760.639=0.023
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean2.785-2.732=0.053
σ0.010-0.018=-0.008
min2.775-2.708=0.067
max2.796-2.747=0.049
policies=200
mean17608.517-17608.402=0.116
σ0.436-0.492=-0.057
min17608.242-17608.153=0.088
max17609.167-17609.140=0.026
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2687.000=151.000
σ0.000
min2838.000-2687.000=151.000
max2838.000-2687.000=151.000
mean28.012-27.518=0.494
σ0.402-0.077=0.325
min27.685-27.407=0.278
max28.523-27.578=0.945