Compare commits

Home / Compare 88a5cf3d .. a5cb48a8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.048=0.000
min33.950-33.951=-0.001
max34.111-34.111=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.083=0.000
σ0.004-0.005=-0.002
min0.077-0.077=0.000
max0.091-0.095=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.316=0.002
σ0.002-0.002=0.001
min23.315-23.313=0.002
max23.324-23.319=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.061=0.002
σ0.005-0.004=0.001
min0.059-0.059=-0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.365=0.065
σ0.365-0.364=0.001
min1756.855-1756.786=0.068
max1758.019-1757.950=0.069
mean1646.950-1665.500=-18.550
σ625.876-627.569=-1.693
min636.000-670.000=-34.000
max2837.000-2613.000=224.000
mean2.366-2.340=0.026
σ0.087-0.109=-0.022
min2.264-2.238=0.026
max2.650-2.648=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.522=0.048
σ0.035-0.013=0.022
min326.515-326.502=0.013
max326.607-326.534=0.074
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean0.424-0.421=0.004
σ0.004-0.001=0.002
min0.421-0.419=0.002
max0.431-0.423=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.732-1988.681=0.051
σ0.014-0.013=0.001
min1988.719-1988.668=0.052
max1988.751-1988.697=0.054
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean2.723-2.673=0.050
σ0.069-0.084=-0.015
min2.646-2.560=0.086
max2.803-2.773=0.030
iters=5
new-facts=6402
prior-facts=1
mean4813.472-4813.415=0.058
σ7.472-7.817=-0.345
min4810.068-4809.489=0.579
max4826.838-4827.391=-0.553
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean8.616-8.875=-0.259
σ0.579-0.511=0.068
min7.809-8.409=-0.600
max9.191-9.623=-0.432
iters=5
new-facts=6402
prior-facts=6402
mean5001.074-5001.073=0.001
σ0.175-0.027=0.149
min5000.763-5001.043=-0.280
max5001.174-5001.106=0.068
mean3035.000-3018.800=16.200
σ269.659-291.726=-22.067
min2837.000-2613.000=224.000
max3451.000-3394.000=57.000
mean9.775-9.660=0.115
σ0.174-0.287=-0.113
min9.635-9.198=0.437
max10.059-9.924=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.203=-0.203
σ0.069-0.357=-0.288
min0.912-0.905=0.008
max1.062-1.781=-0.719

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.505=0.067
σ574.766-574.779=-0.013
min177.175-177.109=0.066
max1326.720-1326.673=0.047
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean0.437-0.559=-0.122
σ0.310-0.569=-0.260
min0.280-0.273=0.007
max0.902-1.413=-0.512
policies=20
mean1772.088-1771.375=0.712
σ0.366-0.355=0.010
min1771.829-1771.139=0.690
max1772.626-1771.903=0.723
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean2.792-2.717=0.076
σ0.021-0.027=-0.006
min2.773-2.692=0.081
max2.819-2.754=0.065
policies=200
mean17727.667-17721.000=6.668
σ0.455-0.424=0.032
min17727.341-17720.671=6.669
max17728.341-17721.621=6.721
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2613.000=224.000
σ0.000
min2837.000-2613.000=224.000
max2837.000-2613.000=224.000
mean27.826-27.461=0.365
σ0.369-0.087=0.282
min27.476-27.382=0.094
max28.169-27.573=0.596