Compare commits

Home / Compare ce1a3ebc .. 4630e3ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.264=-0.002
σ0.054-0.055=-0.001
min35.232-35.236=-0.004
max35.414-35.420=-0.006
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.083-0.084=-0.001
σ0.004-0.005=-0.001
min0.077-0.076=0.001
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.004=-0.002
min23.766-23.763=0.003
max23.773-23.778=-0.005
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.069-0.069=0.000
σ0.003-0.003=-0.000
min0.067-0.066=0.001
max0.075-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.469-1756.470=-0.001
σ0.365-0.364=0.001
min1755.897-1755.897=0.001
max1757.058-1757.053=0.005
mean1659.850-1653.950=5.900
σ644.118-638.736=5.381
min631.000-625.000=6.000
max2801.000-2749.000=52.000
mean2.349-2.346=0.003
σ0.125-0.120=0.006
min2.218-2.240=-0.022
max2.781-2.775=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.694-324.699=-0.006
σ0.053-0.029=0.024
min324.599-324.648=-0.049
max324.720-324.721=-0.001
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean0.425-0.428=-0.003
σ0.001-0.007=-0.007
min0.424-0.422=0.003
max0.426-0.439=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.259-1985.242=0.018
σ0.009-0.031=-0.023
min1985.244-1985.187=0.058
max1985.266-1985.263=0.004
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean2.600-2.584=0.015
σ0.077-0.082=-0.005
min2.507-2.466=0.040
max2.687-2.663=0.024
iters=5
new-facts=6402
prior-facts=1
mean4808.845-4808.852=-0.007
σ7.684-7.739=-0.055
min4805.379-4805.366=0.013
max4822.591-4822.696=-0.105
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean8.837-8.914=-0.077
σ0.127-0.243=-0.116
min8.657-8.787=-0.130
max9.002-9.347=-0.345
iters=5
new-facts=6402
prior-facts=6402
mean4996.457-4996.452=0.004
σ0.018-0.015=0.003
min4996.432-4996.439=-0.007
max4996.480-4996.471=0.009
mean3065.600-2975.200=90.400
σ238.188-212.110=26.077
min2801.000-2749.000=52.000
max3407.000-3241.000=166.000
mean8.774-8.721=0.053
σ0.150-0.153=-0.003
min8.559-8.464=0.095
max8.975-8.849=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.090=-0.071
σ0.136-0.227=-0.090
min0.903-0.915=-0.011
max1.242-1.471=-0.229

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.950-462.936=0.014
σ574.252-574.254=-0.002
min175.816-175.798=0.018
max1324.329-1324.317=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean0.429-0.473=-0.045
σ0.292-0.380=-0.088
min0.281-0.282=-0.001
max0.867-1.043=-0.176
policies=20
mean1758.468-1758.317=0.152
σ0.360-0.361=-0.001
min1758.216-1758.071=0.144
max1759.002-1758.851=0.151
mean820.000
σ0.000
min820.000
max820.000
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean2.789-2.827=-0.038
σ0.011-0.069=-0.058
min2.782-2.782=0.000
max2.806-2.931=-0.125
policies=200
mean17590.239-17590.213=0.026
σ0.508-0.479=0.030
min17589.930-17589.971=-0.042
max17590.997-17590.931=0.066
mean8200.000
σ0.000
min8200.000
max8200.000
mean2801.000-2749.000=52.000
σ0.000
min2801.000-2749.000=52.000
max2801.000-2749.000=52.000
mean27.558-27.440=0.118
σ0.252-0.099=0.153
min27.273-27.313=-0.039
max27.863-27.551=0.312