Compare commits

Home / Compare 8240cbbd .. d9ca4452

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.981-33.979=0.001
σ0.049-0.048=0.001
min33.953-33.955=-0.002
max34.116-34.113=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.085-0.085=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=-0.000
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.319=-0.002
σ0.003-0.003=0.000
min23.312-23.314=-0.002
max23.321-23.323=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.066-0.066=0.000
σ0.003-0.002=0.001
min0.064-0.064=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.428=0.000
σ0.363-0.365=-0.001
min1756.856-1756.855=0.001
max1758.021-1758.020=0.000
mean1649.500-1677.400=-27.900
σ624.879-637.978=-13.099
min674.000-663.000=11.000
max2590.000-2651.000=-61.000
mean2.398-2.373=0.025
σ0.189-0.117=0.072
min2.183-2.222=-0.039
max2.983-2.689=0.294

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.584-326.573=0.011
σ0.015-0.047=-0.032
min326.560-326.492=0.068
max326.598-326.610=-0.012
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean0.428-0.425=0.003
σ0.006-0.001=0.005
min0.422-0.424=-0.002
max0.436-0.426=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.731=0.008
σ0.010-0.016=-0.007
min1988.723-1988.712=0.011
max1988.747-1988.745=0.001
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean2.700-2.698=0.002
σ0.100-0.071=0.029
min2.595-2.600=-0.005
max2.816-2.799=0.017
iters=5
new-facts=6402
prior-facts=1
mean4813.573-4813.567=0.006
σ7.694-7.720=-0.026
min4810.081-4810.086=-0.005
max4827.336-4827.377=-0.040
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean8.746-8.708=0.038
σ0.225-0.467=-0.242
min8.431-7.942=0.489
max9.039-9.103=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean5001.132-5001.136=-0.004
σ0.017-0.021=-0.004
min5001.110-5001.113=-0.003
max5001.148-5001.164=-0.016
mean2995.000-2968.800=26.200
σ315.892-253.886=62.006
min2590.000-2651.000=-61.000
max3404.000-3304.000=100.000
mean9.451-9.688=-0.236
σ0.520-0.305=0.215
min8.648-9.192=-0.544
max9.975-9.925=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.286-1.145=0.141
σ0.335-0.251=0.083
min0.920-0.907=0.014
max1.719-1.460=0.259

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.563-464.564=-0.002
σ574.773-574.779=-0.006
min177.171-177.172=-0.001
max1326.722-1326.733=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean0.539-0.558=-0.020
σ0.528-0.568=-0.040
min0.272-0.273=-0.000
max1.331-1.411=-0.080
policies=20
mean1772.032-1772.019=0.013
σ0.348-0.356=-0.008
min1771.796-1771.783=0.013
max1772.549-1772.548=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean2.726-2.725=0.001
σ0.013-0.025=-0.012
min2.707-2.702=0.004
max2.735-2.753=-0.018
policies=200
mean17727.474-17727.592=-0.118
σ0.544-0.526=0.018
min17727.093-17727.232=-0.139
max17728.267-17728.371=-0.104
mean8400.000
σ0.000
min8400.000
max8400.000
mean2590.000-2651.000=-61.000
σ0.000
min2590.000-2651.000=-61.000
max2590.000-2651.000=-61.000
mean27.572-27.520=0.053
σ0.188-0.154=0.034
min27.403-27.370=0.033
max27.790-27.725=0.065