Compare commits

Home / Compare 52370c37 .. 24ae64e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.053-0.055=-0.003
min35.589-35.587=0.002
max35.767-35.775=-0.007
mean415.600-414.000=1.600
σ0.516-0.000=0.516
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.086-0.086=0.000
σ0.004-0.004=-0.001
min0.082-0.081=0.001
max0.093-0.093=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.002-0.003=-0.001
min24.045-24.045=0.000
max24.051-24.053=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.068-0.064=0.005
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.076-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.364-0.365=-0.001
min1755.916-1755.914=0.001
max1757.081-1757.076=0.005
mean1653.900-1642.300=11.600
σ629.168-643.911=-14.744
min619.000-616.000=3.000
max2690.000-2718.000=-28.000
mean2.350-2.385=-0.035
σ0.104-0.113=-0.009
min2.239-2.221=0.018
max2.652-2.633=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.765=0.001
σ0.048-0.042=0.006
min324.681-324.691=-0.010
max324.793-324.792=0.001
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean0.427-0.428=-0.001
σ0.010-0.009=0.001
min0.420-0.421=-0.001
max0.445-0.442=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.316=0.001
σ0.020-0.021=-0.001
min1985.284-1985.292=-0.009
max1985.332-1985.334=-0.001
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean2.617-2.631=-0.014
σ0.079-0.102=-0.023
min2.558-2.551=0.007
max2.733-2.761=-0.027
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4809.096=-0.121
σ7.796-7.647=0.149
min4805.048-4805.611=-0.564
max4822.914-4822.775=0.139
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean9.029-8.962=0.067
σ0.132-0.362=-0.231
min8.889-8.581=0.308
max9.234-9.521=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.621=-0.127
σ0.178-0.028=0.150
min4996.285-4996.589=-0.304
max4996.640-4996.652=-0.012
mean3058.800-2982.200=76.600
σ293.251-310.297=-17.046
min2690.000-2718.000=-28.000
max3333.000-3430.000=-97.000
mean8.914-8.458=0.456
σ0.415-0.049=0.366
min8.568-8.398=0.170
max9.554-8.511=1.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-0.974=-0.022
σ0.057-0.145=-0.088
min0.917-0.902=0.015
max1.050-1.232=-0.182

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-463.224=-0.010
σ574.773-574.795=-0.023
min175.813-175.814=-0.001
max1325.373-1325.417=-0.044
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean0.564-0.531=0.033
σ0.578-0.514=0.064
min0.272-0.273=-0.001
max1.431-1.302=0.129
policies=20
mean1758.505-1758.498=0.007
σ0.333-0.321=0.013
min1758.295-1758.281=0.013
max1759.001-1758.973=0.029
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean2.717-2.694=0.023
σ0.012-0.016=-0.004
min2.704-2.677=0.027
max2.729-2.711=0.018
policies=200
mean17592.116-17592.157=-0.041
σ0.421-0.533=-0.112
min17591.847-17591.851=-0.004
max17592.744-17592.955=-0.212
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2718.000=-28.000
σ0.000
min2690.000-2718.000=-28.000
max2690.000-2718.000=-28.000
mean27.450-27.396=0.054
σ0.029-0.121=-0.092
min27.432-27.239=0.193
max27.492-27.519=-0.027