Compare commits

Home / Compare 014ff40b .. 858c17bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.052-0.053=-0.001
min35.592-35.589=0.002
max35.765-35.767=-0.002
mean414.000-415.600=-1.600
σ0.000-0.516=-0.516
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.085-0.086=-0.001
σ0.004-0.004=0.000
min0.081-0.082=-0.001
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.048=-0.000
σ0.003-0.002=0.001
min24.040-24.045=-0.005
max24.051-24.051=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.068-0.068=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=0.000
max0.076-0.076=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.001
σ0.365-0.364=0.000
min1755.915-1755.916=-0.001
max1757.075-1757.081=-0.006
mean1652.200-1653.900=-1.700
σ644.668-629.168=15.501
min649.000-619.000=30.000
max2840.000-2690.000=150.000
mean2.352-2.350=0.003
σ0.080-0.104=-0.024
min2.267-2.239=0.027
max2.533-2.652=-0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.766=-0.005
σ0.043-0.048=-0.004
min324.684-324.681=0.003
max324.790-324.793=-0.003
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean0.417-0.427=-0.010
σ0.002-0.010=-0.008
min0.416-0.420=-0.004
max0.420-0.445=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.317=-0.004
σ0.015-0.020=-0.005
min1985.292-1985.284=0.008
max1985.334-1985.332=0.002
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean2.636-2.617=0.019
σ0.129-0.079=0.050
min2.515-2.558=-0.043
max2.817-2.733=0.084
iters=5
new-facts=6402
prior-facts=1
mean4809.111-4808.975=0.136
σ7.773-7.796=-0.023
min4805.604-4805.048=0.556
max4823.016-4822.914=0.102
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean9.162-9.029=0.134
σ0.341-0.132=0.209
min8.925-8.889=0.035
max9.755-9.234=0.521
iters=5
new-facts=6402
prior-facts=6402
mean4996.552-4996.494=0.058
σ0.151-0.178=-0.027
min4996.285-4996.285=-0.001
max4996.646-4996.640=0.006
mean3047.600-3058.800=-11.200
σ270.853-293.251=-22.398
min2840.000-2690.000=150.000
max3465.000-3333.000=132.000
mean8.503-8.914=-0.411
σ0.114-0.415=-0.301
min8.444-8.568=-0.125
max8.705-9.554=-0.849

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.952=0.029
σ0.068-0.057=0.011
min0.924-0.917=0.006
max1.056-1.050=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.215=-0.010
σ574.774-574.773=0.001
min175.808-175.813=-0.005
max1325.366-1325.373=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean0.430-0.564=-0.134
σ0.299-0.578=-0.279
min0.278-0.272=0.006
max0.878-1.431=-0.553
policies=20
mean1758.488-1758.505=-0.017
σ0.353-0.333=0.019
min1758.241-1758.295=-0.054
max1759.009-1759.001=0.008
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean2.788-2.717=0.072
σ0.005-0.012=-0.007
min2.781-2.704=0.076
max2.792-2.729=0.063
policies=200
mean17591.980-17592.116=-0.136
σ0.432-0.421=0.011
min17591.725-17591.847=-0.122
max17592.626-17592.744=-0.118
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2690.000=150.000
σ0.000
min2840.000-2690.000=150.000
max2840.000-2690.000=150.000
mean27.908-27.450=0.459
σ0.376-0.029=0.347
min27.527-27.432=0.095
max28.323-27.492=0.831