Compare commits

Home / Compare ca18e72d .. 1426f09e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.127-73.127=-0.001
σ0.054-0.051=0.004
min73.097-73.100=-0.004
max73.280-73.270=0.010
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.160=0.000
σ0.003-0.004=-0.001
min0.157-0.152=0.005
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.754-23.755=-0.000
σ0.002-0.003=-0.001
min23.751-23.751=-0.001
max23.757-23.762=-0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.068-0.066=0.002
σ0.004-0.005=-0.001
min0.063-0.061=0.002
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.821-1755.822=-0.000
σ0.362-0.362=-0.000
min1755.248-1755.249=-0.001
max1756.410-1756.422=-0.012
mean1648.500-1643.300=5.200
σ640.586-605.159=35.427
min622.000-625.000=-3.000
max2853.000-2466.000=387.000
mean2.797-2.810=-0.013
σ0.173-0.112=0.062
min2.238-2.526=-0.288
max2.992-2.975=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.047-321.044=0.004
σ0.057-0.052=0.005
min320.946-320.952=-0.006
max321.074-321.075=-0.001
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean0.421-0.421=-0.000
σ0.002-0.001=0.001
min0.418-0.420=-0.002
max0.424-0.422=0.002
iters=5
new-facts=1
prior-facts=6402
mean1981.625-1981.630=-0.005
σ0.012-0.005=0.006
min1981.608-1981.623=-0.015
max1981.635-1981.637=-0.002
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean2.711-2.621=0.090
σ0.166-0.075=0.091
min2.547-2.572=-0.025
max2.945-2.741=0.204
iters=5
new-facts=6402
prior-facts=1
mean4805.277-4805.256=0.021
σ7.718-7.710=0.008
min4801.715-4801.781=-0.066
max4819.083-4819.047=0.035
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean9.089-8.681=0.408
σ0.370-0.102=0.269
min8.696-8.552=0.144
max9.695-8.825=0.870
iters=5
new-facts=6402
prior-facts=6402
mean4992.756-4992.832=-0.076
σ0.153-0.015=0.138
min4992.483-4992.819=-0.336
max4992.832-4992.850=-0.018
mean3060.200-2979.600=80.600
σ269.610-286.049=-16.439
min2853.000-2596.000=257.000
max3476.000-3320.000=156.000
mean8.497-8.654=-0.156
σ0.057-0.129=-0.071
min8.436-8.517=-0.081
max8.591-8.843=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.713=-0.682
σ0.130-0.104=0.025
min0.914-1.605=-0.691
max1.231-1.825=-0.595

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.427-462.402=0.024
σ574.243-574.243=-0.000
min175.296-175.275=0.021
max1323.791-1323.767=0.024
mean86.250
σ8.500
min82.000
max99.000
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean0.432-0.534=-0.103
σ0.300-0.533=-0.233
min0.279-0.266=0.013
max0.882-1.334=-0.452
policies=20
mean1753.243-1753.051=0.192
σ0.360-0.359=0.001
min1753.006-1752.837=0.169
max1753.779-1753.589=0.191
mean820.000
σ0.000
min820.000
max820.000
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean2.784-2.730=0.055
σ0.004-0.015=-0.011
min2.779-2.716=0.062
max2.787-2.749=0.038
policies=200
mean17538.836-17537.646=1.190
σ0.586-0.433=0.154
min17538.080-17537.140=0.940
max17539.311-17538.196=1.115
mean8200.000
σ0.000
min8200.000
max8200.000
mean2853.000-2466.000=387.000
σ0.000
min2853.000-2466.000=387.000
max2853.000-2466.000=387.000
mean27.873-27.415=0.457
σ0.398-0.105=0.293
min27.418-27.306=0.112
max28.299-27.558=0.741