Compare commits

Home / Compare 71fa85ea .. ea4e13d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.709-70.701=0.008
σ0.047-0.046=0.001
min70.678-70.669=0.009
max70.839-70.829=0.010
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.160-0.156=0.004
σ0.005-0.005=0.000
min0.151-0.149=0.002
max0.167-0.160=0.007
cache=y
dps=1
iters=10
policies=100
mean21.411-21.409=0.002
σ0.002-0.003=-0.001
min21.408-21.404=0.004
max21.414-21.413=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.058-0.064=-0.006
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.931=0.001
σ0.360-0.361=-0.001
min1754.364-1754.363=0.000
max1755.519-1755.511=0.008
mean1659.150-1663.100=-3.950
σ624.427-620.211=4.216
min641.000-627.000=14.000
max2512.000-2513.000=-1.000
mean2.779-2.851=-0.072
σ0.228-0.154=0.074
min2.271-2.420=-0.149
max3.368-3.031=0.337

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.792=-0.000
σ0.003-0.005=-0.002
min272.788-272.786=0.002
max272.795-272.798=-0.003
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean0.378-0.379=-0.001
σ0.001-0.001=0.000
min0.377-0.378=-0.001
max0.379-0.380=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.223-1933.229=-0.006
σ0.019-0.018=0.001
min1933.197-1933.209=-0.012
max1933.241-1933.256=-0.015
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean3.059-2.887=0.172
σ0.134-0.240=-0.106
min2.966-2.476=0.490
max3.296-3.087=0.210
iters=5
new-facts=6402
prior-facts=1
mean4756.825-4756.815=0.010
σ7.329-7.659=-0.330
min4753.455-4752.961=0.494
max4769.935-4770.508=-0.573
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean8.551-8.823=-0.273
σ0.461-0.172=0.290
min7.811-8.531=-0.720
max8.994-8.973=0.020
iters=5
new-facts=6402
prior-facts=6402
mean4944.442-4944.460=-0.018
σ0.026-0.021=0.005
min4944.415-4944.423=-0.007
max4944.470-4944.474=-0.004
mean2938.200-2964.000=-25.800
σ300.747-283.842=16.905
min2512.000-2587.000=-75.000
max3308.000-3337.000=-29.000
mean8.426-8.683=-0.257
σ0.070-0.407=-0.337
min8.350-8.342=0.009
max8.516-9.285=-0.769

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.673=-0.123
σ0.115-0.227=-0.112
min1.360-1.296=0.064
max1.664-1.883=-0.220

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.307-468.320=-0.013
σ574.231-574.256=-0.025
min181.185-181.188=-0.003
max1329.653-1329.704=-0.052
mean88.250
σ8.500
min84.000
max101.000
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean0.550-0.568=-0.018
σ0.532-0.564=-0.032
min0.283-0.279=0.004
max1.348-1.414=-0.066
policies=20
mean1812.176-1812.143=0.032
σ0.374-0.359=0.015
min1811.925-1811.929=-0.004
max1812.730-1812.678=0.053
mean840.000
σ0.000
min840.000
max840.000
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean2.803-2.813=-0.010
σ0.004-0.017=-0.013
min2.799-2.792=0.007
max2.807-2.829=-0.023
policies=200
mean18128.994-18128.937=0.057
σ0.611-0.602=0.009
min18128.586-18128.537=0.049
max18129.885-18129.813=0.072
mean8400.000
σ0.000
min8400.000
max8400.000
mean2512.000-2513.000=-1.000
σ0.000
min2512.000-2513.000=-1.000
max2512.000-2513.000=-1.000
mean28.285-28.399=-0.114
σ0.071-0.059=0.012
min28.192-28.329=-0.136
max28.343-28.449=-0.105