Compare commits

Home / Compare 3d8101ee .. fd10bb4f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.000
σ0.048-0.052=-0.003
min33.951-33.942=0.009
max34.112-34.123=-0.011
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.084-0.084=-0.000
σ0.003-0.003=0.000
min0.082-0.082=-0.000
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.000
min23.312-23.314=-0.002
max23.322-23.326=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.000
min0.060-0.064=-0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.302=0.001
σ0.364-0.365=-0.001
min1756.728-1756.727=0.001
max1757.889-1757.891=-0.002
mean1663.650-1646.950=16.700
σ627.050-625.008=2.042
min669.000-635.000=34.000
max2610.000-2825.000=-215.000
mean2.367-2.373=-0.006
σ0.104-0.083=0.021
min2.265-2.274=-0.009
max2.701-2.581=0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.442-326.453=-0.010
σ0.053-0.031=0.023
min326.347-326.401=-0.054
max326.469-326.477=-0.008
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean0.428-0.423=0.005
σ0.002-0.003=-0.001
min0.426-0.419=0.007
max0.431-0.426=0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.612-1988.611=0.001
σ0.012-0.009=0.003
min1988.598-1988.600=-0.002
max1988.623-1988.621=0.002
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean2.693-2.703=-0.010
σ0.080-0.067=0.014
min2.596-2.643=-0.047
max2.817-2.783=0.035
iters=5
new-facts=6402
prior-facts=1
mean4813.342-4813.259=0.083
σ7.800-7.852=-0.051
min4809.449-4808.982=0.467
max4827.289-4827.281=0.008
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean8.797-8.350=0.447
σ0.301-0.599=-0.297
min8.469-7.754=0.715
max9.214-9.152=0.061
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5000.864=0.146
σ0.026-0.199=-0.173
min5000.979-5000.630=0.350
max5001.046-5001.043=0.003
mean2961.400-3067.200=-105.800
σ266.965-319.920=-52.955
min2622.000-2825.000=-203.000
max3317.000-3556.000=-239.000
mean9.672-9.093=0.579
σ0.320-0.492=-0.172
min9.223-8.479=0.744
max9.989-9.693=0.296

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.186-0.950=0.236
σ0.301-0.061=0.240
min0.922-0.912=0.011
max1.563-1.058=0.505

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.435-464.441=-0.006
σ574.781-574.774=0.007
min177.040-177.041=-0.001
max1326.606-1326.601=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean0.555-0.442=0.114
σ0.566-0.314=0.251
min0.271-0.281=-0.011
max1.404-0.913=0.491
policies=20
mean1770.742-1770.801=-0.059
σ0.359-0.366=-0.007
min1770.508-1770.552=-0.045
max1771.276-1771.343=-0.067
mean840.000
σ0.000
min840.000
max840.000
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean2.725-2.799=-0.073
σ0.018-0.024=-0.005
min2.709-2.773=-0.064
max2.742-2.830=-0.087
policies=200
mean17714.881-17714.854=0.027
σ0.614-0.543=0.070
min17714.449-17714.430=0.019
max17715.791-17715.642=0.149
mean8400.000
σ0.000
min8400.000
max8400.000
mean2610.000-2825.000=-215.000
σ0.000
min2610.000-2825.000=-215.000
max2610.000-2825.000=-215.000
mean27.618-27.940=-0.322
σ0.247-0.378=-0.131
min27.340-27.623=-0.283
max27.932-28.372=-0.441