Compare commits

Home / Compare 171f9cfd .. 214dee9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.048-0.046=0.001
min70.347-70.350=-0.003
max70.511-70.507=0.004
mean413.000-413.300=-0.300
σ0.000-0.483=-0.483
min413.000
max413.000-414.000=-1.000
mean0.160-0.160=0.000
σ0.003-0.004=-0.001
min0.157-0.156=0.001
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=0.000
min21.141-21.140=0.001
max21.148-21.149=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.389=-0.002
σ0.360-0.359=0.001
min1751.823-1751.821=0.001
max1752.978-1752.977=0.001
mean1643.250-1656.100=-12.850
σ625.468-616.887=8.581
min669.000-637.000=32.000
max2509.000-2495.000=14.000
mean2.767-2.859=-0.091
σ0.206-0.099=0.107
min2.177-2.521=-0.345
max3.124-2.993=0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.125-270.132=-0.007
σ0.006-0.005=0.000
min270.117-270.126=-0.009
max270.131-270.136=-0.006
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean0.373-0.377=-0.004
σ0.006-0.004=0.002
min0.369-0.371=-0.002
max0.384-0.383=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.594=-0.007
σ0.020-0.011=0.010
min1930.564-1930.581=-0.018
max1930.610-1930.607=0.002
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean2.549-2.488=0.061
σ0.134-0.067=0.067
min2.442-2.397=0.044
max2.742-2.551=0.191
iters=5
new-facts=6402
prior-facts=1
mean4751.026-4750.886=0.140
σ0.523-0.600=-0.078
min4750.699-4750.273=0.426
max4751.949-4751.893=0.056
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean8.206-8.130=0.076
σ0.264-0.511=-0.248
min7.850-7.554=0.296
max8.473-8.719=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean4941.516-4941.531=-0.015
σ0.087-0.092=-0.005
min4941.437-4941.453=-0.017
max4941.614-4941.632=-0.019
mean2962.400-2989.400=-27.000
σ431.882-280.918=150.964
min2509.000-2601.000=-92.000
max3551.000-3321.000=230.000
mean8.448-8.503=-0.055
σ0.083-0.120=-0.037
min8.345-8.367=-0.022
max8.531-8.674=-0.143

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.652-1.749=-0.097
σ0.174-0.166=0.009
min1.400-1.467=-0.067
max1.876-1.892=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.365-466.360=0.005
σ575.935-575.936=-0.001
min178.392-178.389=0.003
max1330.267-1330.264=0.003
mean84.000
σ8.000
min80.000
max96.000
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean0.548-0.564=-0.016
σ0.536-0.566=-0.030
min0.278-0.277=0.001
max1.352-1.413=-0.061
policies=20
mean1784.227-1784.198=0.029
σ0.362-0.347=0.015
min1783.994-1783.974=0.020
max1784.765-1784.715=0.050
mean800.000
σ0.000
min800.000
max800.000
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean2.780-2.769=0.011
σ0.013-0.016=-0.003
min2.763-2.752=0.011
max2.793-2.783=0.010
policies=200
mean17848.931-17848.878=0.052
σ0.494-0.507=-0.013
min17848.654-17848.504=0.150
max17849.671-17849.626=0.044
mean8000.000
σ0.000
min8000.000
max8000.000
mean2509.000-2495.000=14.000
σ0.000
min2509.000-2495.000=14.000
max2509.000-2495.000=14.000
mean27.976-27.912=0.064
σ0.186-0.034=0.152
min27.775-27.863=-0.088
max28.224-27.940=0.284