Compare commits

Home / Compare d1b08ccb .. 1d64f782

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.378=0.001
σ0.046-0.045=0.001
min70.350-70.352=-0.002
max70.507-70.504=0.004
mean413.300-416.000=-2.700
σ0.483-0.000=0.483
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.160-0.157=0.003
σ0.004-0.004=-0.000
min0.156-0.152=0.004
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.003=-0.000
min21.140-21.140=0.000
max21.149-21.148=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.389-1752.387=0.002
σ0.359-0.363=-0.004
min1751.821-1751.819=0.003
max1752.977-1752.974=0.003
mean1656.100-1630.500=25.600
σ616.887-597.995=18.892
min637.000-641.000=-4.000
max2495.000-2410.000=85.000
mean2.859-2.751=0.108
σ0.099-0.252=-0.153
min2.521-2.173=0.348
max2.993-3.266=-0.273

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.132-270.128=0.004
σ0.005-0.006=-0.001
min270.126-270.119=0.006
max270.136-270.136=0.000
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean0.377-0.381=-0.004
σ0.004-0.003=0.001
min0.371-0.379=-0.007
max0.383-0.387=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.594=0.001
σ0.011-0.012=-0.002
min1930.581-1930.578=0.003
max1930.607-1930.609=-0.002
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean2.488-2.628=-0.140
σ0.067-0.176=-0.108
min2.397-2.446=-0.049
max2.551-2.860=-0.308
iters=5
new-facts=6402
prior-facts=1
mean4750.886-4751.072=-0.186
σ0.600-0.880=-0.279
min4750.273-4750.492=-0.219
max4751.893-4752.633=-0.740
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean8.130-8.483=-0.353
σ0.511-0.582=-0.071
min7.554-7.613=-0.059
max8.719-9.027=-0.308
iters=5
new-facts=6402
prior-facts=6402
mean4941.531-4941.532=-0.001
σ0.092-0.087=0.005
min4941.453-4941.449=0.004
max4941.632-4941.637=-0.004
mean2989.400-3019.600=-30.200
σ280.918-374.361=-93.443
min2601.000-2512.000=89.000
max3321.000-3377.000=-56.000
mean8.503-8.661=-0.158
σ0.120-0.475=-0.355
min8.367-8.196=0.171
max8.674-9.458=-0.785

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.749-1.771=-0.022
σ0.166-0.087=0.079
min1.467-1.698=-0.231
max1.892-1.914=-0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.362=-0.002
σ575.936-575.931=0.005
min178.389-178.392=-0.003
max1330.264-1330.259=0.006
mean84.000
σ8.000
min80.000
max96.000
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean0.564-0.563=0.002
σ0.566-0.567=-0.001
min0.277-0.277=0.001
max1.413-1.413=-0.000
policies=20
mean1784.198-1784.223=-0.024
σ0.347-0.362=-0.015
min1783.974-1783.988=-0.014
max1784.715-1784.761=-0.046
mean800.000
σ0.000
min800.000
max800.000
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean2.769-2.776=-0.007
σ0.016-0.007=0.009
min2.752-2.767=-0.015
max2.783-2.784=-0.000
policies=200
mean17848.878-17848.772=0.106
σ0.507-0.455=0.052
min17848.504-17848.450=0.054
max17849.626-17849.437=0.189
mean8000.000
σ0.000
min8000.000
max8000.000
mean2495.000-2410.000=85.000
σ0.000
min2495.000-2410.000=85.000
max2495.000-2410.000=85.000
mean27.912-27.962=-0.050
σ0.034-0.067=-0.033
min27.863-27.892=-0.029
max27.940-28.051=-0.111