Compare commits

Home / Compare 052fa513 .. e66cb313

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-73.049=-0.001
σ0.049-0.046=0.003
min73.025-73.017=0.008
max73.185-73.176=0.009
mean416.000-418.000=-2.000
σ0.000-1.054=-1.054
min416.000-417.000=-1.000
max416.000-419.000=-3.000
mean0.161-0.168=-0.007
σ0.003-0.008=-0.005
min0.157-0.161=-0.003
max0.167-0.187=-0.020
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.000
σ0.002-0.002=-0.000
min23.737-23.738=-0.000
max23.743-23.747=-0.003
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.066-0.066=-0.001
σ0.002-0.003=-0.001
min0.064-0.064=-0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.786=0.002
σ0.363-0.359=0.004
min1758.213-1758.218=-0.004
max1759.373-1759.368=0.005
mean1646.400-1656.400=-10.000
σ628.178-621.547=6.631
min624.000-634.000=-10.000
max2768.000-2506.000=262.000
mean2.789-2.732=0.057
σ0.158-0.270=-0.112
min2.226-2.157=0.069
max2.995-3.112=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-324.012=-0.001
σ0.058-0.053=0.006
min323.908-323.918=-0.010
max324.046-324.041=0.005
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean0.432-0.426=0.006
σ0.005-0.002=0.004
min0.426-0.424=0.002
max0.438-0.428=0.010
iters=5
new-facts=1
prior-facts=6402
mean1984.569-1984.580=-0.011
σ0.019-0.015=0.004
min1984.542-1984.565=-0.022
max1984.595-1984.599=-0.004
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean2.581-2.608=-0.027
σ0.074-0.123=-0.049
min2.496-2.444=0.052
max2.685-2.769=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4808.294-4808.191=0.103
σ7.761-7.814=-0.053
min4804.692-4804.145=0.547
max4822.174-4822.156=0.018
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean8.979-8.498=0.481
σ0.500-0.486=0.014
min8.493-7.928=0.564
max9.787-9.020=0.768
iters=5
new-facts=6402
prior-facts=6402
mean4995.810-4995.805=0.005
σ0.015-0.019=-0.004
min4995.791-4995.783=0.008
max4995.829-4995.819=0.009
mean2987.600-2941.000=46.600
σ216.551-307.335=-90.784
min2768.000-2506.000=262.000
max3303.000-3324.000=-21.000
mean8.614-8.556=0.058
σ0.095-0.046=0.049
min8.493-8.479=0.015
max8.711-8.596=0.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.795=-0.709
σ0.179-0.072=0.107
min0.919-1.682=-0.762
max1.307-1.860=-0.554

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.358-468.323=0.034
σ574.240-574.228=0.012
min181.227-181.207=0.020
max1329.718-1329.665=0.053
mean88.250
σ8.500
min84.000
max101.000
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean0.444-0.537=-0.093
σ0.306-0.510=-0.204
min0.289-0.281=0.008
max0.902-1.301=-0.399
policies=20
mean1812.599-1812.409=0.190
σ0.394-0.392=0.002
min1812.344-1812.149=0.196
max1813.179-1812.988=0.191
mean840.000
σ0.000
min840.000
max840.000
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean2.892-2.817=0.075
σ0.009-0.016=-0.007
min2.885-2.799=0.086
max2.904-2.831=0.073
policies=200
mean18131.642-18131.563=0.079
σ0.547-0.402=0.145
min18131.159-18131.295=-0.136
max18132.427-18132.157=0.270
mean8400.000
σ0.000
min8400.000
max8400.000
mean2768.000-2506.000=262.000
σ0.000
min2768.000-2506.000=262.000
max2768.000-2506.000=262.000
mean28.444-28.436=0.008
σ0.223-0.046=0.177
min28.217-28.378=-0.161
max28.636-28.480=0.156