Compare commits

Home / Compare 3a5c8183 .. e6fd9fec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.564=0.001
σ0.047-0.047=-0.000
min70.538-70.539=-0.001
max70.696-70.697=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.161-0.161=-0.001
σ0.003-0.003=-0.000
min0.158-0.157=0.000
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.290-21.291=-0.001
σ0.012-0.012=-0.001
min21.282-21.283=-0.002
max21.322-21.324=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.064=-0.004
σ0.003-0.002=0.001
min0.058-0.063=-0.005
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=-0.001
σ0.362-0.361=0.001
min1752.993-1752.996=-0.003
max1754.149-1754.159=-0.009
mean1603.800-1648.050=-44.250
σ626.652-614.087=12.564
min583.000-688.000=-105.000
max2727.000-2758.000=-31.000
mean2.775-2.824=-0.050
σ0.235-0.141=0.094
min2.249-2.493=-0.245
max3.124-3.025=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.011-272.015=-0.004
σ0.005-0.007=-0.002
min272.004-272.005=-0.001
max272.017-272.022=-0.004
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean0.386-0.390=-0.005
σ0.008-0.005=0.003
min0.379-0.382=-0.002
max0.400-0.395=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.432=0.005
σ0.012-0.011=0.000
min1932.418-1932.419=-0.001
max1932.446-1932.444=0.002
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean2.999-2.985=0.014
σ0.070-0.087=-0.017
min2.947-2.867=0.080
max3.117-3.102=0.015
iters=5
new-facts=6402
prior-facts=1
mean4753.053-4753.016=0.036
σ0.895-0.938=-0.043
min4752.326-4752.195=0.131
max4754.612-4754.626=-0.013
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean8.415-8.637=-0.222
σ0.302-0.391=-0.089
min8.012-8.219=-0.207
max8.796-9.093=-0.297
iters=5
new-facts=6402
prior-facts=6402
mean4943.563-4943.626=-0.063
σ0.166-0.022=0.143
min4943.268-4943.600=-0.331
max4943.653-4943.651=0.003
mean3044.400-2972.600=71.800
σ273.058-271.921=1.138
min2727.000-2758.000=-31.000
max3420.000-3398.000=22.000
mean8.507-8.403=0.104
σ0.094-0.046=0.048
min8.360-8.367=-0.007
max8.592-8.464=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.055=-0.026
σ0.138-0.189=-0.050
min0.934-0.935=-0.001
max1.251-1.373=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.091-473.091=0.001
σ575.938-575.944=-0.006
min185.114-185.111=0.004
max1336.998-1337.006=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean0.557-0.555=0.002
σ0.542-0.527=0.016
min0.284-0.289=-0.006
max1.370-1.345=0.025
policies=20
mean1851.441-1851.433=0.008
σ0.363-0.379=-0.016
min1851.203-1851.175=0.028
max1851.978-1851.993=-0.015
mean840.000
σ0.000
min840.000
max840.000
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean2.882-2.885=-0.003
σ0.016-0.019=-0.003
min2.864-2.867=-0.003
max2.900-2.906=-0.005
policies=200
mean18521.168-18520.966=0.203
σ0.510-0.573=-0.063
min18520.876-18520.650=0.226
max18521.931-18521.823=0.108
mean8400.000
σ0.000
min8400.000
max8400.000
mean2727.000-2758.000=-31.000
σ0.000
min2727.000-2758.000=-31.000
max2727.000-2758.000=-31.000
mean28.934-28.815=0.119
σ0.112-0.112=0.001
min28.841-28.704=0.137
max29.096-28.952=0.144