Compare commits

Home / Compare 61501804 .. e31f5c78

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.563=0.003
σ0.048-0.044=0.004
min70.533-70.539=-0.006
max70.699-70.687=0.013
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.156-0.157=-0.000
σ0.004-0.005=-0.000
min0.150-0.150=0.000
max0.163-0.162=0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.291=-0.004
σ0.003-0.010=-0.008
min21.282-21.283=-0.002
max21.291-21.319=-0.029
mean413.000-414.700=-1.700
σ0.000-0.483=-0.483
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.058=0.004
max0.072-0.066=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.569=-0.002
σ0.360-0.360=0.001
min1752.991-1752.999=-0.008
max1754.145-1754.155=-0.009
mean1663.850-1667.800=-3.950
σ646.255-646.884=-0.629
min686.000-687.000=-1.000
max2769.000-2774.000=-5.000
mean2.759-2.805=-0.046
σ0.244-0.154=0.090
min2.178-2.308=-0.130
max3.007-2.987=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-272.013=-0.001
σ0.008-0.008=0.001
min271.998-272.003=-0.005
max272.021-272.023=-0.002
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean0.388-0.389=-0.001
σ0.009-0.010=-0.001
min0.378-0.379=-0.001
max0.396-0.404=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.442=-0.004
σ0.017-0.011=0.006
min1932.413-1932.431=-0.018
max1932.459-1932.457=0.002
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean2.944-2.920=0.024
σ0.132-0.191=-0.059
min2.750-2.585=0.165
max3.088-3.066=0.022
iters=5
new-facts=6402
prior-facts=1
mean4753.028-4753.128=-0.100
σ0.575-0.863=-0.288
min4752.622-4752.697=-0.075
max4754.030-4754.668=-0.638
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean8.645-8.765=-0.120
σ0.380-0.272=0.108
min8.135-8.443=-0.308
max9.165-9.070=0.095
iters=5
new-facts=6402
prior-facts=6402
mean4943.630-4943.632=-0.003
σ0.019-0.015=0.004
min4943.608-4943.612=-0.004
max4943.651-4943.649=0.002
mean3001.200-3027.400=-26.200
σ219.704-235.208=-15.504
min2769.000-2774.000=-5.000
max3303.000-3331.000=-28.000
mean8.532-8.757=-0.225
σ0.100-0.366=-0.266
min8.429-8.432=-0.003
max8.640-9.216=-0.576

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-0.992=0.047
σ0.127-0.143=-0.016
min0.924-0.916=0.009
max1.235-1.247=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.091-473.102=-0.011
σ575.935-575.959=-0.024
min185.112-185.116=-0.004
max1336.993-1337.040=-0.047
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean0.477-0.622=-0.145
σ0.384-0.647=-0.263
min0.283-0.295=-0.013
max1.053-1.593=-0.540
policies=20
mean1851.435-1851.433=0.003
σ0.377-0.368=0.009
min1851.178-1851.179=-0.002
max1851.994-1851.976=0.017
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean2.847-2.856=-0.010
σ0.012-0.029=-0.017
min2.831-2.830=0.002
max2.859-2.896=-0.037
policies=200
mean18521.183-18521.031=0.153
σ0.492-0.571=-0.080
min18520.894-18520.706=0.188
max18521.918-18521.886=0.032
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2774.000=-5.000
σ0.000
min2769.000-2774.000=-5.000
max2769.000-2774.000=-5.000
mean28.773-28.781=-0.009
σ0.077-0.189=-0.111
min28.691-28.561=0.129
max28.854-29.018=-0.164