Compare commits

Home / Compare 954c39b6 .. 5e8df37d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.570=-0.002
σ0.044-0.044=-0.000
min70.545-70.545=0.000
max70.692-70.693=-0.001
mean413.800-415.800=-2.000
σ0.422
min413.000-415.000=-2.000
max414.000-416.000=-2.000
mean0.159-0.154=0.004
σ0.003-0.006=-0.003
min0.155-0.148=0.007
max0.164-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.294-21.292=0.002
σ0.011-0.003=0.008
min21.287-21.287=-0.000
max21.324-21.297=0.027
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.173-1753.171=0.002
σ0.360-0.364=-0.003
min1752.600-1752.604=-0.004
max1753.760-1753.758=0.002
mean1649.800-1664.700=-14.900
σ615.470-638.202=-22.731
min668.000-623.000=45.000
max2652.000-2804.000=-152.000
mean2.879-2.768=0.111
σ0.131-0.194=-0.063
min2.544-2.311=0.233
max3.211-3.033=0.178

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.619-271.617=0.002
σ0.008-0.009=-0.001
min271.611-271.609=0.002
max271.629-271.631=-0.002
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean0.376-0.377=-0.002
σ0.007-0.007=-0.000
min0.371-0.373=-0.001
max0.388-0.390=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.040-1932.047=-0.007
σ0.005-0.010=-0.005
min1932.036-1932.036=0.000
max1932.048-1932.063=-0.015
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean3.068-3.043=0.024
σ0.159-0.333=-0.174
min2.938-2.528=0.410
max3.319-3.354=-0.035
iters=5
new-facts=6402
prior-facts=1
mean4752.599-4752.729=-0.130
σ1.048-0.912=0.136
min4751.709-4751.947=-0.237
max4754.363-4754.307=0.056
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean8.350-8.074=0.275
σ0.469-0.293=0.175
min7.675-7.819=-0.144
max8.944-8.562=0.382
iters=5
new-facts=6402
prior-facts=6402
mean4943.168-4943.234=-0.066
σ0.147-0.018=0.129
min4942.906-4943.211=-0.305
max4943.251-4943.248=0.002
mean3025.400-3034.600=-9.200
σ302.307-281.376=20.931
min2652.000-2804.000=-152.000
max3317.000-3455.000=-138.000
mean8.887-8.591=0.296
σ0.416-0.326=0.090
min8.448-8.299=0.149
max9.368-9.063=0.306

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.202-1.031=0.170
σ0.295-0.139=0.156
min0.934-0.936=-0.002
max1.690-1.254=0.436

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.287-472.291=-0.004
σ575.927-575.932=-0.006
min184.320-184.320=0.001
max1336.177-1336.189=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean0.557-0.494=0.063
σ0.542-0.391=0.151
min0.282-0.294=-0.012
max1.370-1.080=0.290
policies=20
mean1843.535-1843.534=0.002
σ0.384-0.369=0.015
min1843.268-1843.300=-0.033
max1844.101-1844.080=0.021
mean840.000
σ0.000
min840.000
max840.000
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean2.879-2.886=-0.007
σ0.011-0.045=-0.034
min2.863-2.856=0.006
max2.886-2.952=-0.066
policies=200
mean18441.910-18442.039=-0.128
σ0.608-0.468=0.140
min18441.547-18441.768=-0.221
max18442.814-18442.739=0.075
mean8400.000
σ0.000
min8400.000
max8400.000
mean2652.000-2804.000=-152.000
σ0.000
min2652.000-2804.000=-152.000
max2652.000-2804.000=-152.000
mean28.918-28.922=-0.004
σ0.221-0.099=0.122
min28.612-28.806=-0.194
max29.139-29.042=0.097