Compare commits

Home / Compare f186b350 .. 1ac554c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.053-0.051=0.002
min35.218-35.218=0.000
max35.393-35.387=0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.079-0.086=-0.007
σ0.004-0.004=0.000
min0.076-0.082=-0.006
max0.087-0.093=-0.006
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.003-0.002=0.000
min23.767-23.767=0.000
max23.775-23.773=0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.067-0.069=-0.002
σ0.001-0.003=-0.003
min0.066-0.066=-0.000
max0.068-0.076=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=-0.000
σ0.364-0.365=-0.001
min1755.911-1755.913=-0.001
max1757.073-1757.063=0.009
mean1650.550-1658.250=-7.700
σ628.062-642.350=-14.288
min620.000-631.000=-11.000
max2693.000-2800.000=-107.000
mean2.356-2.333=0.023
σ0.104-0.145=-0.040
min2.220-2.097=0.122
max2.649-2.786=-0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.703-324.692=0.011
σ0.053-0.048=0.005
min324.608-324.609=-0.001
max324.729-324.732=-0.004
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean0.428-0.431=-0.003
σ0.010-0.011=-0.001
min0.422-0.423=-0.002
max0.445-0.448=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.258-1985.262=-0.004
σ0.011-0.009=0.002
min1985.244-1985.247=-0.003
max1985.268-1985.269=-0.000
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean2.639-2.640=-0.001
σ0.095-0.059=0.035
min2.575-2.590=-0.015
max2.796-2.715=0.081
iters=5
new-facts=6402
prior-facts=1
mean4808.877-4808.774=0.103
σ7.687-7.783=-0.096
min4805.364-4804.838=0.526
max4822.628-4822.688=-0.061
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean8.984-9.114=-0.130
σ0.241-0.179=0.062
min8.670-8.900=-0.230
max9.301-9.366=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4996.437=0.028
σ0.009-0.070=-0.061
min4996.451-4996.317=0.134
max4996.474-4996.492=-0.017
mean3007.400-2989.200=18.200
σ361.672-202.097=159.575
min2693.000-2800.000=-107.000
max3535.000-3291.000=244.000
mean8.645-8.687=-0.042
σ0.138-0.157=-0.019
min8.473-8.473=-0.001
max8.793-8.899=-0.107

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.941-0.949=-0.008
σ0.062-0.051=0.010
min0.900-0.919=-0.019
max1.048-1.040=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.958-462.964=-0.006
σ574.254-574.250=0.005
min175.817-175.833=-0.016
max1324.340-1324.338=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean0.551-0.430=0.121
σ0.554-0.302=0.252
min0.274-0.278=-0.004
max1.382-0.883=0.499
policies=20
mean1758.533-1758.685=-0.151
σ0.336-0.327=0.008
min1758.308-1758.470=-0.162
max1759.032-1759.170=-0.138
mean820.000
σ0.000
min820.000
max820.000
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean2.719-2.832=-0.113
σ0.006-0.077=-0.070
min2.712-2.781=-0.069
max2.726-2.946=-0.220
policies=200
mean17592.443-17592.425=0.018
σ0.484-0.542=-0.059
min17592.173-17592.064=0.108
max17593.167-17593.231=-0.064
mean8200.000
σ0.000
min8200.000
max8200.000
mean2693.000-2800.000=-107.000
σ0.000
min2693.000-2800.000=-107.000
max2693.000-2800.000=-107.000
mean27.449-27.493=-0.044
σ0.073-0.117=-0.044
min27.364-27.388=-0.025
max27.529-27.603=-0.074