Compare commits

Home / Compare 6559884b .. bc4eb76a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.794=0.000
σ0.109-0.110=-0.001
min35.739-35.742=-0.003
max36.102-36.106=-0.004
mean412.000-409.000=3.000
σ0.000
min412.000-409.000=3.000
max412.000-409.000=3.000
mean0.072-0.076=-0.004
σ0.004-0.004=0.001
min0.068-0.074=-0.005
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.066-26.066=-0.000
σ0.003-0.002=0.001
min26.061-26.063=-0.002
max26.071-26.069=0.001
mean412.000-409.000=3.000
σ0.000
min412.000-409.000=3.000
max412.000-409.000=3.000
mean0.061-0.061=0.000
σ0.002-0.002=-0.000
min0.059-0.059=0.000
max0.067-0.067=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.999-1757.000=-0.001
σ0.364-0.364=-0.000
min1756.425-1756.425=0.000
max1757.568-1757.582=-0.014
mean1654.950-1651.050=3.900
σ635.849-632.708=3.141
min670.000-660.000=10.000
max2731.000-2797.000=-66.000
mean2.871-2.854=0.017
σ0.150-0.105=0.045
min2.513-2.576=-0.063
max3.148-2.993=0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.264-278.280=-0.015
σ0.007-0.006=0.001
min278.258-278.274=-0.015
max278.277-278.288=-0.011
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean0.414-0.409=0.005
σ0.011-0.007=0.004
min0.404-0.403=0.001
max0.428-0.419=0.009
iters=5
new-facts=1
prior-facts=6402
mean2175.522-2175.528=-0.006
σ0.011-0.011=0.000
min2175.510-2175.514=-0.005
max2175.537-2175.538=-0.001
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean2.886-2.916=-0.030
σ0.230-0.129=0.101
min2.687-2.796=-0.110
max3.277-3.107=0.170
iters=5
new-facts=6402
prior-facts=1
mean5134.468-5134.486=-0.018
σ1.061-1.016=0.045
min5133.600-5133.724=-0.124
max5136.317-5136.275=0.043
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean9.075-9.289=-0.214
σ0.323-0.271=0.052
min8.617-8.965=-0.347
max9.528-9.587=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean5238.359-5238.301=0.058
σ0.102-0.198=-0.096
min5238.265-5237.971=0.294
max5238.470-5238.463=0.007
mean3205.600-3280.000=-74.400
σ448.846-454.073=-5.227
min2731.000-2797.000=-66.000
max3841.000-3899.000=-58.000
mean8.829-9.035=-0.206
σ0.101-0.427=-0.326
min8.732-8.744=-0.012
max8.987-9.785=-0.798

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.064=-0.027
σ0.134-0.131=0.003
min0.945-0.943=0.002
max1.254-1.264=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.473-467.467=0.007
σ572.658-572.647=0.011
min181.134-181.139=-0.005
max1326.460-1326.437=0.023
mean85.500
σ7.000
min82.000
max96.000
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean0.581-0.455=0.127
σ0.575-0.306=0.269
min0.292-0.297=-0.005
max1.443-0.913=0.530
policies=20
mean1811.664-1811.683=-0.020
σ0.376-0.370=0.006
min1811.412-1811.419=-0.007
max1812.221-1812.212=0.008
mean820.000
σ0.000
min820.000
max820.000
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean2.852-2.946=-0.094
σ0.015-0.091=-0.077
min2.836-2.864=-0.028
max2.869-3.065=-0.196
policies=200
mean18123.512-18123.338=0.175
σ0.508-0.437=0.071
min18123.258-18123.086=0.172
max18124.274-18123.992=0.282
mean8200.000
σ0.000
min8200.000
max8200.000
mean2731.000-2797.000=-66.000
σ0.000
min2731.000-2797.000=-66.000
max2731.000-2797.000=-66.000
mean28.989-28.938=0.051
σ0.289-0.145=0.144
min28.674-28.790=-0.116
max29.295-29.064=0.231