Compare commits

Home / Compare 2bb88d8d .. 641a6fb1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.795-35.794=0.001
σ0.109-0.110=-0.002
min35.742-35.738=0.004
max36.102-36.106=-0.004
mean412.300-413.100=-0.800
σ0.483-0.316=0.167
min412.000-413.000=-1.000
max413.000-414.000=-1.000
mean0.076-0.075=0.001
σ0.004-0.003=0.001
min0.073-0.073=0.000
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean26.066-26.064=0.002
σ0.004-0.003=0.001
min26.060-26.059=0.001
max26.076-26.068=0.008
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.059=0.003
σ0.003-0.004=-0.001
min0.060-0.056=0.004
max0.069-0.065=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.000-1756.997=0.003
σ0.369-0.367=0.002
min1756.425-1756.425=0.001
max1757.590-1757.584=0.006
mean1660.900-1658.150=2.750
σ639.445-625.816=13.629
min671.000-672.000=-1.000
max2705.000-2741.000=-36.000
mean2.885-2.825=0.060
σ0.090-0.177=-0.087
min2.669-2.304=0.365
max3.031-3.033=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.285-278.286=-0.001
σ0.006-0.005=0.002
min278.277-278.278=-0.001
max278.295-278.290=0.005
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean0.409-0.411=-0.003
σ0.007-0.007=0.000
min0.403-0.405=-0.002
max0.419-0.422=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2175.530-2175.531=-0.002
σ0.011-0.024=-0.013
min2175.519-2175.501=0.018
max2175.548-2175.568=-0.020
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean3.000-2.966=0.034
σ0.264-0.123=0.141
min2.754-2.816=-0.062
max3.415-3.099=0.316
iters=5
new-facts=6402
prior-facts=1
mean5134.579-5134.571=0.008
σ1.015-0.938=0.077
min5134.024-5134.069=-0.045
max5136.388-5136.240=0.148
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean9.083-8.937=0.146
σ0.408-0.353=0.054
min8.744-8.377=0.367
max9.772-9.296=0.476
iters=5
new-facts=6402
prior-facts=6402
mean5238.308-5238.364=-0.056
σ0.121-0.110=0.011
min5238.132-5238.234=-0.102
max5238.474-5238.483=-0.010
mean3257.400-3265.600=-8.200
σ476.461-398.472=77.989
min2705.000-2741.000=-36.000
max3896.000-3647.000=249.000
mean8.881-9.286=-0.405
σ0.138-0.436=-0.298
min8.734-8.824=-0.090
max9.053-9.916=-0.862

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.106-1.096=0.010
σ0.118-0.114=0.004
min0.947-0.955=-0.008
max1.252-1.274=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.466-467.463=0.003
σ572.658-572.657=0.001
min181.132-181.131=0.001
max1326.453-1326.449=0.004
mean85.500
σ7.000
min82.000
max96.000
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean0.569-0.583=-0.015
σ0.552-0.580=-0.028
min0.285-0.285=0.000
max1.397-1.454=-0.057
policies=20
mean1811.669-1811.630=0.039
σ0.381-0.382=-0.001
min1811.426-1811.386=0.040
max1812.232-1812.196=0.036
mean820.000
σ0.000
min820.000
max820.000
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean2.867-2.858=0.010
σ0.014-0.012=0.003
min2.853-2.843=0.010
max2.886-2.870=0.016
policies=200
mean18123.477-18123.417=0.061
σ0.378-0.549=-0.171
min18123.255-18123.006=0.249
max18124.044-18124.226=-0.182
mean8200.000
σ0.000
min8200.000
max8200.000
mean2705.000-2741.000=-36.000
σ0.000
min2705.000-2741.000=-36.000
max2705.000-2741.000=-36.000
mean28.935-28.904=0.031
σ0.134-0.123=0.011
min28.819-28.723=0.095
max29.088-28.985=0.103