Compare commits

Home / Compare b8448263 .. 3aa69261

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.000
σ0.045-0.047=-0.002
min70.678-70.669=0.009
max70.827-70.831=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.160-0.162=-0.002
σ0.003-0.003=-0.001
min0.157-0.159=-0.002
max0.166-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.001
σ0.003-0.002=0.001
min21.404-21.404=-0.000
max21.413-21.410=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.361-0.362=-0.000
min1754.357-1754.359=-0.002
max1755.512-1755.517=-0.005
mean1650.500-1657.050=-6.550
σ624.381-619.488=4.892
min623.000-686.000=-63.000
max2771.000-2775.000=-4.000
mean2.748-2.816=-0.069
σ0.163-0.143=0.020
min2.330-2.330=0.000
max3.033-3.034=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.755-272.755=0.000
σ0.004-0.003=0.001
min272.749-272.753=-0.004
max272.759-272.760=-0.001
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean0.382-0.384=-0.002
σ0.005-0.008=-0.003
min0.379-0.379=-0.000
max0.391-0.398=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1933.159=-0.001
σ0.015-0.018=-0.003
min1933.140-1933.141=-0.001
max1933.177-1933.183=-0.006
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean2.959-2.968=-0.009
σ0.132-0.362=-0.230
min2.745-2.472=0.273
max3.092-3.396=-0.304
iters=5
new-facts=6402
prior-facts=1
mean4756.795-4756.911=-0.116
σ7.679-7.589=0.090
min4752.949-4753.446=-0.496
max4770.524-4770.486=0.038
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean8.705-8.618=0.087
σ0.547-0.218=0.330
min7.947-8.366=-0.419
max9.326-8.961=0.365
iters=5
new-facts=6402
prior-facts=6402
mean4944.394-4944.392=0.002
σ0.018-0.023=-0.005
min4944.369-4944.366=0.003
max4944.409-4944.423=-0.014
mean2987.400-3037.400=-50.000
σ220.205-323.120=-102.915
min2771.000-2775.000=-4.000
max3309.000-3525.000=-216.000
mean8.514-8.450=0.063
σ0.082-0.128=-0.046
min8.432-8.337=0.095
max8.632-8.666=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-1.006=0.030
σ0.134-0.135=-0.002
min0.915-0.916=-0.002
max1.241-1.226=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.360-468.344=0.016
σ574.272-574.255=0.018
min181.220-181.207=0.013
max1329.769-1329.726=0.043
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean0.485-0.447=0.038
σ0.385-0.307=0.078
min0.290-0.292=-0.002
max1.062-0.907=0.155
policies=20
mean1812.526-1812.380=0.146
σ0.382-0.393=-0.011
min1812.265-1812.104=0.161
max1813.087-1812.957=0.130
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean2.889-2.884=0.005
σ0.001-0.009=-0.008
min2.888-2.878=0.011
max2.891-2.896=-0.006
policies=200
mean18129.050-18129.054=-0.005
σ0.481-0.344=0.137
min18128.516-18128.731=-0.214
max18129.510-18129.503=0.007
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2775.000=-4.000
σ0.000
min2771.000-2775.000=-4.000
max2771.000-2775.000=-4.000
mean28.439-28.471=-0.032
σ0.213-0.236=-0.023
min28.279-28.258=0.021
max28.732-28.722=0.010