Compare commits

Home / Compare bcb564f8 .. 5035d9bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.566=-0.004
σ0.049-0.046=0.003
min70.537-70.539=-0.002
max70.699-70.692=0.007
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.154-0.153=0.001
σ0.005-0.005=-0.000
min0.149-0.147=0.002
max0.163-0.163=0.000
cache=y
dps=1
iters=10
policies=100
mean21.291-21.287=0.004
σ0.011-0.003=0.008
min21.284-21.283=0.002
max21.322-21.291=0.031
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.060=0.004
σ0.002-0.002=-0.000
min0.063-0.059=0.004
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.173-1753.173=-0.000
σ0.360-0.362=-0.001
min1752.607-1752.606=0.001
max1753.763-1753.742=0.021
mean1669.850-1657.300=12.550
σ641.805-639.229=2.577
min692.000-630.000=62.000
max2842.000-2843.000=-1.000
mean2.739-2.746=-0.007
σ0.212-0.192=0.020
min2.153-2.305=-0.152
max3.033-2.968=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.625-271.623=0.002
σ0.005-0.008=-0.003
min271.619-271.614=0.005
max271.629-271.629=0.001
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean0.382-0.378=0.003
σ0.002-0.004=-0.002
min0.380-0.372=0.008
max0.384-0.382=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.040-1932.045=-0.005
σ0.013-0.013=0.000
min1932.024-1932.031=-0.007
max1932.056-1932.063=-0.007
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean3.019-3.032=-0.013
σ0.093-0.211=-0.118
min2.953-2.770=0.183
max3.182-3.357=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4752.811-4752.812=-0.001
σ0.834-0.822=0.012
min4752.285-4752.319=-0.034
max4754.291-4754.274=0.017
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean8.189-8.175=0.014
σ0.639-0.575=0.064
min7.668-7.727=-0.059
max9.109-8.993=0.116
iters=5
new-facts=6402
prior-facts=6402
mean4943.241-4943.230=0.012
σ0.018-0.010=0.008
min4943.217-4943.213=0.005
max4943.260-4943.238=0.023
mean3059.200-3057.600=1.600
σ273.472-272.380=1.093
min2842.000-2843.000=-1.000
max3478.000-3473.000=5.000
mean8.641-8.486=0.156
σ0.371-0.162=0.209
min8.390-8.328=0.062
max9.277-8.750=0.527

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.019=0.038
σ0.130-0.138=-0.008
min0.934-0.927=0.007
max1.252-1.246=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-472.288=0.004
σ575.915-575.919=-0.004
min184.328-184.326=0.002
max1336.164-1336.166=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean0.452-0.453=-0.001
σ0.302-0.303=-0.001
min0.299-0.298=0.001
max0.904-0.908=-0.003
policies=20
mean1843.570-1843.583=-0.013
σ0.381-0.370=0.011
min1843.291-1843.314=-0.024
max1844.121-1844.119=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean2.980-2.975=0.005
σ0.018-0.046=-0.028
min2.963-2.945=0.018
max3.001-3.043=-0.041
policies=200
mean18442.237-18442.232=0.006
σ0.479-0.439=0.040
min18441.930-18441.816=0.114
max18442.951-18442.845=0.106
mean8400.000
σ0.000
min8400.000
max8400.000
mean2842.000-2843.000=-1.000
σ0.000
min2842.000-2843.000=-1.000
max2842.000-2843.000=-1.000
mean29.327-29.110=0.217
σ0.418-0.568=-0.150
min28.929-28.657=0.272
max29.913-29.938=-0.025