Compare commits

Home / Compare 44c4dfe8 .. 244ed811

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.561=0.000
σ0.048-0.046=0.002
min70.539-70.533=0.007
max70.696-70.688=0.008
mean415.000
σ0.000
min415.000
max415.000
mean0.155-0.152=0.003
σ0.005-0.012=-0.007
min0.150-0.128=0.023
max0.163-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.288=0.001
σ0.002-0.003=-0.001
min21.286-21.280=0.006
max21.292-21.291=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.001
min0.061-0.058=0.003
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.373=0.196
σ0.362-0.363=-0.001
min1753.001-1752.798=0.203
max1754.149-1753.960=0.189
mean1655.250-1653.600=1.650
σ637.120-646.055=-8.936
min631.000-632.000=-1.000
max2847.000-2897.000=-50.000
mean2.809-2.733=0.076
σ0.182-0.212=-0.030
min2.359-2.303=0.056
max3.060-2.951=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-271.756=0.260
σ0.005-0.006=-0.002
min272.010-271.750=0.260
max272.023-271.766=0.257
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean0.388-0.384=0.004
σ0.011-0.010=0.001
min0.377-0.376=0.001
max0.404-0.397=0.006
iters=5
new-facts=1
prior-facts=6402
mean1792.204-1932.172=-139.968
σ313.584-0.006=313.578
min1231.247-1932.165=-700.918
max1932.476-1932.182=0.294
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean2.714-2.992=-0.277
σ0.585-0.130=0.454
min1.705-2.792=-1.087
max3.125-3.121=0.004
iters=5
new-facts=6402
prior-facts=1
mean4752.919-4752.793=0.126
σ0.361-0.920=-0.559
min4752.644-4752.019=0.625
max4753.541-4754.390=-0.849
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean8.670-8.428=0.242
σ0.362-0.349=0.013
min8.240-7.995=0.245
max9.154-8.827=0.327
iters=5
new-facts=6402
prior-facts=6402
mean4943.559-4943.377=0.182
σ0.172-0.016=0.156
min4943.254-4943.360=-0.106
max4943.660-4943.397=0.263
mean2975.400-3068.000=-92.600
σ168.643-184.957=-16.314
min2847.000-2897.000=-50.000
max3259.000-3344.000=-85.000
mean8.558-8.540=0.018
σ0.135-0.161=-0.026
min8.393-8.370=0.023
max8.695-8.787=-0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.999=0.026
σ0.137-0.137=-0.001
min0.934-0.934=-0.000
max1.248-1.244=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.083-472.852=0.231
σ575.915-575.916=-0.002
min185.119-184.887=0.232
max1336.956-1336.727=0.229
mean88.250
σ8.500
min84.000
max101.000
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean0.495-0.448=0.046
σ0.386-0.305=0.081
min0.299-0.294=0.006
max1.074-0.906=0.168
policies=20
mean1851.466-1849.221=2.244
σ0.376-0.372=0.004
min1851.181-1848.942=2.239
max1852.012-1849.761=2.251
mean840.000
σ0.000
min840.000
max840.000
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean2.944-2.953=-0.009
σ0.009-0.011=-0.001
min2.934-2.940=-0.006
max2.953-2.963=-0.009
policies=200
mean18521.154-18498.620=22.533
σ0.338-0.489=-0.151
min18520.917-18498.244=22.672
max18521.651-18499.307=22.344
mean8400.000
σ0.000
min8400.000
max8400.000
mean2847.000-2897.000=-50.000
σ0.000
min2847.000-2897.000=-50.000
max2847.000-2897.000=-50.000
mean29.266-29.232=0.033
σ0.425-0.455=-0.030
min28.915-28.831=0.084
max29.800-29.715=0.085