Compare commits

Home / Compare 5ab94a5f .. bfcebad1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.703=-0.001
σ0.048-0.048=0.000
min70.664-70.667=-0.003
max70.834-70.835=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.160-0.162=-0.002
σ0.004-0.004=0.000
min0.153-0.159=-0.006
max0.166-0.170=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.003=0.000
min21.403-21.404=-0.001
max21.413-21.412=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.061=-0.002
max0.067-0.073=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.930=-0.001
σ0.361-0.360=0.001
min1754.364-1754.369=-0.005
max1755.525-1755.513=0.012
mean1664.500-1651.250=13.250
σ620.899-633.106=-12.206
min622.000-613.000=9.000
max2502.000-2871.000=-369.000
mean2.764-2.887=-0.122
σ0.145-0.179=-0.034
min2.324-2.563=-0.239
max3.020-3.402=-0.382

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.752=0.003
σ0.008-0.005=0.002
min272.747-272.743=0.004
max272.764-272.756=0.008
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean0.384-0.383=0.001
σ0.009-0.006=0.003
min0.377-0.378=-0.001
max0.399-0.393=0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.161-1933.161=0.000
σ0.009-0.008=0.001
min1933.147-1933.150=-0.003
max1933.171-1933.169=0.002
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean3.005-3.193=-0.188
σ0.127-0.179=-0.052
min2.789-3.008=-0.219
max3.121-3.476=-0.355
iters=5
new-facts=6402
prior-facts=1
mean4756.741-4756.997=-0.256
σ7.717-7.553=0.164
min4752.313-4753.520=-1.207
max4770.508-4770.508=-0.000
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean8.359-8.128=0.231
σ0.514-0.358=0.156
min7.642-7.752=-0.109
max8.946-8.615=0.330
iters=5
new-facts=6402
prior-facts=6402
mean4944.397-4944.399=-0.002
σ0.018-0.020=-0.002
min4944.374-4944.373=0.001
max4944.418-4944.418=0.000
mean2977.400-3044.000=-66.600
σ279.725-250.571=29.153
min2588.000-2871.000=-283.000
max3307.000-3439.000=-132.000
mean8.560-8.586=-0.026
σ0.114-0.112=0.002
min8.428-8.448=-0.020
max8.710-8.681=0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.524-1.080=0.443
σ0.198-0.224=-0.026
min1.321-0.915=0.406
max1.801-1.462=0.338

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.323-468.349=-0.026
σ574.260-574.269=-0.009
min181.187-181.204=-0.017
max1329.713-1329.753=-0.040
mean88.250
σ8.500
min84.000
max101.000
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean0.570-0.445=0.126
σ0.573-0.296=0.277
min0.281-0.290=-0.008
max1.430-0.888=0.542
policies=20
mean1812.174-1812.369=-0.195
σ0.380-0.392=-0.012
min1811.926-1812.089=-0.162
max1812.736-1812.944=-0.208
mean840.000
σ0.000
min840.000
max840.000
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean2.814-2.881=-0.067
σ0.013-0.008=0.005
min2.799-2.873=-0.074
max2.830-2.887=-0.058
policies=200
mean18129.087-18129.747=-0.659
σ0.516-0.728=-0.213
min18128.799-18128.838=-0.040
max18129.860-18130.495=-0.635
mean8400.000
σ0.000
min8400.000
max8400.000
mean2502.000-2871.000=-369.000
σ0.000
min2502.000-2871.000=-369.000
max2502.000-2871.000=-369.000
mean28.354-28.818=-0.464
σ0.071-0.404=-0.334
min28.294-28.427=-0.133
max28.454-29.234=-0.780