Compare commits

Home / Compare 13258337 .. afcec8df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.704-70.700=0.003
σ0.047-0.047=-0.000
min70.671-70.673=-0.002
max70.833-70.832=0.001
mean413.100-415.000=-1.900
σ0.316-0.000=0.316
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.163-0.152=0.011
σ0.004-0.011=-0.007
min0.158-0.126=0.033
max0.169-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.408-21.407=0.001
σ0.003-0.001=0.002
min21.402-21.405=-0.003
max21.411-21.409=0.002
mean414.000-415.800=-1.800
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.063-0.053=0.010
σ0.003-0.004=-0.001
min0.060-0.050=0.010
max0.068-0.061=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.932=-0.002
σ0.361-0.363=-0.002
min1754.355-1754.367=-0.012
max1755.497-1755.529=-0.032
mean1647.150-1667.500=-20.350
σ632.688-620.926=11.762
min623.000-625.000=-2.000
max2773.000-2504.000=269.000
mean2.751-2.795=-0.044
σ0.241-0.186=0.055
min2.142-2.178=-0.036
max3.016-3.034=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.756=0.001
σ0.007-0.008=-0.001
min272.748-272.744=0.004
max272.765-272.766=-0.001
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean0.381-0.383=-0.002
σ0.008-0.010=-0.002
min0.377-0.371=0.007
max0.395-0.397=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1933.158=0.002
σ0.015-0.017=-0.002
min1933.146-1933.130=0.016
max1933.176-1933.177=-0.000
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean3.057-3.070=-0.013
σ0.051-0.214=-0.163
min3.008-2.771=0.237
max3.123-3.373=-0.250
iters=5
new-facts=6402
prior-facts=1
mean4756.922-4756.813=0.108
σ7.579-7.653=-0.074
min4753.391-4753.000=0.391
max4770.477-4770.497=-0.020
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean8.742-8.513=0.229
σ0.432-0.427=0.005
min8.340-7.843=0.497
max9.459-9.034=0.425
iters=5
new-facts=6402
prior-facts=6402
mean4944.322-4944.398=-0.075
σ0.164-0.025=0.139
min4944.031-4944.363=-0.332
max4944.409-4944.423=-0.014
mean2996.800-2961.400=35.400
σ282.298-402.498=-120.200
min2773.000-2504.000=269.000
max3420.000-3479.000=-59.000
mean8.442-8.495=-0.053
σ0.096-0.086=0.010
min8.302-8.408=-0.106
max8.549-8.616=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.122-1.620=-0.498
σ0.248-0.274=-0.026
min0.918-1.223=-0.305
max1.504-1.842=-0.339

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.341-468.319=0.021
σ574.255-574.258=-0.002
min181.205-181.187=0.018
max1329.724-1329.706=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean0.442-0.560=-0.118
σ0.301-0.548=-0.246
min0.286-0.285=0.002
max0.894-1.382=-0.488
policies=20
mean1812.353-1812.181=0.172
σ0.393-0.386=0.006
min1812.083-1811.932=0.152
max1812.932-1812.753=0.178
mean840.000
σ0.000
min840.000
max840.000
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean2.894-2.825=0.068
σ0.012-0.010=0.002
min2.884-2.812=0.072
max2.911-2.836=0.075
policies=200
mean18128.941-18128.905=0.036
σ0.397-0.629=-0.232
min18128.565-18128.495=0.071
max18129.472-18129.842=-0.370
mean8400.000
σ0.000
min8400.000
max8400.000
mean2773.000-2504.000=269.000
σ0.000
min2773.000-2504.000=269.000
max2773.000-2504.000=269.000
mean28.461-28.423=0.039
σ0.253-0.009=0.244
min28.284-28.415=-0.131
max28.832-28.435=0.398