Compare commits

Home / Compare 360f79cd .. 14a4d6fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.701=0.005
σ0.045-0.046=-0.001
min70.676-70.670=0.007
max70.832-70.828=0.003
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.176-0.159=0.016
σ0.009-0.003=0.006
min0.158-0.156=0.002
max0.185-0.165=0.020
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.000
σ0.003-0.003=-0.000
min21.404-21.405=-0.002
max21.413-21.414=-0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.066-0.065=0.001
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.931=0.001
σ0.361-0.362=-0.001
min1754.357-1754.355=0.002
max1755.518-1755.517=0.001
mean1647.050-1664.800=-17.750
σ632.385-618.766=13.619
min622.000
max2769.000-2493.000=276.000
mean2.911-2.809=0.102
σ0.148-0.135=0.013
min2.778-2.485=0.293
max3.360-2.996=0.364

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.792=0.000
σ0.006-0.005=0.000
min272.784-272.787=-0.002
max272.798-272.798=-0.000
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean0.381-0.379=0.003
σ0.005-0.002=0.003
min0.377-0.377=0.000
max0.390-0.382=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.226-1933.217=0.009
σ0.007-0.014=-0.007
min1933.214-1933.195=0.019
max1933.233-1933.230=0.003
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean3.019-3.084=-0.065
σ0.129-0.089=0.040
min2.842-3.029=-0.188
max3.204-3.239=-0.035
iters=5
new-facts=6402
prior-facts=1
mean4756.860-4756.868=-0.008
σ7.669-7.592=0.077
min4752.954-4753.098=-0.144
max4770.569-4770.444=0.125
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean8.378-8.343=0.035
σ0.556-0.318=0.238
min7.771-7.967=-0.195
max8.925-8.679=0.246
iters=5
new-facts=6402
prior-facts=6402
mean4944.455-4944.448=0.007
σ0.014-0.022=-0.008
min4944.442-4944.420=0.022
max4944.473-4944.470=0.003
mean3002.400-2976.600=25.800
σ298.001-398.977=-100.976
min2769.000-2493.000=276.000
max3471.000-3521.000=-50.000
mean8.382-8.393=-0.011
σ0.039-0.137=-0.098
min8.355-8.285=0.070
max8.445-8.630=-0.185

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.639=-0.608
σ0.132-0.234=-0.102
min0.912-1.227=-0.315
max1.234-1.812=-0.578

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.322-468.303=0.019
σ574.228-574.229=-0.001
min181.204-181.185=0.019
max1329.664-1329.646=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean0.442-0.534=-0.091
σ0.304-0.504=-0.200
min0.288-0.281=0.007
max0.898-1.289=-0.391
policies=20
mean1812.352-1812.172=0.180
σ0.394-0.385=0.009
min1812.071-1811.924=0.148
max1812.929-1812.743=0.185
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean2.899-2.805=0.094
σ0.019-0.027=-0.008
min2.884-2.778=0.106
max2.926-2.837=0.089
policies=200
mean18128.942-18128.957=-0.015
σ0.376-0.588=-0.212
min18128.544-18128.442=0.102
max18129.440-18129.804=-0.365
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2493.000=276.000
σ0.000
min2769.000-2493.000=276.000
max2769.000-2493.000=276.000
mean28.487-28.323=0.164
σ0.103-0.073=0.029
min28.406-28.264=0.142
max28.634-28.420=0.215