Compare commits

Home / Compare 41001ad7 .. ab9dc1b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.777-70.731=0.046
σ0.047-0.047=-0.001
min70.747-70.701=0.046
max70.907-70.862=0.044
mean412.000-412.300=-0.300
σ0.000-0.483=-0.483
min412.000
max412.000-413.000=-1.000
mean0.161-0.157=0.004
σ0.004-0.005=-0.001
min0.155-0.149=0.005
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.489-21.446=0.044
σ0.002-0.002=0.000
min21.486-21.441=0.045
max21.493-21.448=0.045
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.065=-0.000
σ0.005-0.003=0.002
min0.060-0.063=-0.003
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.258-1757.908=0.350
σ0.360-0.360=0.001
min1757.700-1757.336=0.364
max1758.844-1758.492=0.352
mean1654.300-1668.900=-14.600
σ642.459-652.264=-9.805
min644.000-636.000=8.000
max2846.000-2857.000=-11.000
mean2.899-2.785=0.114
σ0.137-0.199=-0.062
min2.557-2.372=0.185
max3.280-3.109=0.171

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.713-275.387=0.326
σ0.004-0.010=-0.006
min275.709-275.378=0.331
max275.718-275.398=0.319
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean0.391-0.387=0.004
σ0.008-0.004=0.004
min0.384-0.384=0.000
max0.401-0.394=0.007
iters=5
new-facts=1
prior-facts=6402
mean1936.129-1935.782=0.347
σ0.014-0.011=0.003
min1936.107-1935.770=0.336
max1936.145-1935.800=0.345
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean3.026-2.938=0.088
σ0.012-0.249=-0.237
min3.007-2.553=0.454
max3.038-3.185=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4756.805-4756.396=0.409
σ0.921-1.054=-0.134
min4756.010-4755.151=0.859
max4758.396-4758.076=0.320
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean8.375-7.923=0.452
σ0.462-0.363=0.098
min7.616-7.687=-0.071
max8.863-8.568=0.295
iters=5
new-facts=6402
prior-facts=6402
mean4947.281-4946.927=0.354
σ0.161-0.159=0.002
min4946.995-4946.646=0.349
max4947.377-4947.022=0.355
mean3025.000-3085.200=-60.200
σ268.781-306.785=-38.005
min2846.000-2857.000=-11.000
max3461.000-3556.000=-95.000
mean8.424-8.477=-0.053
σ0.051-0.121=-0.070
min8.359-8.399=-0.040
max8.471-8.690=-0.219

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.020=-0.003
σ0.136-0.137=-0.001
min0.930-0.929=0.001
max1.245-1.243=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean478.787-478.088=0.699
σ574.921-574.923=-0.002
min191.318-190.615=0.703
max1341.169-1340.472=0.696
mean90.250
σ8.500
min86.000
max103.000
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean0.460-0.450=0.010
σ0.304-0.302=0.001
min0.306-0.287=0.019
max0.916-0.904=0.012
policies=20
mean1913.455-1906.470=6.985
σ0.397-0.390=0.007
min1913.147-1906.173=6.974
max1914.018-1907.024=6.993
mean860.000
σ0.000
min860.000
max860.000
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean3.067-3.053=0.013
σ0.011-0.008=0.003
min3.054-3.047=0.008
max3.081-3.066=0.015
policies=200
mean19140.974-19070.932=70.042
σ0.441-0.390=0.051
min19140.565-19070.534=70.031
max19141.573-19071.454=70.119
mean8600.000
σ0.000
min8600.000
max8600.000
mean2846.000-2857.000=-11.000
σ0.000
min2846.000-2857.000=-11.000
max2846.000-2857.000=-11.000
mean30.490-30.113=0.377
σ0.564-0.442=0.122
min29.975-29.756=0.218
max31.201-30.760=0.441