Compare commits

Home / Compare 1e0f03c5 .. 9a15e775

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.567=-0.005
σ0.045-0.046=-0.001
min70.539-70.532=0.007
max70.688-70.691=-0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.160=-0.001
σ0.004-0.004=0.000
min0.152-0.154=-0.002
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.287=0.004
σ0.011-0.003=0.007
min21.283-21.281=0.002
max21.320-21.292=0.029
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.062-0.062=-0.000
σ0.003-0.003=0.000
min0.058-0.059=-0.000
max0.068-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.568=-0.000
σ0.358-0.360=-0.001
min1753.001-1753.002=-0.002
max1754.132-1754.153=-0.021
mean1658.150-1666.900=-8.750
σ634.969-646.692=-11.723
min642.000-688.000=-46.000
max2855.000-2773.000=82.000
mean2.843-2.829=0.014
σ0.198-0.140=0.058
min2.334-2.428=-0.094
max3.268-3.007=0.261

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.014=0.005
σ0.006-0.009=-0.002
min272.013-272.000=0.012
max272.030-272.022=0.008
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean0.393-0.387=0.006
σ0.013-0.008=0.005
min0.377-0.377=0.000
max0.413-0.395=0.018
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.433=0.004
σ0.004-0.007=-0.003
min1932.433-1932.426=0.006
max1932.444-1932.444=0.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean3.118-3.054=0.063
σ0.133-0.198=-0.065
min3.002-2.931=0.071
max3.327-3.406=-0.079
iters=5
new-facts=6402
prior-facts=1
mean4753.200-4753.213=-0.013
σ0.880-0.839=0.041
min4752.665-4752.760=-0.095
max4754.758-4754.708=0.050
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean8.302-8.211=0.090
σ0.680-0.390=0.290
min7.641-7.735=-0.095
max9.161-8.703=0.457
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.554=0.003
σ0.162-0.151=0.011
min4943.270-4943.285=-0.015
max4943.656-4943.629=0.027
mean3084.000-3053.800=30.200
σ260.905-340.625=-79.720
min2855.000-2773.000=82.000
max3446.000-3565.000=-119.000
mean8.451-8.455=-0.003
σ0.149-0.120=0.029
min8.344-8.362=-0.018
max8.711-8.661=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.066-1.045=0.022
σ0.229-0.129=0.100
min0.931-0.931=-0.001
max1.463-1.247=0.217

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.091=-0.009
σ575.913-575.948=-0.034
min185.118-185.112=0.006
max1336.952-1337.013=-0.061
mean88.250
σ8.500
min84.000
max101.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean0.496-0.556=-0.060
σ0.374-0.547=-0.173
min0.309-0.268=0.040
max1.057-1.376=-0.319
policies=20
mean1851.474-1851.425=0.049
σ0.364-0.385=-0.021
min1851.214-1851.159=0.055
max1852.005-1851.994=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean2.952-2.855=0.097
σ0.010-0.015=-0.005
min2.943-2.842=0.101
max2.964-2.875=0.089
policies=200
mean18521.072-18521.043=0.030
σ0.517-0.425=0.092
min18520.701-18520.728=-0.026
max18521.810-18521.667=0.143
mean8400.000
σ0.000
min8400.000
max8400.000
mean2855.000-2773.000=82.000
σ0.000
min2855.000-2773.000=82.000
max2855.000-2773.000=82.000
mean29.263-28.892=0.370
σ0.401-0.129=0.272
min28.915-28.790=0.125
max29.617-29.080=0.537