Compare commits

Home / Compare b931db50 .. 43339168

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.568=-0.005
σ0.045-0.048=-0.002
min70.541-70.545=-0.005
max70.690-70.700=-0.010
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.159=0.000
σ0.002-0.003=-0.001
min0.157-0.155=0.002
max0.163-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.004
σ0.010-0.003=0.007
min21.286-21.283=0.003
max21.319-21.291=0.028
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.063=0.001
σ0.003-0.003=0.000
min0.059-0.058=0.000
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.001
σ0.361-0.361=0.000
min1753.000-1752.998=0.003
max1754.167-1754.150=0.017
mean1640.750-1652.650=-11.900
σ601.480-625.772=-24.293
min643.000-623.000=20.000
max2425.000-2849.000=-424.000
mean2.789-2.833=-0.044
σ0.169-0.067=0.101
min2.342-2.716=-0.374
max3.119-2.953=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.017=-0.000
σ0.011-0.007=0.003
min272.002-272.010=-0.008
max272.031-272.027=0.005
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean0.399-0.389=0.011
σ0.017-0.011=0.007
min0.378-0.377=0.001
max0.418-0.403=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.435=0.001
σ0.005-0.006=-0.001
min1932.429-1932.426=0.003
max1932.440-1932.441=-0.001
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean2.908-3.023=-0.116
σ0.125-0.112=0.013
min2.767-2.907=-0.140
max3.038-3.206=-0.167
iters=5
new-facts=6402
prior-facts=1
mean4752.930-4753.174=-0.244
σ0.360-0.835=-0.475
min4752.678-4752.725=-0.047
max4753.559-4754.661=-1.102
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean8.641-8.451=0.189
σ0.272-0.439=-0.167
min8.294-7.866=0.427
max8.988-8.938=0.050
iters=5
new-facts=6402
prior-facts=6402
mean4943.633-4943.626=0.006
σ0.015-0.022=-0.007
min4943.619-4943.614=0.006
max4943.652-4943.665=-0.013
mean2996.000-3050.800=-54.800
σ264.791-210.010=54.781
min2632.000-2849.000=-217.000
max3299.000-3350.000=-51.000
mean8.457-8.576=-0.120
σ0.231-0.201=0.030
min8.157-8.407=-0.250
max8.764-8.919=-0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.836-1.037=0.799
σ0.074-0.154=-0.080
min1.732-0.940=0.793
max1.909-1.295=0.613

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.071-473.080=-0.009
σ575.910-575.915=-0.006
min185.112-185.112=0.000
max1336.935-1336.953=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean0.561-0.486=0.076
σ0.540-0.377=0.163
min0.290-0.295=-0.005
max1.372-1.052=0.320
policies=20
mean1851.426-1851.458=-0.032
σ0.369-0.375=-0.006
min1851.173-1851.160=0.012
max1851.970-1851.999=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean2.865-2.948=-0.083
σ0.022-0.002=0.020
min2.840-2.945=-0.105
max2.894-2.950=-0.056
policies=200
mean18521.090-18521.091=-0.001
σ0.340-0.462=-0.121
min18520.894-18520.686=0.208
max18521.600-18521.734=-0.135
mean8400.000
σ0.000
min8400.000
max8400.000
mean2425.000-2849.000=-424.000
σ0.000
min2425.000-2849.000=-424.000
max2425.000-2849.000=-424.000
mean28.947-29.233=-0.286
σ0.066-0.541=-0.474
min28.865-28.756=0.109
max29.020-29.757=-0.737