Compare commits

Home / Compare 8eff4f29 .. ccaca8e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=-0.000
σ0.046-0.046=-0.001
min70.674-70.676=-0.002
max70.829-70.831=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.160=0.000
σ0.005-0.004=0.002
min0.152-0.154=-0.003
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.410=-0.001
σ0.003-0.003=-0.000
min21.404-21.406=-0.002
max21.412-21.414=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.065=-0.002
σ0.003-0.003=0.000
min0.059-0.061=-0.001
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.001
σ0.360-0.360=0.001
min1754.363-1754.361=0.002
max1755.514-1755.511=0.003
mean1664.250-1663.500=0.750
σ624.965-619.866=5.099
min623.000-624.000=-1.000
max2521.000-2504.000=17.000
mean2.832-2.831=0.001
σ0.176-0.118=0.057
min2.351-2.425=-0.074
max3.066-2.976=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.790=0.001
σ0.006-0.007=-0.001
min272.781-272.780=0.001
max272.796-272.799=-0.003
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean0.384-0.379=0.006
σ0.010-0.004=0.006
min0.377-0.375=0.001
max0.397-0.386=0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.220-1933.221=-0.002
σ0.012-0.007=0.005
min1933.206-1933.213=-0.008
max1933.231-1933.228=0.002
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean3.116-3.022=0.093
σ0.217-0.116=0.101
min2.783-2.828=-0.045
max3.344-3.134=0.210
iters=5
new-facts=6402
prior-facts=1
mean4756.884-4757.031=-0.148
σ7.641-7.569=0.072
min4753.031-4753.516=-0.485
max4770.544-4770.570=-0.026
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean8.311-8.096=0.216
σ0.446-0.427=0.019
min7.730-7.729=0.001
max8.785-8.743=0.042
iters=5
new-facts=6402
prior-facts=6402
mean4944.381-4944.401=-0.020
σ0.143-0.179=-0.036
min4944.127-4944.086=0.041
max4944.467-4944.530=-0.064
mean2987.400-2942.000=45.400
σ392.958-372.685=20.274
min2521.000-2504.000=17.000
max3525.000-3447.000=78.000
mean8.524-8.631=-0.108
σ0.128-0.254=-0.126
min8.378-8.402=-0.024
max8.721-9.011=-0.290

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.572-1.520=0.051
σ0.223-0.235=-0.013
min1.229-1.228=0.001
max1.845-1.753=0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.306-468.304=0.002
σ574.232-574.230=0.002
min181.180-181.184=-0.003
max1329.654-1329.649=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean0.550-0.559=-0.009
σ0.526-0.546=-0.019
min0.283-0.285=-0.001
max1.339-1.377=-0.038
policies=20
mean1812.161-1812.156=0.004
σ0.386-0.391=-0.005
min1811.912-1811.895=0.017
max1812.734-1812.734=0.000
mean840.000
σ0.000
min840.000
max840.000
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean2.814-2.831=-0.017
σ0.009-0.012=-0.003
min2.806-2.816=-0.010
max2.825-2.841=-0.017
policies=200
mean18128.695-18129.049=-0.354
σ0.619-0.498=0.121
min18128.247-18128.774=-0.526
max18129.598-18129.795=-0.197
mean8400.000
σ0.000
min8400.000
max8400.000
mean2521.000-2504.000=17.000
σ0.000
min2521.000-2504.000=17.000
max2521.000-2504.000=17.000
mean28.320-28.316=0.004
σ0.081-0.065=0.015
min28.239-28.237=0.002
max28.431-28.387=0.044