Compare commits

Home / Compare 81defb86 .. 72e12ffa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.390=0.001
σ0.046-0.047=-0.001
min70.364-70.361=0.003
max70.518-70.522=-0.003
mean421.000-416.000=5.000
σ0.000
min421.000-416.000=5.000
max421.000-416.000=5.000
mean0.158-0.158=-0.000
σ0.003-0.004=-0.000
min0.152-0.151=0.000
max0.162-0.163=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.003=0.000
min21.141-21.141=-0.000
max21.151-21.149=0.003
mean421.000-416.000=5.000
σ0.000
min421.000-416.000=5.000
max421.000-416.000=5.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.063-0.062=0.000
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.363-0.359=0.004
min1751.824-1751.826=-0.003
max1752.982-1752.980=0.002
mean1664.400-1663.700=0.700
σ633.408-637.727=-4.320
min624.000-622.000=2.000
max2777.000-2778.000=-1.000
mean2.769-2.826=-0.057
σ0.170-0.189=-0.019
min2.405-2.343=0.062
max3.145-3.117=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-270.142=0.004
σ0.008-0.009=-0.000
min270.131-270.130=0.001
max270.153-270.153=-0.001
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean0.379-0.380=-0.002
σ0.005-0.005=0.000
min0.371-0.373=-0.002
max0.385-0.387=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.606=0.001
σ0.009-0.010=-0.001
min1930.593-1930.596=-0.003
max1930.616-1930.617=-0.000
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean2.506-2.547=-0.042
σ0.127-0.116=0.010
min2.358-2.466=-0.108
max2.697-2.747=-0.050
iters=5
new-facts=6402
prior-facts=1
mean4751.376-4751.307=0.069
σ0.813-0.898=-0.085
min4750.922-4750.788=0.134
max4752.827-4752.904=-0.078
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean8.033-8.510=-0.476
σ0.371-0.538=-0.166
min7.665-7.692=-0.027
max8.509-9.099=-0.589
iters=5
new-facts=6402
prior-facts=6402
mean4941.764-4941.771=-0.007
σ0.024-0.020=0.004
min4941.742-4941.741=0.001
max4941.792-4941.793=-0.001
mean3055.400-3021.600=33.800
σ339.447-228.325=111.122
min2777.000-2778.000=-1.000
max3566.000-3323.000=243.000
mean8.425-8.581=-0.156
σ0.114-0.226=-0.112
min8.354-8.375=-0.021
max8.626-8.964=-0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.025=0.022
σ0.125-0.138=-0.013
min0.938-0.933=0.005
max1.244-1.250=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.378=-0.001
σ575.930-575.925=0.004
min178.410-178.407=0.004
max1330.271-1330.266=0.005
mean84.250
σ8.500
min80.000
max97.000
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean0.440-0.440=-0.000
σ0.304-0.300=0.003
min0.285-0.287=-0.002
max0.895-0.891=0.004
policies=20
mean1784.359-1784.371=-0.012
σ0.350-0.363=-0.013
min1784.119-1784.128=-0.010
max1784.877-1784.908=-0.031
mean800.000
σ0.000
min800.000
max800.000
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean2.862-2.842=0.020
σ0.112-0.079=0.033
min2.769-2.766=0.003
max3.009-2.926=0.084
policies=200
mean17849.884-17849.858=0.026
σ0.480-0.452=0.027
min17849.585-17849.610=-0.024
max17850.599-17850.535=0.064
mean8000.000
σ0.000
min8000.000
max8000.000
mean2777.000-2778.000=-1.000
σ0.000
min2777.000-2778.000=-1.000
max2777.000-2778.000=-1.000
mean27.940-27.891=0.049
σ0.087-0.097=-0.011
min27.867-27.764=0.103
max28.066-27.992=0.074