Compare commits

Home / Compare 442fbbc7 .. c577d308

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.384=0.007
σ0.049-0.048=0.000
min70.359-70.351=0.009
max70.526-70.517=0.009
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.160-0.159=0.001
σ0.004-0.004=0.000
min0.156-0.156=0.000
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.141=0.004
σ0.003-0.003=0.000
min21.141-21.137=0.004
max21.149-21.145=0.004
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.064-0.061=0.003
σ0.002-0.004=-0.002
min0.062-0.056=0.007
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.361-0.360=0.001
min1751.827-1751.825=0.002
max1752.989-1752.980=0.009
mean1654.800-1655.800=-1.000
σ629.221-642.431=-13.210
min617.000-627.000=-10.000
max2771.000-2774.000=-3.000
mean2.842-2.843=-0.001
σ0.153-0.204=-0.050
min2.511-2.172=0.339
max3.117-3.171=-0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.142=-0.002
σ0.009-0.009=-0.000
min270.128-270.129=-0.000
max270.151-270.153=-0.002
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean0.378-0.376=0.002
σ0.005-0.006=-0.001
min0.372-0.368=0.004
max0.384-0.383=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.592=0.017
σ0.008-0.022=-0.014
min1930.598-1930.563=0.034
max1930.619-1930.620=-0.001
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean2.517-2.569=-0.052
σ0.102-0.142=-0.040
min2.450-2.460=-0.009
max2.691-2.815=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4751.318-4751.276=0.041
σ0.908-0.891=0.017
min4750.802-4750.772=0.030
max4752.933-4752.863=0.070
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean8.477-8.544=-0.066
σ0.526-0.610=-0.084
min7.614-7.625=-0.011
max9.000-9.048=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean4941.695-4941.763=-0.068
σ0.154-0.028=0.125
min4941.423-4941.737=-0.314
max4941.785-4941.794=-0.009
mean3014.000-3025.200=-11.200
σ236.541-227.509=9.032
min2771.000-2774.000=-3.000
max3328.000-3323.000=5.000
mean8.626-8.491=0.134
σ0.245-0.193=0.053
min8.394-8.230=0.164
max9.009-8.698=0.311

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.088-1.105=-0.017
σ0.142-0.261=-0.119
min0.934-0.925=0.009
max1.322-1.498=-0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.375-466.379=-0.003
σ575.936-575.938=-0.002
min178.401-178.401=0.000
max1330.280-1330.286=-0.006
mean84.250
σ8.500
min80.000
max97.000
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean0.440-0.442=-0.001
σ0.304-0.298=0.006
min0.284-0.286=-0.001
max0.897-0.889=0.008
policies=20
mean1784.323-1784.358=-0.035
σ0.316-0.368=-0.052
min1784.104-1784.108=-0.004
max1784.782-1784.901=-0.119
mean800.000
σ0.000
min800.000
max800.000
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean2.824-2.873=-0.049
σ0.089-0.114=-0.025
min2.756-2.765=-0.009
max2.954-2.983=-0.028
policies=200
mean17849.642-17849.644=-0.002
σ0.512-0.621=-0.108
min17849.353-17849.226=0.127
max17850.409-17850.558=-0.149
mean8000.000
σ0.000
min8000.000
max8000.000
mean2771.000-2774.000=-3.000
σ0.000
min2771.000-2774.000=-3.000
max2771.000-2774.000=-3.000
mean27.990-27.784=0.206
σ0.198-0.151=0.047
min27.843-27.688=0.156
max28.283-28.007=0.275