Compare commits

Home / Compare 157cf019 .. ed6c66ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=0.000
σ0.045-0.049=-0.003
min70.350-70.350=-0.001
max70.505-70.514=-0.010
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.161-0.161=-0.000
σ0.002-0.003=-0.001
min0.159-0.158=0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.001
σ0.004-0.002=0.001
min21.141-21.142=-0.001
max21.150-21.148=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.387=-0.001
σ0.360-0.361=-0.000
min1751.815-1751.818=-0.003
max1752.954-1752.973=-0.019
mean1635.550-1659.450=-23.900
σ607.844-636.764=-28.920
min635.000-624.000=11.000
max2453.000-2801.000=-348.000
mean2.838-2.820=0.018
σ0.140-0.141=-0.001
min2.478-2.477=0.002
max3.034-2.999=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-270.127=0.001
σ0.008-0.007=0.001
min270.118-270.117=0.001
max270.137-270.134=0.002
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean0.379-0.380=-0.001
σ0.007-0.001=0.006
min0.369-0.379=-0.010
max0.388-0.380=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.596=-0.005
σ0.017-0.009=0.008
min1930.563-1930.582=-0.019
max1930.605-1930.604=0.001
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean2.675-2.511=0.164
σ0.264-0.085=0.180
min2.468-2.451=0.017
max3.116-2.655=0.461
iters=5
new-facts=6402
prior-facts=1
mean4751.016-4750.941=0.075
σ0.611-1.021=-0.410
min4750.648-4749.914=0.735
max4752.093-4752.659=-0.566
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean8.203-8.660=-0.457
σ0.563-0.624=-0.061
min7.680-7.651=0.030
max9.091-9.155=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean4941.454-4941.531=-0.077
σ0.123-0.091=0.032
min4941.265-4941.457=-0.192
max4941.609-4941.631=-0.022
mean2923.800-3053.200=-129.400
σ397.275-226.475=170.801
min2453.000-2801.000=-348.000
max3421.000-3373.000=48.000
mean8.497-8.647=-0.150
σ0.217-0.290=-0.073
min8.282-8.355=-0.074
max8.833-9.052=-0.219

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.863-1.052=0.811
σ0.053-0.130=-0.077
min1.817-0.937=0.880
max1.937-1.257=0.681

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.352-466.354=-0.002
σ575.921-575.921=0.001
min178.389-178.387=0.003
max1330.235-1330.235=-0.001
mean84.000
σ8.000
min80.000
max96.000
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean0.566-0.445=0.121
σ0.566-0.306=0.260
min0.280-0.291=-0.011
max1.415-0.903=0.511
policies=20
mean1784.214-1784.254=-0.040
σ0.367-0.354=0.013
min1783.977-1783.978=-0.001
max1784.761-1784.749=0.012
mean800.000
σ0.000
min800.000
max800.000
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean2.784-2.866=-0.082
σ0.016-0.072=-0.056
min2.764-2.782=-0.018
max2.802-2.958=-0.156
policies=200
mean17848.926-17848.800=0.126
σ0.469-0.581=-0.112
min17848.589-17848.405=0.183
max17849.620-17849.639=-0.018
mean8000.000
σ0.000
min8000.000
max8000.000
mean2453.000-2801.000=-348.000
σ0.000
min2453.000-2801.000=-348.000
max2453.000-2801.000=-348.000
mean28.043-28.039=0.004
σ0.079-0.151=-0.072
min27.931-27.923=0.009
max28.115-28.255=-0.140