Compare commits

Home / Compare 4ab529a7 .. 556cb7f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.049-0.048=0.000
min70.362-70.361=0.002
max70.526-70.524=0.001
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.160-0.160=-0.000
σ0.004-0.003=0.001
min0.153-0.158=-0.005
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.003=-0.001
min21.141-21.141=0.000
max21.148-21.150=-0.003
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.003=0.001
min0.060-0.063=-0.003
max0.070-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.393=0.002
σ0.361-0.362=-0.001
min1751.827-1751.827=-0.000
max1752.981-1752.977=0.004
mean1652.000-1652.600=-0.600
σ618.821-627.386=-8.565
min639.000-615.000=24.000
max2491.000-2769.000=-278.000
mean2.839-2.798=0.041
σ0.115-0.163=-0.048
min2.514-2.356=0.158
max3.153-2.988=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.146-270.140=0.005
σ0.005-0.006=-0.001
min270.141-270.136=0.005
max270.151-270.150=0.001
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean0.379-0.380=-0.002
σ0.002-0.002=-0.000
min0.375-0.378=-0.002
max0.380-0.382=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1930.606=-0.010
σ0.013-0.004=0.009
min1930.579-1930.602=-0.022
max1930.614-1930.611=0.003
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean2.549-2.532=0.017
σ0.088-0.088=0.001
min2.486-2.453=0.033
max2.694-2.680=0.014
iters=5
new-facts=6402
prior-facts=1
mean4751.209-4751.300=-0.091
σ1.032-0.915=0.117
min4750.235-4750.820=-0.585
max4752.966-4752.929=0.038
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean8.570-8.489=0.081
σ0.622-0.588=0.034
min7.610-7.717=-0.107
max9.182-9.017=0.165
iters=5
new-facts=6402
prior-facts=6402
mean4941.772-4941.702=0.070
σ0.016-0.143=-0.127
min4941.757-4941.446=0.310
max4941.789-4941.779=0.010
mean2935.200-3016.400=-81.200
σ306.318-231.103=75.215
min2491.000-2769.000=-278.000
max3306.000-3320.000=-14.000
mean8.489-8.581=-0.091
σ0.063-0.204=-0.141
min8.440-8.408=0.032
max8.590-8.918=-0.327

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.735-1.030=0.705
σ0.173-0.134=0.039
min1.476-0.941=0.535
max1.885-1.251=0.635

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.366-466.369=-0.003
σ575.919-575.919=-0.000
min178.403-178.399=0.004
max1330.245-1330.248=-0.003
mean84.000
σ8.000
min80.000
max96.000
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean0.564-0.446=0.118
σ0.564-0.308=0.256
min0.279-0.289=-0.009
max1.410-0.908=0.503
policies=20
mean1784.317-1784.306=0.012
σ0.354-0.333=0.021
min1784.092-1784.059=0.033
max1784.844-1784.787=0.057
mean800.000
σ0.000
min800.000
max800.000
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean2.782-2.839=-0.056
σ0.015-0.093=-0.078
min2.766-2.782=-0.017
max2.800-2.976=-0.177
policies=200
mean17849.869-17849.641=0.227
σ0.452-0.532=-0.080
min17849.614-17849.271=0.343
max17850.545-17850.412=0.133
mean8000.000
σ0.000
min8000.000
max8000.000
mean2491.000-2769.000=-278.000
σ0.000
min2491.000-2769.000=-278.000
max2491.000-2769.000=-278.000
mean28.001-28.032=-0.031
σ0.105-0.101=0.003
min27.860-27.931=-0.070
max28.083-28.149=-0.066