Compare commits

Home / Compare c135b59f .. 797aad98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.382=-0.002
σ0.046-0.048=-0.002
min70.352-70.347=0.005
max70.509-70.514=-0.005
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.160-0.161=-0.002
σ0.005-0.003=0.001
min0.152-0.159=-0.007
max0.166-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.004-0.003=0.000
min21.138-21.140=-0.002
max21.150-21.150=0.001
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.388=-0.000
σ0.360-0.364=-0.004
min1751.819-1751.818=0.002
max1752.956-1752.967=-0.011
mean1659.000-1627.550=31.450
σ642.199-589.196=53.004
min629.000-626.000=3.000
max2853.000-2414.000=439.000
mean2.835-2.826=0.009
σ0.078-0.143=-0.065
min2.698-2.312=0.387
max2.959-3.006=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.131-270.131=-0.001
σ0.004-0.004=-0.001
min270.126-270.128=-0.002
max270.135-270.138=-0.003
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean0.380-0.380=0.000
σ0.002-0.001=0.001
min0.378-0.379=-0.000
max0.383-0.381=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.583-1930.598=-0.015
σ0.019-0.012=0.007
min1930.563-1930.582=-0.020
max1930.601-1930.612=-0.011
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean2.629-2.517=0.112
σ0.290-0.137=0.153
min2.457-2.368=0.089
max3.144-2.725=0.418
iters=5
new-facts=6402
prior-facts=1
mean4750.935-4751.069=-0.134
σ0.956-0.850=0.105
min4750.134-4750.547=-0.413
max4752.592-4752.582=0.010
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean8.766-8.465=0.300
σ0.158-0.515=-0.358
min8.568-7.618=0.951
max8.903-8.934=-0.031
iters=5
new-facts=6402
prior-facts=6402
mean4941.536-4941.529=0.007
σ0.082-0.084=-0.002
min4941.471-4941.459=0.012
max4941.627-4941.628=-0.001
mean3048.000-3024.200=23.800
σ199.201-299.401=-100.200
min2853.000-2608.000=245.000
max3324.000-3410.000=-86.000
mean8.592-8.517=0.075
σ0.214-0.127=0.087
min8.376-8.387=-0.011
max8.910-8.685=0.225

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.697=-0.675
σ0.138-0.194=-0.055
min0.927-1.468=-0.541
max1.248-1.990=-0.742

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.353=0.011
σ575.918-575.922=-0.004
min178.395-178.388=0.007
max1330.240-1330.235=0.006
mean84.000
σ8.000
min80.000
max96.000
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean0.441-0.566=-0.125
σ0.303-0.558=-0.256
min0.284-0.276=0.008
max0.895-1.404=-0.509
policies=20
mean1784.270-1784.224=0.047
σ0.363-0.361=0.002
min1784.020-1783.984=0.036
max1784.805-1784.760=0.044
mean800.000
σ0.000
min800.000
max800.000
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean2.856-2.770=0.087
σ0.011-0.010=0.000
min2.841-2.765=0.077
max2.865-2.785=0.080
policies=200
mean17848.943-17848.736=0.206
σ0.477-0.478=-0.000
min17848.593-17848.361=0.232
max17849.648-17849.430=0.219
mean8000.000
σ0.000
min8000.000
max8000.000
mean2853.000-2414.000=439.000
σ0.000
min2853.000-2414.000=439.000
max2853.000-2414.000=439.000
mean28.383-27.911=0.472
σ0.449-0.056=0.393
min27.878-27.843=0.035
max28.833-27.968=0.865