Compare commits

Home / Compare b048aa37 .. de2955be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.380=-0.001
σ0.046-0.048=-0.001
min70.350-70.353=-0.003
max70.507-70.513=-0.005
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.154-0.159=-0.005
σ0.004-0.003=0.001
min0.150-0.156=-0.006
max0.160-0.163=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.002=-0.000
min21.141-21.142=-0.001
max21.147-21.148=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.386=0.001
σ0.361-0.359=0.002
min1751.817-1751.819=-0.003
max1752.964-1752.948=0.015
mean1633.600-1627.750=5.850
σ602.339-590.026=12.312
min669.000-625.000=44.000
max2456.000-2415.000=41.000
mean2.794-2.801=-0.006
σ0.163-0.147=0.016
min2.373-2.458=-0.085
max3.044-3.018=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.131-270.127=0.004
σ0.005-0.007=-0.002
min270.125-270.118=0.007
max270.137-270.135=0.002
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean0.378-0.378=-0.000
σ0.007-0.002=0.005
min0.373-0.376=-0.003
max0.390-0.380=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.597-1930.587=0.010
σ0.009-0.019=-0.010
min1930.585-1930.554=0.031
max1930.606-1930.600=0.006
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean2.589-2.532=0.057
σ0.135-0.181=-0.046
min2.465-2.327=0.138
max2.764-2.781=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4751.131-4751.134=-0.003
σ0.803-0.799=0.004
min4750.666-4750.663=0.003
max4752.558-4752.554=0.004
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean8.127-8.133=-0.007
σ0.417-0.357=0.060
min7.704-7.760=-0.056
max8.685-8.577=0.108
iters=5
new-facts=6402
prior-facts=6402
mean4941.527-4941.381=0.146
σ0.081-0.271=-0.190
min4941.453-4940.912=0.541
max4941.623-4941.610=0.013
mean2939.400-2942.800=-3.400
σ428.404-456.713=-28.309
min2456.000-2415.000=41.000
max3511.000-3551.000=-40.000
mean8.418-8.502=-0.084
σ0.151-0.200=-0.050
min8.306-8.314=-0.009
max8.673-8.783=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.799-1.835=-0.036
σ0.048-0.070=-0.022
min1.726-1.741=-0.015
max1.846-1.932=-0.086

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-466.353=-0.001
σ575.922-575.920=0.002
min178.389-178.389=0.000
max1330.235-1330.233=0.002
mean84.000
σ8.000
min80.000
max96.000
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean0.566-0.559=0.007
σ0.567-0.560=0.007
min0.282-0.276=0.006
max1.417-1.399=0.018
policies=20
mean1784.213-1784.227=-0.014
σ0.365-0.359=0.006
min1783.976-1784.000=-0.024
max1784.755-1784.761=-0.005
mean800.000
σ0.000
min800.000
max800.000
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean2.780-2.781=-0.000
σ0.027-0.014=0.013
min2.740-2.762=-0.022
max2.798-2.795=0.002
policies=200
mean17848.932-17848.768=0.164
σ0.458-0.507=-0.049
min17848.635-17848.356=0.279
max17849.615-17849.501=0.114
mean8000.000
σ0.000
min8000.000
max8000.000
mean2456.000-2415.000=41.000
σ0.000
min2456.000-2415.000=41.000
max2456.000-2415.000=41.000
mean27.946-27.910=0.037
σ0.104-0.087=0.018
min27.806-27.785=0.021
max28.058-27.981=0.077