Compare commits

Home / Compare df17e9d1 .. 0483d24f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.384=0.006
σ0.048-0.047=0.000
min70.364-70.352=0.011
max70.523-70.516=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.157-0.160=-0.003
σ0.004-0.004=0.000
min0.151-0.154=-0.003
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.142=0.003
σ0.002-0.002=0.001
min21.142-21.139=0.003
max21.148-21.144=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.064=-0.001
σ0.005-0.002=0.002
min0.058-0.058=-0.000
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.393=-0.000
σ0.363-0.361=0.002
min1751.833-1751.828=0.005
max1752.976-1752.977=-0.001
mean1644.800-1657.900=-13.100
σ605.864-629.322=-23.458
min636.000-618.000=18.000
max2458.000-2774.000=-316.000
mean2.831-2.809=0.022
σ0.168-0.149=0.019
min2.358-2.331=0.028
max3.074-3.008=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.142-270.144=-0.002
σ0.007-0.007=0.000
min270.131-270.134=-0.003
max270.151-270.153=-0.002
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean0.384-0.377=0.007
σ0.014-0.003=0.011
min0.368-0.373=-0.005
max0.399-0.380=0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.597-1930.599=-0.002
σ0.027-0.024=0.002
min1930.564-1930.556=0.009
max1930.620-1930.614=0.006
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean2.541-2.526=0.015
σ0.130-0.062=0.068
min2.430-2.482=-0.052
max2.746-2.633=0.113
iters=5
new-facts=6402
prior-facts=1
mean4751.301-4751.292=0.009
σ0.927-0.910=0.017
min4750.816-4750.762=0.054
max4752.950-4752.912=0.039
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean8.550-8.631=-0.081
σ0.611-0.533=0.078
min7.621-7.784=-0.163
max9.032-9.133=-0.101
iters=5
new-facts=6402
prior-facts=6402
mean4941.769-4941.761=0.008
σ0.022-0.033=-0.011
min4941.738-4941.725=0.013
max4941.791-4941.796=-0.005
mean2965.800-3017.400=-51.600
σ263.636-236.710=26.925
min2609.000-2774.000=-165.000
max3312.000-3331.000=-19.000
mean8.479-8.587=-0.108
σ0.069-0.171=-0.101
min8.376-8.430=-0.054
max8.563-8.845=-0.282

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.752-1.073=0.680
σ0.127-0.096=0.030
min1.636-0.942=0.694
max1.961-1.214=0.746

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.365-466.379=-0.013
σ575.923-575.942=-0.019
min178.399-178.402=-0.004
max1330.250-1330.292=-0.042
mean84.250
σ8.500
min80.000
max97.000
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean0.550-0.442=0.108
σ0.545-0.303=0.242
min0.276-0.286=-0.010
max1.367-0.897=0.470
policies=20
mean1784.291-1784.359=-0.067
σ0.369-0.368=0.001
min1784.049-1784.119=-0.070
max1784.839-1784.903=-0.064
mean800.000
σ0.000
min800.000
max800.000
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean2.768-2.850=-0.082
σ0.012-0.084=-0.071
min2.751-2.783=-0.032
max2.779-2.962=-0.183
policies=200
mean17849.807-17849.641=0.166
σ0.517-0.610=-0.093
min17849.447-17849.225=0.222
max17850.544-17850.542=0.002
mean8000.000
σ0.000
min8000.000
max8000.000
mean2458.000-2774.000=-316.000
σ0.000
min2458.000-2774.000=-316.000
max2458.000-2774.000=-316.000
mean27.927-27.892=0.035
σ0.038-0.031=0.007
min27.890-27.846=0.044
max27.980-27.915=0.065