Compare commits

Home / Compare 2106b2b1 .. 267ba946

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.696=-0.001
σ0.046-0.045=0.001
min70.668-70.669=-0.002
max70.823-70.821=0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.159-0.158=0.001
σ0.004-0.005=-0.001
min0.151-0.151=0.000
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.419-21.421=-0.001
σ0.003-0.002=0.001
min21.413-21.418=-0.005
max21.422-21.425=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.063=0.001
σ0.003-0.004=-0.001
min0.060-0.059=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.458=-0.001
σ0.358-0.362=-0.004
min1753.885-1753.893=-0.008
max1755.033-1755.044=-0.011
mean1642.850-1659.200=-16.350
σ628.709-629.565=-0.856
min624.000-628.000=-4.000
max2854.000-2676.000=178.000
mean2.828-2.798=0.030
σ0.142-0.183=-0.040
min2.546-2.382=0.164
max3.125-3.073=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-273.501=0.004
σ0.005-0.007=-0.002
min273.500-273.490=0.010
max273.512-273.511=0.001
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean0.388-0.378=0.011
σ0.007-0.004=0.004
min0.381-0.375=0.005
max0.399-0.384=0.015
iters=5
new-facts=1
prior-facts=6402
mean1933.893-1933.897=-0.004
σ0.013-0.015=-0.002
min1933.879-1933.877=0.002
max1933.906-1933.917=-0.011
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean2.988-2.911=0.077
σ0.144-0.131=0.013
min2.738-2.701=0.037
max3.092-3.036=0.056
iters=5
new-facts=6402
prior-facts=1
mean4754.739-4754.390=0.349
σ0.807-1.040=-0.232
min4754.302-4753.570=0.733
max4756.181-4756.151=0.030
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean7.918-8.755=-0.837
σ0.373-0.306=0.068
min7.652-8.385=-0.732
max8.567-9.133=-0.567
iters=5
new-facts=6402
prior-facts=6402
mean4765.021-4945.112=-180.092
σ402.692-0.024=402.668
min4044.663-4945.080=-900.417
max4945.127-4945.139=-0.011
mean3037.600-3000.400=37.200
σ267.201-249.211=17.990
min2854.000-2676.000=178.000
max3466.000-3301.000=165.000
mean8.327-8.578=-0.252
σ0.641-0.133=0.508
min7.278-8.426=-1.147
max8.936-8.791=0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.074=-0.009
σ0.175-0.151=0.024
min0.928-0.917=0.010
max1.355-1.249=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.076-473.065=0.012
σ575.912-575.919=-0.007
min185.111-185.096=0.015
max1336.944-1336.943=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean0.478-0.579=-0.101
σ0.363-0.572=-0.209
min0.292-0.291=0.001
max1.023-1.438=-0.415
policies=20
mean1851.444-1851.263=0.181
σ0.381-0.377=0.004
min1851.150-1851.019=0.131
max1851.995-1851.821=0.175
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean2.950-2.859=0.092
σ0.007-0.007=-0.000
min2.944-2.851=0.093
max2.956-2.867=0.089
policies=200
mean18519.904-18519.359=0.545
σ0.734-0.546=0.189
min18519.314-18518.998=0.316
max18520.853-18520.169=0.685
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2676.000=178.000
σ0.000
min2854.000-2676.000=178.000
max2854.000-2676.000=178.000
mean29.136-28.822=0.314
σ0.405-0.095=0.310
min28.727-28.726=0.002
max29.692-28.950=0.742