Compare commits

Home / Compare f375f03c .. d67f93f1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.053-0.055=-0.002
min35.590-35.586=0.003
max35.767-35.772=-0.005
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.084-0.083=0.001
σ0.005-0.005=-0.001
min0.077-0.077=-0.000
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=0.000
σ0.003-0.003=-0.000
min24.040-24.041=-0.001
max24.050-24.050=-0.000
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.064-0.066=-0.002
σ0.003-0.004=-0.001
min0.061-0.062=-0.001
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.492=-0.001
σ0.364-0.366=-0.002
min1755.916-1755.914=0.002
max1757.075-1757.081=-0.006
mean1650.750-1643.500=7.250
σ644.690-642.307=2.383
min631.000-645.000=-14.000
max2838.000-2822.000=16.000
mean2.339-2.336=0.003
σ0.079-0.113=-0.035
min2.257-2.071=0.187
max2.488-2.669=-0.181

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.769=-0.008
σ0.055-0.043=0.012
min324.663-324.692=-0.030
max324.791-324.798=-0.007
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean0.428-0.432=-0.004
σ0.008-0.010=-0.003
min0.424-0.424=-0.000
max0.442-0.446=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.318=0.002
σ0.022-0.011=0.010
min1985.290-1985.301=-0.011
max1985.340-1985.327=0.013
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean2.624-2.660=-0.035
σ0.142-0.127=0.015
min2.517-2.513=0.004
max2.864-2.815=0.049
iters=5
new-facts=6402
prior-facts=1
mean4808.991-4808.976=0.015
σ7.752-7.737=0.014
min4805.040-4805.072=-0.032
max4822.848-4822.809=0.039
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean8.748-8.712=0.036
σ0.337-0.484=-0.147
min8.155-7.963=0.192
max8.956-9.264=-0.308
iters=5
new-facts=6402
prior-facts=6402
mean4996.487-4996.554=-0.067
σ0.196-0.154=0.042
min4996.246-4996.280=-0.034
max4996.655-4996.644=0.012
mean3061.800-3001.600=60.200
σ296.069-259.533=36.536
min2838.000-2822.000=16.000
max3517.000-3408.000=109.000
mean8.502-8.477=0.025
σ0.109-0.057=0.052
min8.416-8.422=-0.006
max8.687-8.561=0.126

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-0.950=-0.003
σ0.064-0.056=0.008
min0.896-0.917=-0.021
max1.057-1.049=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.217=-0.012
σ574.767-574.770=-0.003
min175.815-175.821=-0.006
max1325.355-1325.372=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean0.434-0.466=-0.032
σ0.297-0.367=-0.070
min0.280-0.281=-0.001
max0.879-1.016=-0.137
policies=20
mean1758.533-1758.500=0.033
σ0.350-0.341=0.010
min1758.288-1758.292=-0.003
max1759.049-1759.008=0.041
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean2.800-2.781=0.019
σ0.008-0.015=-0.006
min2.789-2.762=0.028
max2.809-2.795=0.014
policies=200
mean17592.078-17592.118=-0.041
σ0.446-0.571=-0.125
min17591.633-17591.804=-0.171
max17592.690-17592.974=-0.285
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2822.000=16.000
σ0.000
min2838.000-2822.000=16.000
max2838.000-2822.000=16.000
mean27.898-27.919=-0.021
σ0.528-0.318=0.210
min27.456-27.567=-0.111
max28.521-28.247=0.274