Compare commits

Home / Compare 9e9b9ba9 .. b7864dec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.055-0.054=0.001
min35.234-35.233=0.000
max35.418-35.415=0.003
mean418.000-414.800=3.200
σ0.000-0.422=-0.422
min418.000-414.000=4.000
max418.000-415.000=3.000
mean0.086-0.085=0.001
σ0.005-0.004=0.001
min0.082-0.082=-0.000
max0.092-0.093=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.002=0.001
min23.764-23.767=-0.004
max23.773-23.774=-0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.065-0.069=-0.004
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.075-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.365-0.364=0.001
min1755.914-1755.910=0.004
max1757.078-1757.071=0.007
mean1663.100-1652.350=10.750
σ646.544-639.953=6.590
min631.000-627.000=4.000
max2813.000-2829.000=-16.000
mean2.355-2.380=-0.025
σ0.103-0.145=-0.043
min2.243-2.252=-0.009
max2.635-2.904=-0.270

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.718=-0.009
σ0.042-0.030=0.012
min324.635-324.666=-0.031
max324.730-324.742=-0.012
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean0.425-0.424=0.001
σ0.001-0.003=-0.002
min0.424-0.422=0.002
max0.426-0.429=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.251-1985.253=-0.002
σ0.016-0.016=-0.001
min1985.231-1985.231=-0.000
max1985.265-1985.271=-0.006
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean2.605-2.641=-0.036
σ0.086-0.119=-0.033
min2.530-2.555=-0.025
max2.750-2.830=-0.080
iters=5
new-facts=6402
prior-facts=1
mean4808.865-4808.858=0.007
σ7.692-7.671=0.021
min4805.406-4805.385=0.022
max4822.625-4822.580=0.044
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean8.935-8.828=0.107
σ0.126-0.122=0.004
min8.796-8.650=0.146
max9.061-8.988=0.073
iters=5
new-facts=6402
prior-facts=6402
mean4996.394-4996.459=-0.065
σ0.152-0.025=0.128
min4996.122-4996.421=-0.299
max4996.478-4996.482=-0.005
mean3033.600-3063.400=-29.800
σ215.324-306.458=-91.135
min2813.000-2829.000=-16.000
max3354.000-3537.000=-183.000
mean8.743-8.495=0.248
σ0.171-0.126=0.045
min8.491-8.334=0.157
max8.930-8.682=0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.003=-0.003
σ0.064-0.137=-0.073
min0.918-0.913=0.005
max1.048-1.227=-0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.977=-0.001
σ574.250-574.251=-0.001
min175.838-175.841=-0.003
max1324.351-1324.353=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean0.424-0.431=-0.007
σ0.283-0.297=-0.014
min0.280-0.281=-0.001
max0.849-0.877=-0.028
policies=20
mean1758.716-1758.718=-0.001
σ0.350-0.348=0.002
min1758.481-1758.481=0.000
max1759.235-1759.232=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean2.787-2.789=-0.001
σ0.008-0.014=-0.007
min2.780-2.776=0.004
max2.797-2.809=-0.012
policies=200
mean17592.453-17593.218=-0.765
σ0.426-0.708=-0.283
min17592.001-17592.186=-0.185
max17593.014-17593.692=-0.677
mean8200.000
σ0.000
min8200.000
max8200.000
mean2813.000-2829.000=-16.000
σ0.000
min2813.000-2829.000=-16.000
max2813.000-2829.000=-16.000
mean27.513-27.846=-0.334
σ0.182-0.396=-0.214
min27.355-27.499=-0.144
max27.774-28.281=-0.507