Compare commits

Home / Compare 10827dbe .. b016cd36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.001
σ0.053-0.056=-0.003
min35.589-35.585=0.004
max35.767-35.775=-0.008
mean415.600-415.000=0.600
σ0.516-0.000=0.516
min415.000
max416.000-415.000=1.000
mean0.086-0.084=0.002
σ0.004-0.003=0.000
min0.082-0.081=0.001
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.002-0.003=-0.001
min24.045-24.044=0.001
max24.051-24.054=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.068-0.068=-0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.076-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.000
σ0.364-0.364=0.001
min1755.916-1755.915=0.001
max1757.081-1757.076=0.005
mean1653.900-1652.850=1.050
σ629.168-629.238=-0.071
min619.000-618.000=1.000
max2690.000-2704.000=-14.000
mean2.350-2.338=0.012
σ0.104-0.100=0.004
min2.239-2.201=0.038
max2.652-2.636=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.764=0.002
σ0.048-0.048=-0.000
min324.681-324.678=0.003
max324.793-324.793=-0.000
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean0.427-0.423=0.004
σ0.010-0.001=0.009
min0.420-0.421=-0.001
max0.445-0.425=0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.313=0.004
σ0.020-0.017=0.003
min1985.284-1985.295=-0.011
max1985.332-1985.332=-0.000
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean2.617-2.609=0.008
σ0.079-0.149=-0.070
min2.558-2.453=0.106
max2.733-2.857=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4808.961=0.014
σ7.796-7.742=0.054
min4805.048-4805.018=0.030
max4822.914-4822.801=0.113
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean9.029-8.823=0.205
σ0.132-0.261=-0.130
min8.889-8.495=0.394
max9.234-9.163=0.071
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.626=-0.132
σ0.178-0.025=0.153
min4996.285-4996.598=-0.313
max4996.640-4996.653=-0.012
mean3058.800-2971.000=87.800
σ293.251-234.749=58.502
min2690.000-2704.000=-14.000
max3333.000-3307.000=26.000
mean8.914-8.545=0.369
σ0.415-0.104=0.311
min8.568-8.447=0.122
max9.554-8.714=0.841

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-1.004=-0.053
σ0.057-0.068=-0.011
min0.917-0.916=0.001
max1.050-1.056=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-463.215=-0.000
σ574.773-574.769=0.003
min175.813-175.820=-0.007
max1325.373-1325.369=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean0.564-0.541=0.023
σ0.578-0.534=0.044
min0.272-0.273=-0.001
max1.431-1.341=0.090
policies=20
mean1758.505-1758.503=0.002
σ0.333-0.327=0.006
min1758.295-1758.292=0.003
max1759.001-1758.989=0.012
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean2.717-2.723=-0.006
σ0.012-0.024=-0.012
min2.704-2.698=0.006
max2.729-2.755=-0.026
policies=200
mean17592.116-17591.933=0.182
σ0.421-0.686=-0.265
min17591.847-17591.303=0.544
max17592.744-17592.911=-0.167
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2704.000=-14.000
σ0.000
min2690.000-2704.000=-14.000
max2690.000-2704.000=-14.000
mean27.450-27.379=0.070
σ0.029-0.145=-0.116
min27.432-27.206=0.226
max27.492-27.512=-0.020