Compare commits

Home / Compare 3befc6a5 .. 71f9eb40

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.000
σ0.053-0.054=-0.001
min35.212-35.208=0.004
max35.393-35.395=-0.002
mean414.000-413.600=0.400
σ0.000-0.516=-0.516
min414.000-413.000=1.000
max414.000
mean0.085-0.082=0.003
σ0.004-0.005=-0.002
min0.082-0.076=0.006
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.001
σ0.003-0.003=0.000
min23.765-23.765=0.000
max23.776-23.773=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.068=-0.000
σ0.003-0.003=0.000
min0.066-0.066=0.000
max0.074-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.363=0.001
σ0.366-0.365=0.001
min1755.787-1755.791=-0.004
max1756.949-1756.943=0.006
mean1627.950-1647.400=-19.450
σ593.085-638.726=-45.641
min642.000-628.000=14.000
max2428.000-2751.000=-323.000
mean2.338-2.366=-0.029
σ0.098-0.122=-0.024
min2.169-2.224=-0.054
max2.616-2.626=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588-324.584=0.004
σ0.040-0.045=-0.005
min324.517-324.504=0.013
max324.613-324.606=0.007
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean0.420-0.425=-0.005
σ0.008-0.003=0.005
min0.406-0.421=-0.015
max0.424-0.428=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.137-1985.143=-0.006
σ0.013-0.010=0.004
min1985.124-1985.128=-0.005
max1985.152-1985.153=-0.001
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean2.608-2.626=-0.018
σ0.103-0.059=0.044
min2.498-2.566=-0.068
max2.771-2.692=0.080
iters=5
new-facts=6402
prior-facts=1
mean4808.627-4808.542=0.085
σ7.731-7.479=0.251
min4804.686-4804.674=0.012
max4822.446-4821.910=0.536
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean8.532-8.701=-0.169
σ0.480-0.570=-0.090
min7.791-7.712=0.079
max8.954-9.126=-0.172
iters=5
new-facts=6402
prior-facts=6402
mean4996.277-4996.345=-0.067
σ0.153-0.016=0.137
min4996.004-4996.322=-0.318
max4996.361-4996.362=-0.001
mean2930.400-3049.800=-119.400
σ420.749-247.255=173.494
min2461.000-2751.000=-290.000
max3497.000-3396.000=101.000
mean8.509-8.706=-0.197
σ0.101-0.145=-0.045
min8.379-8.528=-0.148
max8.654-8.856=-0.202

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.611-0.997=0.614
σ0.114-0.180=-0.065
min1.468-0.905=0.564
max1.732-1.316=0.416

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.946-462.974=-0.028
σ574.245-574.255=-0.009
min175.818-175.839=-0.021
max1324.314-1324.356=-0.042
mean86.250
σ8.500
min82.000
max99.000
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean0.567-0.431=0.136
σ0.582-0.299=0.283
min0.271-0.278=-0.007
max1.440-0.880=0.560
policies=20
mean1758.512-1758.718=-0.207
σ0.351-0.348=0.002
min1758.276-1758.480=-0.203
max1759.031-1759.234=-0.203
mean820.000
σ0.000
min820.000
max820.000
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean2.723-2.826=-0.104
σ0.009-0.063=-0.054
min2.712-2.787=-0.074
max2.734-2.920=-0.185
policies=200
mean17592.321-17592.360=-0.039
σ0.466-0.449=0.017
min17592.066-17592.012=0.054
max17593.020-17593.017=0.002
mean8200.000
σ0.000
min8200.000
max8200.000
mean2428.000-2751.000=-323.000
σ0.000
min2428.000-2751.000=-323.000
max2428.000-2751.000=-323.000
mean27.570-27.403=0.166
σ0.322-0.118=0.204
min27.276-27.275=0.001
max27.985-27.541=0.445