Compare commits

Home / Compare eb484ffb .. 734da65b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.054-0.054=0.001
min35.590-35.586=0.004
max35.771-35.769=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.083-0.080=0.003
σ0.004-0.004=0.000
min0.076-0.076=-0.001
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.003-0.004=-0.000
min24.042-24.038=0.004
max24.052-24.051=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.066=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.491=-0.001
σ0.365-0.365=-0.000
min1755.915-1755.916=-0.001
max1757.082-1757.079=0.003
mean1654.850-1647.050=7.800
σ645.420-639.374=6.046
min633.000-625.000=8.000
max2846.000-2822.000=24.000
mean2.357-2.328=0.028
σ0.138-0.075=0.063
min2.220-2.221=-0.001
max2.835-2.549=0.286

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.772-324.766=0.006
σ0.036-0.053=-0.017
min324.710-324.671=0.039
max324.804-324.794=0.011
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean0.426-0.431=-0.005
σ0.007-0.010=-0.002
min0.421-0.423=-0.002
max0.439-0.442=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.317=0.001
σ0.013-0.022=-0.008
min1985.308-1985.297=0.011
max1985.339-1985.343=-0.004
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean2.640-2.636=0.004
σ0.125-0.134=-0.009
min2.521-2.518=0.003
max2.824-2.812=0.012
iters=5
new-facts=6402
prior-facts=1
mean4809.078-4809.120=-0.042
σ7.717-7.705=0.012
min4805.576-4805.573=0.003
max4822.883-4822.903=-0.020
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean8.827-8.833=-0.006
σ0.262-0.473=-0.212
min8.434-7.993=0.441
max9.063-9.127=-0.063
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.626=-0.001
σ0.028-0.024=0.004
min4996.592-4996.593=-0.001
max4996.655-4996.653=0.002
mean3044.600-3054.400=-9.800
σ279.267-303.324=-24.057
min2846.000-2822.000=24.000
max3486.000-3520.000=-34.000
mean8.516-8.512=0.004
σ0.143-0.122=0.021
min8.420-8.410=0.010
max8.768-8.723=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-0.978=0.031
σ0.137-0.068=0.069
min0.917-0.921=-0.004
max1.229-1.058=0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.218-463.210=0.007
σ574.770-574.773=-0.003
min175.818-175.814=0.004
max1325.372-1325.369=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean0.432-0.434=-0.002
σ0.296-0.301=-0.006
min0.281-0.280=0.002
max0.875-0.886=-0.010
policies=20
mean1758.528-1758.505=0.022
σ0.350-0.353=-0.004
min1758.292-1758.269=0.022
max1759.045-1759.030=0.015
mean820.000
σ0.000
min820.000
max820.000
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean2.793-2.780=0.014
σ0.011-0.006=0.005
min2.784-2.771=0.014
max2.808-2.783=0.025
policies=200
mean17592.092-17592.135=-0.044
σ0.545-0.487=0.059
min17591.794-17591.828=-0.033
max17592.909-17592.861=0.048
mean8200.000
σ0.000
min8200.000
max8200.000
mean2846.000-2822.000=24.000
σ0.000
min2846.000-2822.000=24.000
max2846.000-2822.000=24.000
mean27.913-27.803=0.111
σ0.390-0.378=0.012
min27.493-27.465=0.028
max28.387-28.224=0.163