Compare commits

Home / Compare 2511c26f .. da8635a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.055-0.054=0.001
min35.592-35.586=0.006
max35.772-35.769=0.003
mean414.200-414.000=0.200
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.086-0.080=0.006
σ0.003-0.004=-0.001
min0.083-0.076=0.007
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.002-0.004=-0.001
min24.043-24.038=0.005
max24.050-24.051=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.004-0.004=0.000
min0.061-0.061=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.365-0.365=0.000
min1755.914-1755.916=-0.003
max1757.081-1757.079=0.003
mean1649.550-1647.050=2.500
σ640.658-639.374=1.285
min633.000-625.000=8.000
max2828.000-2822.000=6.000
mean2.358-2.328=0.030
σ0.064-0.075=-0.011
min2.287-2.221=0.066
max2.493-2.549=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.766=0.002
σ0.047-0.053=-0.006
min324.686-324.671=0.015
max324.800-324.794=0.007
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean0.431-0.431=0.001
σ0.020-0.010=0.010
min0.421-0.423=-0.002
max0.467-0.442=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.317=-0.004
σ0.021-0.022=-0.001
min1985.286-1985.297=-0.011
max1985.336-1985.343=-0.007
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean2.660-2.636=0.024
σ0.170-0.134=0.037
min2.453-2.518=-0.065
max2.885-2.812=0.073
iters=5
new-facts=6402
prior-facts=1
mean4809.091-4809.120=-0.029
σ7.718-7.705=0.013
min4805.575-4805.573=0.002
max4822.897-4822.903=-0.006
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean8.917-8.833=0.084
σ0.181-0.473=-0.293
min8.598-7.993=0.605
max9.032-9.127=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.626=-0.005
σ0.027-0.024=0.003
min4996.595-4996.593=0.002
max4996.654-4996.653=0.001
mean3067.000-3054.400=12.600
σ310.052-303.324=6.728
min2828.000-2822.000=6.000
max3541.000-3520.000=21.000
mean8.560-8.512=0.048
σ0.116-0.122=-0.006
min8.454-8.410=0.044
max8.746-8.723=0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-0.978=-0.026
σ0.054-0.068=-0.013
min0.922-0.921=0.002
max1.048-1.058=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.210=-0.005
σ574.766-574.773=-0.006
min175.819-175.814=0.005
max1325.355-1325.369=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean0.431-0.434=-0.003
σ0.300-0.301=-0.001
min0.279-0.280=-0.001
max0.880-0.886=-0.005
policies=20
mean1758.534-1758.505=0.029
σ0.353-0.353=-0.001
min1758.301-1758.269=0.032
max1759.058-1759.030=0.027
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean2.784-2.780=0.004
σ0.054-0.006=0.048
min2.725-2.771=-0.046
max2.849-2.783=0.066
policies=200
mean17592.080-17592.135=-0.055
σ0.579-0.487=0.092
min17591.529-17591.828=-0.299
max17592.897-17592.861=0.036
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2822.000=6.000
σ0.000
min2828.000-2822.000=6.000
max2828.000-2822.000=6.000
mean27.910-27.803=0.107
σ0.661-0.378=0.282
min27.283-27.465=-0.182
max28.742-28.224=0.518