Compare commits

Home / Compare e885c315 .. a7d9aaef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.056-0.054=0.002
min35.588-35.588=-0.000
max35.775-35.770=0.005
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.085-0.085=0.000
σ0.003-0.003=-0.001
min0.083-0.082=0.001
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.003-0.003=-0.000
min24.043-24.042=0.001
max24.050-24.053=-0.003
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.069-0.064=0.004
σ0.003-0.004=-0.001
min0.066-0.061=0.006
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1718.539=37.952
σ0.365-169.588=-169.223
min1755.916-998.041=757.875
max1757.078-1757.019=0.059
mean1628.500-1631.250=-2.750
σ593.143-607.770=-14.627
min660.000-620.000=40.000
max2426.000-2455.000=-29.000
mean2.338-2.270=0.068
σ0.079-0.225=-0.146
min2.243-1.366=0.877
max2.511-2.435=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.770-324.760=0.010
σ0.042-0.048=-0.006
min324.695-324.675=0.020
max324.794-324.791=0.003
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean0.425-0.425=-0.001
σ0.001-0.004=-0.003
min0.423-0.422=0.001
max0.426-0.433=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.310=0.016
σ0.016-0.023=-0.008
min1985.299-1985.274=0.025
max1985.339-1985.330=0.009
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean2.550-2.712=-0.161
σ0.147-0.282=-0.135
min2.304-2.483=-0.179
max2.689-3.179=-0.490
iters=5
new-facts=6402
prior-facts=1
mean4809.097-4808.996=0.101
σ7.672-7.475=0.197
min4805.618-4805.610=0.008
max4822.821-4822.367=0.453
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean8.960-9.155=-0.196
σ0.152-0.406=-0.254
min8.718-8.831=-0.112
max9.125-9.787=-0.662
iters=5
new-facts=6402
prior-facts=6402
mean4996.623-4996.633=-0.010
σ0.027-0.022=0.005
min4996.582-4996.606=-0.024
max4996.644-4996.655=-0.010
mean2971.800-2989.000=-17.200
σ289.790-312.652=-22.862
min2583.000-2586.000=-3.000
max3322.000-3391.000=-69.000
mean8.620-8.590=0.030
σ0.136-0.092=0.044
min8.482-8.470=0.012
max8.828-8.679=0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.449-1.545=-0.096
σ0.169-0.244=-0.075
min1.227-1.134=0.093
max1.666-1.777=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.206=-0.001
σ574.771-574.775=-0.003
min175.818-175.815=0.003
max1325.363-1325.368=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean0.532-0.538=-0.005
σ0.514-0.546=-0.031
min0.271-0.252=0.019
max1.304-1.356=-0.052
policies=20
mean1758.504-1758.490=0.014
σ0.348-0.338=0.010
min1758.263-1758.252=0.011
max1759.019-1758.990=0.029
mean820.000
σ0.000
min820.000
max820.000
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean2.732-2.698=0.034
σ0.039-0.023=0.016
min2.701-2.672=0.029
max2.789-2.725=0.063
policies=200
mean17592.044-17592.051=-0.006
σ0.627-0.459=0.168
min17591.705-17591.674=0.031
max17592.983-17592.719=0.264
mean8200.000
σ0.000
min8200.000
max8200.000
mean2426.000-2455.000=-29.000
σ0.000
min2426.000-2455.000=-29.000
max2426.000-2455.000=-29.000
mean27.519-27.333=0.186
σ0.216-0.141=0.074
min27.207-27.179=0.028
max27.695-27.497=0.199