Compare commits

Home / Compare 96336a92 .. e034dc24

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.283-35.283=-0.000
σ0.053-0.053=0.000
min35.256-35.256=-0.000
max35.433-35.433=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.083-0.082=0.002
σ0.005-0.005=0.000
min0.077-0.076=0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.785-23.786=-0.001
σ0.003-0.003=-0.001
min23.782-23.779=0.003
max23.790-23.791=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.069-0.069=0.000
σ0.004-0.003=0.001
min0.066-0.066=-0.001
max0.077-0.076=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.486=0.003
σ0.366-0.364=0.003
min1755.916-1755.915=0.001
max1757.073-1757.057=0.015
mean1655.000-1657.050=-2.050
σ637.947-641.879=-3.932
min628.000-627.000=1.000
max2786.000-2789.000=-3.000
mean2.321-2.369=-0.049
σ0.103-0.119=-0.016
min2.097-2.248=-0.152
max2.579-2.618=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.718=-0.006
σ0.055-0.034=0.021
min324.614-324.659=-0.045
max324.744-324.746=-0.002
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean0.430-0.426=0.004
σ0.011-0.009=0.002
min0.421-0.419=0.002
max0.443-0.442=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.264=0.000
σ0.012-0.010=0.002
min1985.247-1985.251=-0.003
max1985.276-1985.277=-0.001
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean2.543-2.733=-0.190
σ0.076-0.128=-0.053
min2.438-2.566=-0.128
max2.651-2.903=-0.252
iters=5
new-facts=6402
prior-facts=1
mean4808.785-4808.866=-0.080
σ7.785-7.644=0.141
min4804.799-4805.393=-0.594
max4822.701-4822.540=0.161
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean8.779-8.732=0.046
σ0.640-0.190=0.449
min7.716-8.516=-0.800
max9.429-8.974=0.455
iters=5
new-facts=6402
prior-facts=6402
mean4996.468-4996.482=-0.014
σ0.020-0.022=-0.002
min4996.445-4996.455=-0.011
max4996.489-4996.505=-0.016
mean3063.000-3019.200=43.800
σ246.631-235.245=11.386
min2786.000-2789.000=-3.000
max3419.000-3259.000=160.000
mean8.714-8.857=-0.143
σ0.208-0.270=-0.062
min8.479-8.577=-0.098
max8.945-9.202=-0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.970-1.054=-0.084
σ0.067-0.239=-0.172
min0.914-0.913=0.001
max1.044-1.470=-0.427

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.960=-0.009
σ574.250-574.250=0.000
min175.818-175.825=-0.007
max1324.326-1324.335=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean0.430-0.407=0.023
σ0.298-0.258=0.040
min0.277-0.276=0.001
max0.876-0.793=0.083
policies=20
mean1758.621-1758.601=0.020
σ0.416-0.375=0.042
min1758.338-1758.347=-0.009
max1759.238-1759.156=0.082
mean820.000
σ0.000
min820.000
max820.000
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean2.823-2.792=0.031
σ0.061-0.083=-0.022
min2.786-2.711=0.075
max2.914-2.907=0.007
policies=200
mean17592.670-17592.580=0.091
σ0.418-0.621=-0.203
min17592.439-17592.160=0.279
max17593.296-17593.501=-0.204
mean8200.000
σ0.000
min8200.000
max8200.000
mean2786.000-2789.000=-3.000
σ0.000
min2786.000-2789.000=-3.000
max2786.000-2789.000=-3.000
mean27.317-27.365=-0.048
σ0.101-0.147=-0.046
min27.167-27.251=-0.084
max27.389-27.565=-0.177