Compare commits

Home / Compare fe91b6ad .. bc9bf6ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.054-0.053=0.001
min35.207-35.219=-0.012
max35.395-35.394=0.002
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.085-0.082=0.003
σ0.003-0.003=-0.000
min0.082-0.076=0.006
max0.092-0.085=0.007
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.003-0.003=0.000
min23.764-23.765=-0.001
max23.774-23.775=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.067=-0.004
σ0.004-0.004=0.000
min0.060-0.061=-0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.349-1756.347=0.002
σ0.367-0.365=0.002
min1755.770-1755.771=-0.000
max1756.941-1756.940=0.001
mean1643.650-1644.400=-0.750
σ629.437-632.345=-2.908
min654.000-627.000=27.000
max2839.000-2841.000=-2.000
mean2.329-2.333=-0.003
σ0.091-0.092=-0.000
min2.219-2.251=-0.032
max2.634-2.579=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.572-324.566=0.006
σ0.042-0.048=-0.006
min324.497-324.480=0.017
max324.596-324.595=0.002
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean0.422-0.428=-0.006
σ0.001-0.011=-0.010
min0.421-0.421=0.000
max0.424-0.448=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.131-1985.125=0.007
σ0.010-0.007=0.003
min1985.116-1985.116=0.000
max1985.145-1985.135=0.009
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean2.613-2.717=-0.104
σ0.081-0.185=-0.103
min2.554-2.552=0.001
max2.739-2.953=-0.214
iters=5
new-facts=6402
prior-facts=1
mean4808.735-4808.536=0.199
σ7.662-7.859=-0.197
min4805.263-4804.646=0.617
max4822.442-4822.587=-0.145
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean8.908-8.643=0.265
σ0.414-0.815=-0.401
min8.380-7.748=0.632
max9.520-9.567=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean4996.316-4996.197=0.119
σ0.029-0.184=-0.156
min4996.270-4995.973=0.298
max4996.342-4996.335=0.007
mean3067.600-3048.200=19.400
σ302.299-274.614=27.685
min2839.000-2841.000=-2.000
max3537.000-3471.000=66.000
mean8.508-8.540=-0.032
σ0.162-0.196=-0.034
min8.374-8.313=0.061
max8.758-8.802=-0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.201=-0.196
σ0.137-0.344=-0.207
min0.913-0.915=-0.002
max1.230-1.637=-0.408

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.952-462.932=0.020
σ574.254-574.262=-0.008
min175.812-175.796=0.016
max1324.332-1324.324=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean0.429-0.470=-0.042
σ0.288-0.373=-0.085
min0.283-0.282=0.001
max0.861-1.030=-0.169
policies=20
mean1758.473-1758.304=0.169
σ0.344-0.355=-0.010
min1758.225-1758.067=0.159
max1758.978-1758.831=0.148
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean2.813-2.772=0.042
σ0.024-0.006=0.018
min2.780-2.764=0.016
max2.830-2.777=0.053
policies=200
mean17590.693-17590.114=0.579
σ0.583-0.479=0.105
min17589.972-17589.689=0.283
max17591.369-17590.801=0.568
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2841.000=-2.000
σ0.000
min2839.000-2841.000=-2.000
max2839.000-2841.000=-2.000
mean27.904-27.799=0.105
σ0.356-0.420=-0.064
min27.603-27.428=0.174
max28.366-28.276=0.090