Compare commits

Home / Compare ca5964a8 .. 8c06f7a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=-0.001
σ0.055-0.053=0.002
min35.239-35.238=0.000
max35.418-35.415=0.004
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.083-0.086=-0.003
σ0.004-0.003=0.001
min0.076-0.083=-0.007
max0.089-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.002-0.002=0.000
min23.766-23.765=0.001
max23.773-23.774=-0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.068-0.068=-0.000
σ0.003-0.003=-0.000
min0.065-0.066=-0.001
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.366-0.365=0.001
min1755.909-1755.910=-0.001
max1757.073-1757.070=0.003
mean1644.050-1649.650=-5.600
σ611.578-639.722=-28.143
min648.000-626.000=22.000
max2467.000-2826.000=-359.000
mean2.334-2.344=-0.011
σ0.076-0.080=-0.003
min2.197-2.206=-0.008
max2.502-2.565=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.701=0.006
σ0.050-0.058=-0.008
min324.620-324.598=0.022
max324.739-324.734=0.005
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean0.427-0.425=0.003
σ0.007-0.001=0.007
min0.422-0.424=-0.002
max0.440-0.426=0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.252-1985.256=-0.004
σ0.023-0.015=0.009
min1985.225-1985.241=-0.016
max1985.278-1985.276=0.002
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean2.605-2.622=-0.017
σ0.119-0.069=0.049
min2.445-2.546=-0.100
max2.741-2.711=0.030
iters=5
new-facts=6402
prior-facts=1
mean4808.882-4808.867=0.014
σ7.676-7.657=0.019
min4805.419-4805.394=0.025
max4822.612-4822.564=0.048
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean8.987-8.938=0.049
σ0.132-0.162=-0.031
min8.803-8.689=0.114
max9.126-9.084=0.042
iters=5
new-facts=6402
prior-facts=6402
mean4996.395-4996.469=-0.074
σ0.158-0.017=0.140
min4996.114-4996.451=-0.337
max4996.484-4996.491=-0.007
mean2903.200-3047.200=-144.000
σ398.718-199.608=199.111
min2467.000-2826.000=-359.000
max3441.000-3335.000=106.000
mean8.463-8.720=-0.257
σ0.064-0.254=-0.190
min8.364-8.506=-0.141
max8.529-9.053=-0.524

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.580-1.025=0.556
σ0.187-0.129=0.058
min1.288-0.909=0.379
max1.730-1.224=0.506

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.968=-0.021
σ574.249-574.253=-0.004
min175.817-175.838=-0.021
max1324.320-1324.347=-0.026
mean86.250
σ8.500
min82.000
max99.000
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean0.584-0.430=0.154
σ0.615-0.300=0.315
min0.273-0.276=-0.003
max1.506-0.879=0.626
policies=20
mean1758.506-1758.717=-0.211
σ0.345-0.349=-0.004
min1758.267-1758.478=-0.212
max1759.016-1759.234=-0.218
mean820.000
σ0.000
min820.000
max820.000
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean2.718-2.789=-0.071
σ0.033-0.023=0.010
min2.688-2.772=-0.084
max2.760-2.822=-0.062
policies=200
mean17592.508-17593.291=-0.783
σ0.512-0.734=-0.222
min17592.201-17592.324=-0.123
max17593.274-17593.902=-0.627
mean8200.000
σ0.000
min8200.000
max8200.000
mean2467.000-2826.000=-359.000
σ0.000
min2467.000-2826.000=-359.000
max2467.000-2826.000=-359.000
mean27.450-27.873=-0.423
σ0.119-0.416=-0.297
min27.356-27.530=-0.175
max27.614-28.382=-0.767