Compare commits

Home / Compare e8a49393 .. b5ca001a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.245=-0.002
σ0.053-0.053=0.001
min35.217-35.219=-0.002
max35.393-35.393=0.000
mean415.000-415.800=-0.800
σ0.000-0.422=-0.422
min415.000
max415.000-416.000=-1.000
mean0.080-0.086=-0.007
σ0.004-0.003=0.000
min0.076-0.083=-0.007
max0.086-0.092=-0.007
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.003=-0.000
min23.766-23.767=-0.001
max23.776-23.776=0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.069=-0.002
σ0.003-0.003=0.000
min0.061-0.066=-0.005
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.362=0.124
σ0.365-0.364=0.001
min1755.911-1755.789=0.123
max1757.076-1756.946=0.129
mean1632.650-1646.300=-13.650
σ600.076-631.485=-31.409
min653.000-628.000=25.000
max2435.000-2839.000=-404.000
mean2.339-2.348=-0.009
σ0.115-0.100=0.015
min2.199-2.237=-0.038
max2.712-2.568=0.144

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.697-324.581=0.116
σ0.058-0.056=0.001
min324.595-324.480=0.115
max324.732-324.609=0.123
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean0.425-0.430=-0.004
σ0.004-0.011=-0.007
min0.421-0.421=-0.000
max0.433-0.446=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.275-1985.139=0.135
σ0.014-0.016=-0.002
min1985.260-1985.111=0.150
max1985.295-1985.149=0.146
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean2.636-2.716=-0.080
σ0.229-0.144=0.085
min2.440-2.536=-0.095
max3.001-2.851=0.150
iters=5
new-facts=6402
prior-facts=1
mean4808.753-4808.669=0.084
σ7.780-7.401=0.379
min4804.851-4805.206=-0.355
max4822.663-4821.907=0.756
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean8.790-8.726=0.064
σ0.534-0.501=0.033
min7.902-7.920=-0.018
max9.259-9.298=-0.039
iters=5
new-facts=6402
prior-facts=6402
mean4996.393-4996.348=0.046
σ0.151-0.018=0.133
min4996.127-4996.323=-0.196
max4996.488-4996.367=0.121
mean2940.400-3056.400=-116.000
σ447.864-251.539=196.325
min2435.000-2839.000=-404.000
max3542.000-3441.000=101.000
mean8.576-8.498=0.078
σ0.227-0.119=0.108
min8.418-8.407=0.011
max8.919-8.705=0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.691-0.945=0.745
σ0.225-0.057=0.168
min1.295-0.911=0.384
max1.830-1.044=0.786

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.964=-0.017
σ574.245-574.249=-0.004
min175.819-175.833=-0.013
max1324.314-1324.337=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean0.560-0.428=0.133
σ0.570-0.300=0.269
min0.271-0.275=-0.004
max1.414-0.878=0.537
policies=20
mean1758.528-1758.691=-0.163
σ0.358-0.349=0.009
min1758.286-1758.467=-0.181
max1759.059-1759.210=-0.151
mean820.000
σ0.000
min820.000
max820.000
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean2.754-2.765=-0.010
σ0.073-0.005=0.068
min2.703-2.758=-0.055
max2.862-2.771=0.091
policies=200
mean17592.374-17593.249=-0.875
σ0.357-0.677=-0.320
min17592.171-17592.311=-0.140
max17592.907-17593.838=-0.930
mean8200.000
σ0.000
min8200.000
max8200.000
mean2435.000-2839.000=-404.000
σ0.000
min2435.000-2839.000=-404.000
max2435.000-2839.000=-404.000
mean27.433-27.772=-0.339
σ0.138-0.354=-0.216
min27.272-27.465=-0.193
max27.563-28.144=-0.581