Compare commits

Home / Compare 8623b63f .. 3cc8200c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=0.000
σ0.054-0.052=0.002
min35.217-35.222=-0.005
max35.396-35.391=0.005
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.002
min0.082-0.077=0.004
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=-0.000
min23.764-23.763=0.001
max23.774-23.773=0.001
mean412.000-413.700=-1.700
σ0.000-0.483=-0.483
min412.000-413.000=-1.000
max412.000-414.000=-2.000
mean0.067-0.066=0.001
σ0.005-0.005=0.000
min0.061-0.061=-0.001
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.486=-0.014
σ0.364-0.365=-0.001
min1755.896-1755.911=-0.015
max1757.062-1757.070=-0.007
mean1647.700-1638.750=8.950
σ639.664-603.662=36.003
min624.000-651.000=-27.000
max2824.000-2449.000=375.000
mean2.367-2.349=0.018
σ0.145-0.111=0.033
min2.116-2.245=-0.129
max2.794-2.727=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.692-324.707=-0.016
σ0.043-0.045=-0.002
min324.616-324.627=-0.011
max324.720-324.735=-0.015
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean0.424-0.428=-0.004
σ0.005-0.007=-0.003
min0.420-0.424=-0.003
max0.432-0.441=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.241-1985.258=-0.016
σ0.017-0.013=0.004
min1985.217-1985.244=-0.027
max1985.257-1985.272=-0.015
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean2.562-2.692=-0.130
σ0.059-0.136=-0.077
min2.506-2.547=-0.041
max2.657-2.876=-0.219
iters=5
new-facts=6402
prior-facts=1
mean4808.846-4808.663=0.183
σ7.672-7.782=-0.111
min4805.365-4804.760=0.605
max4822.569-4822.568=0.000
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean8.929-8.570=0.359
σ0.147-0.627=-0.479
min8.803-7.878=0.925
max9.154-9.477=-0.323
iters=5
new-facts=6402
prior-facts=6402
mean4996.385-4996.456=-0.071
σ0.161-0.019=0.142
min4996.099-4996.430=-0.331
max4996.478-4996.478=0.000
mean3050.200-2943.200=107.000
σ208.422-446.030=-237.608
min2824.000-2449.000=375.000
max3354.000-3546.000=-192.000
mean8.630-8.504=0.126
σ0.191-0.111=0.080
min8.437-8.431=0.006
max8.888-8.700=0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.576=-0.527
σ0.166-0.246=-0.081
min0.913-1.143=-0.230
max1.321-1.733=-0.412

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.947=0.004
σ574.253-574.250=0.003
min175.815-175.815=-0.001
max1324.331-1324.322=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean0.434-0.544=-0.109
σ0.301-0.549=-0.248
min0.281-0.259=0.021
max0.886-1.367=-0.481
policies=20
mean1758.483-1758.507=-0.024
σ0.354-0.348=0.006
min1758.237-1758.270=-0.033
max1759.006-1759.022=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean2.781-2.706=0.075
σ0.012-0.013=-0.001
min2.771-2.693=0.078
max2.798-2.723=0.075
policies=200
mean17590.983-17592.449=-1.467
σ0.748-0.465=0.283
min17590.085-17592.167=-2.082
max17591.639-17593.144=-1.505
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2449.000=375.000
σ0.000
min2824.000-2449.000=375.000
max2824.000-2449.000=375.000
mean27.854-27.434=0.420
σ0.441-0.162=0.279
min27.405-27.278=0.127
max28.361-27.597=0.764