Compare commits

Home / Compare 8a0de1e9 .. fc65ad25

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.225=0.018
σ0.054-0.055=-0.001
min35.208-35.193=0.015
max35.395-35.380=0.015
mean413.600-417.000=-3.400
σ0.516-0.000=0.516
min413.000-417.000=-4.000
max414.000-417.000=-3.000
mean0.082-0.086=-0.004
σ0.005-0.004=0.001
min0.076-0.083=-0.007
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.754=0.015
σ0.003-0.003=-0.000
min23.765-23.750=0.014
max23.773-23.760=0.013
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.068-0.064=0.004
σ0.003-0.004=-0.001
min0.066-0.061=0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.357=0.006
σ0.365-0.367=-0.002
min1755.791-1755.781=0.010
max1756.943-1756.953=-0.011
mean1647.400-1654.250=-6.850
σ638.726-641.952=-3.226
min628.000-630.000=-2.000
max2751.000-2833.000=-82.000
mean2.366-2.354=0.012
σ0.122-0.119=0.003
min2.224-2.203=0.020
max2.626-2.713=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.584-324.593=-0.009
σ0.045-0.019=0.025
min324.504-324.559=-0.055
max324.606-324.604=0.001
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean0.425-0.426=-0.001
σ0.003-0.002=0.001
min0.421-0.423=-0.002
max0.428-0.428=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.143-1985.127=0.016
σ0.010-0.013=-0.004
min1985.128-1985.111=0.017
max1985.153-1985.139=0.013
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean2.626-2.683=-0.057
σ0.059-0.177=-0.119
min2.566-2.526=0.040
max2.692-2.963=-0.271
iters=5
new-facts=6402
prior-facts=1
mean4808.542-4808.730=-0.188
σ7.479-7.674=-0.195
min4804.674-4805.256=-0.582
max4821.910-4822.459=-0.548
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean8.701-8.910=-0.209
σ0.570-0.137=0.433
min7.712-8.737=-1.024
max9.126-9.067=0.059
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4996.328=0.017
σ0.016-0.026=-0.009
min4996.322-4996.293=0.029
max4996.362-4996.358=0.004
mean3049.800-3062.000=-12.200
σ247.255-306.304=-59.048
min2751.000-2833.000=-82.000
max3396.000-3536.000=-140.000
mean8.706-8.585=0.121
σ0.145-0.156=-0.011
min8.528-8.442=0.085
max8.856-8.801=0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.012=-0.015
σ0.180-0.137=0.043
min0.905-0.919=-0.014
max1.316-1.236=0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.974-462.966=0.008
σ574.255-574.253=0.002
min175.839-175.827=0.012
max1324.356-1324.346=0.011
mean86.250
σ8.500
min82.000
max99.000
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean0.431-0.435=-0.003
σ0.299-0.304=-0.005
min0.278-0.280=-0.001
max0.880-0.890=-0.011
policies=20
mean1758.718-1758.617=0.102
σ0.348-0.343=0.005
min1758.480-1758.377=0.102
max1759.234-1759.123=0.111
mean820.000
σ0.000
min820.000
max820.000
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean2.826-2.800=0.027
σ0.063-0.004=0.058
min2.787-2.797=-0.010
max2.920-2.806=0.114
policies=200
mean17592.360-17592.339=0.022
σ0.449-0.657=-0.208
min17592.012-17591.438=0.573
max17593.017-17592.857=0.160
mean8200.000
σ0.000
min8200.000
max8200.000
mean2751.000-2833.000=-82.000
σ0.000
min2751.000-2833.000=-82.000
max2751.000-2833.000=-82.000
mean27.403-27.872=-0.468
σ0.118-0.328=-0.211
min27.275-27.585=-0.309
max27.541-28.207=-0.666