Compare commits

Home / Compare 92c1dbee .. bdfdb1d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.055-0.053=0.001
min35.237-35.236=0.001
max35.418-35.413=0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.084-0.086=-0.002
σ0.005-0.005=0.001
min0.077-0.082=-0.005
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.003-0.002=0.001
min23.767-23.768=-0.001
max23.776-23.775=0.001
mean413.000-413.700=-0.700
σ0.000-0.483=-0.483
min413.000
max413.000-414.000=-1.000
mean0.068-0.068=-0.000
σ0.004-0.004=-0.000
min0.066-0.066=-0.000
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.473-1756.472=0.000
σ0.366-0.365=0.001
min1755.896-1755.895=0.000
max1757.064-1757.059=0.004
mean1649.900-1656.550=-6.650
σ642.097-607.380=34.716
min625.000-676.000=-51.000
max2840.000-2478.000=362.000
mean2.323-2.312=0.012
σ0.091-0.060=0.031
min2.173-2.239=-0.066
max2.511-2.451=0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.690-324.696=-0.006
σ0.057-0.030=0.027
min324.589-324.643=-0.054
max324.722-324.710=0.012
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean0.429-0.425=0.005
σ0.009-0.001=0.008
min0.425-0.423=0.001
max0.445-0.425=0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.245-1985.253=-0.008
σ0.019-0.016=0.003
min1985.221-1985.234=-0.013
max1985.263-1985.270=-0.008
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean2.645-2.589=0.056
σ0.131-0.072=0.059
min2.543-2.503=0.040
max2.864-2.673=0.191
iters=5
new-facts=6402
prior-facts=1
mean4808.619-4808.753=-0.135
σ7.166-7.728=-0.562
min4805.323-4804.835=0.488
max4821.437-4822.569=-1.132
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean8.633-8.650=-0.017
σ0.447-0.329=0.118
min7.885-8.085=-0.200
max9.045-8.923=0.122
iters=5
new-facts=6402
prior-facts=6402
mean4996.451-4996.402=0.050
σ0.016-0.138=-0.122
min4996.438-4996.156=0.282
max4996.477-4996.475=0.002
mean3003.600-2999.400=4.200
σ186.838-259.506=-72.668
min2840.000-2613.000=227.000
max3296.000-3308.000=-12.000
mean8.596-8.645=-0.049
σ0.137-0.146=-0.009
min8.422-8.501=-0.080
max8.754-8.863=-0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.563=-0.560
σ0.133-0.230=-0.096
min0.911-1.186=-0.274
max1.217-1.762=-0.546

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.953-462.921=0.032
σ574.252-574.248=0.004
min175.814-175.793=0.021
max1324.331-1324.293=0.038
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean0.435-0.545=-0.110
σ0.300-0.538=-0.238
min0.285-0.275=0.010
max0.885-1.352=-0.467
policies=20
mean1758.491-1758.268=0.223
σ0.348-0.346=0.002
min1758.250-1758.026=0.223
max1759.004-1758.779=0.225
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean2.799-2.722=0.077
σ0.003-0.019=-0.016
min2.794-2.703=0.091
max2.802-2.748=0.055
policies=200
mean17591.069-17590.118=0.950
σ0.680-0.423=0.257
min17590.275-17589.741=0.534
max17591.691-17590.722=0.968
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2478.000=362.000
σ0.000
min2840.000-2478.000=362.000
max2840.000-2478.000=362.000
mean27.964-27.497=0.468
σ0.394-0.222=0.172
min27.561-27.302=0.259
max28.465-27.794=0.671