Compare commits

Home / Compare 61fbf87c .. cd90d86f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.263=0.355
σ0.054-0.055=-0.000
min35.593-35.233=0.360
max35.771-35.416=0.355
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-23.770=0.278
σ0.002-0.003=-0.000
min24.045-23.767=0.278
max24.052-23.774=0.277
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.068=0.000
σ0.003-0.003=-0.000
min0.066-0.065=0.000
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.470=0.021
σ0.365-0.364=0.000
min1755.917-1755.894=0.023
max1757.080-1757.064=0.016
mean1654.000-1655.100=-1.100
σ641.406-644.146=-2.740
min630.000-627.000=3.000
max2847.000-2845.000=2.000
mean2.365-2.354=0.011
σ0.113-0.120=-0.007
min2.233-2.251=-0.018
max2.624-2.796=-0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.692=0.070
σ0.056-0.047=0.010
min324.662-324.609=0.053
max324.800-324.722=0.078
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean0.432-0.424=0.008
σ0.008-0.002=0.005
min0.422-0.423=-0.001
max0.440-0.429=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.257=0.060
σ0.016-0.006=0.011
min1985.291-1985.248=0.043
max1985.330-1985.263=0.068
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean2.621-2.633=-0.013
σ0.068-0.076=-0.008
min2.551-2.564=-0.013
max2.715-2.716=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4808.731=0.376
σ7.628-7.765=-0.137
min4805.595-4804.823=0.771
max4822.749-4822.614=0.136
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean8.935-8.798=0.137
σ0.456-0.304=0.152
min8.367-8.301=0.067
max9.633-9.014=0.619
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.454=0.175
σ0.023-0.019=0.004
min4996.598-4996.434=0.164
max4996.653-4996.473=0.180
mean3056.600-3039.000=17.600
σ226.085-202.000=24.085
min2847.000-2845.000=2.000
max3393.000-3327.000=66.000
mean8.751-8.642=0.109
σ0.170-0.186=-0.016
min8.496-8.483=0.012
max8.958-8.944=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-1.006=-0.083
σ0.014-0.134=-0.120
min0.912-0.917=-0.006
max0.947-1.222=-0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.954=0.254
σ574.766-574.252=0.514
min175.818-175.814=0.003
max1325.356-1324.332=1.024
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean0.423-0.456=-0.033
σ0.292-0.357=-0.065
min0.271-0.276=-0.006
max0.861-0.992=-0.131
policies=20
mean1758.519-1758.484=0.036
σ0.350-0.345=0.004
min1758.301-1758.253=0.048
max1759.040-1758.996=0.044
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean2.780-2.771=0.009
σ0.007-0.028=-0.021
min2.771-2.736=0.036
max2.788-2.800=-0.012
policies=200
mean17592.188-17591.214=0.973
σ0.486-0.581=-0.095
min17591.867-17590.464=1.403
max17592.911-17591.722=1.188
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2845.000=2.000
σ0.000
min2847.000-2845.000=2.000
max2847.000-2845.000=2.000
mean27.898-27.898=0.001
σ0.342-0.321=0.021
min27.428-27.561=-0.133
max28.189-28.266=-0.078