Compare commits

Home / Compare ce35b0cf .. 282d1a85

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.354
σ0.054-0.055=-0.001
min35.593-35.239=0.355
max35.771-35.419=0.353
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.083=0.003
σ0.003-0.006=-0.002
min0.082-0.076=0.006
max0.091-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-23.770=0.278
σ0.002-0.002=0.000
min24.045-23.766=0.279
max24.052-23.773=0.278
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.066=0.002
σ0.003-0.005=-0.002
min0.066-0.062=0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.470=0.021
σ0.365-0.365=-0.001
min1755.917-1755.894=0.023
max1757.080-1757.061=0.019
mean1654.000-1650.700=3.300
σ641.406-640.346=1.060
min630.000-627.000=3.000
max2847.000-2833.000=14.000
mean2.365-2.341=0.023
σ0.113-0.071=0.041
min2.233-2.251=-0.018
max2.624-2.463=0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.703=0.059
σ0.056-0.030=0.027
min324.662-324.651=0.011
max324.800-324.724=0.076
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean0.432-0.423=0.009
σ0.008-0.002=0.006
min0.422-0.421=0.001
max0.440-0.426=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.248=0.069
σ0.016-0.014=0.002
min1985.291-1985.230=0.061
max1985.330-1985.264=0.066
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean2.621-2.614=0.006
σ0.068-0.119=-0.051
min2.551-2.513=0.038
max2.715-2.785=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4808.877=0.229
σ7.628-7.649=-0.021
min4805.595-4805.340=0.254
max4822.749-4822.559=0.191
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean8.935-8.640=0.295
σ0.456-0.546=-0.090
min8.367-7.710=0.658
max9.633-9.081=0.551
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.438=0.191
σ0.023-0.016=0.007
min4996.598-4996.417=0.181
max4996.653-4996.460=0.193
mean3056.600-3060.800=-4.200
σ226.085-298.361=-72.276
min2847.000-2833.000=14.000
max3393.000-3519.000=-126.000
mean8.751-8.472=0.280
σ0.170-0.125=0.045
min8.496-8.350=0.145
max8.958-8.675=0.283

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.967=-0.044
σ0.014-0.144=-0.130
min0.912-0.888=0.023
max0.947-1.224=-0.278

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.951=0.256
σ574.766-574.254=0.512
min175.818-175.818=-0.000
max1325.356-1324.332=1.024
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean0.423-0.433=-0.010
σ0.292-0.303=-0.011
min0.271-0.282=-0.011
max0.861-0.887=-0.026
policies=20
mean1758.519-1758.486=0.034
σ0.350-0.344=0.006
min1758.301-1758.254=0.047
max1759.040-1758.996=0.045
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean2.780-2.787=-0.007
σ0.007-0.011=-0.004
min2.771-2.777=-0.006
max2.788-2.802=-0.014
policies=200
mean17592.188-17590.970=1.218
σ0.486-0.755=-0.270
min17591.867-17589.939=1.929
max17592.911-17591.677=1.234
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2833.000=14.000
σ0.000
min2847.000-2833.000=14.000
max2847.000-2833.000=14.000
mean27.898-27.873=0.025
σ0.342-0.420=-0.077
min27.428-27.494=-0.066
max28.189-28.325=-0.136