Compare commits

Home / Compare 810b2732 .. b04fb9a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.001
σ0.054-0.054=0.000
min35.587-35.590=-0.003
max35.770-35.771=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.086-0.084=0.002
σ0.004-0.004=-0.000
min0.082-0.077=0.005
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=0.001
σ0.003-0.004=-0.001
min24.041-24.042=-0.000
max24.052-24.051=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.067-0.063=0.004
σ0.003-0.003=-0.000
min0.063-0.060=0.002
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.491=0.000
σ0.365-0.364=0.001
min1755.915-1755.914=0.001
max1757.070-1757.076=-0.006
mean1654.600-1652.850=1.750
σ642.845-644.913=-2.068
min624.000-633.000=-9.000
max2794.000-2841.000=-47.000
mean2.343-2.325=0.018
σ0.110-0.084=0.026
min2.246-2.236=0.010
max2.704-2.537=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.760=0.008
σ0.045-0.054=-0.010
min324.688-324.664=0.024
max324.790-324.796=-0.006
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean0.430-0.431=-0.000
σ0.010-0.010=-0.000
min0.420-0.420=-0.000
max0.445-0.441=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.319=0.003
σ0.016-0.017=-0.001
min1985.294-1985.298=-0.004
max1985.334-1985.334=-0.001
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean2.593-2.671=-0.078
σ0.095-0.129=-0.035
min2.508-2.522=-0.014
max2.732-2.853=-0.121
iters=5
new-facts=6402
prior-facts=1
mean4809.088-4809.090=-0.002
σ7.731-7.729=0.002
min4805.609-4805.566=0.043
max4822.918-4822.916=0.002
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean9.030-8.986=0.043
σ0.160-0.159=0.002
min8.886-8.836=0.050
max9.277-9.196=0.081
iters=5
new-facts=6402
prior-facts=6402
mean4996.554-4996.626=-0.072
σ0.146-0.030=0.116
min4996.295-4996.587=-0.292
max4996.646-4996.657=-0.011
mean3028.600-3064.800=-36.200
σ292.161-297.625=-5.464
min2794.000-2841.000=-47.000
max3469.000-3524.000=-55.000
mean8.562-8.665=-0.103
σ0.246-0.253=-0.007
min8.410-8.428=-0.018
max8.991-9.058=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-0.940=0.006
σ0.054-0.057=-0.002
min0.917-0.906=0.011
max1.043-1.037=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.207=0.001
σ574.766-574.766=0.000
min175.819-175.819=-0.001
max1325.357-1325.356=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean0.430-0.430=0.000
σ0.306-0.300=0.006
min0.276-0.278=-0.002
max0.889-0.879=0.010
policies=20
mean1758.514-1758.539=-0.025
σ0.360-0.343=0.017
min1758.311-1758.328=-0.017
max1759.052-1759.051=0.001
mean820.000
σ0.000
min820.000
max820.000
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean2.822-2.772=0.050
σ0.084-0.007=0.077
min2.775-2.763=0.012
max2.947-2.779=0.168
policies=200
mean17592.032-17592.211=-0.179
σ0.634-0.466=0.168
min17591.583-17591.837=-0.254
max17592.961-17592.892=0.069
mean8200.000
σ0.000
min8200.000
max8200.000
mean2794.000-2841.000=-47.000
σ0.000
min2794.000-2841.000=-47.000
max2794.000-2841.000=-47.000
mean27.351-27.845=-0.494
σ0.164-0.385=-0.220
min27.204-27.480=-0.276
max27.554-28.299=-0.744