Compare commits

Home / Compare 7582f0b1 .. 516d5122

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.054-0.053=0.001
min35.592-35.591=0.002
max35.771-35.768=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.083-0.082=0.000
σ0.004-0.004=-0.000
min0.077-0.076=0.001
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.003-0.003=-0.000
min24.044-24.044=-0.000
max24.053-24.054=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.066-0.068=-0.002
σ0.004-0.003=0.001
min0.061-0.067=-0.006
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.487=0.002
σ0.366-0.365=0.001
min1755.914-1755.912=0.002
max1757.078-1757.072=0.006
mean1644.150-1654.050=-9.900
σ645.733-643.499=2.234
min621.000-628.000=-7.000
max2726.000-2841.000=-115.000
mean2.361-2.347=0.014
σ0.120-0.079=0.041
min2.234-2.265=-0.031
max2.602-2.534=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.763-324.765=-0.001
σ0.054-0.045=0.009
min324.667-324.684=-0.017
max324.794-324.792=0.002
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean0.428-0.416=0.011
σ0.009-0.001=0.008
min0.423-0.415=0.009
max0.443-0.418=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.317=-0.004
σ0.018-0.016=0.002
min1985.292-1985.287=0.005
max1985.332-1985.326=0.007
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean2.673-2.742=-0.069
σ0.096-0.142=-0.046
min2.554-2.599=-0.045
max2.750-2.949=-0.199
iters=5
new-facts=6402
prior-facts=1
mean4808.938-4809.105=-0.167
σ7.824-7.648=0.177
min4805.000-4805.580=-0.580
max4822.917-4822.784=0.133
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean8.751-8.824=-0.073
σ0.790-0.314=0.477
min7.774-8.477=-0.703
max9.361-9.194=0.168
iters=5
new-facts=6402
prior-facts=6402
mean4996.628-4996.631=-0.003
σ0.024-0.020=0.004
min4996.601-4996.610=-0.009
max4996.656-4996.660=-0.004
mean3020.800-3078.800=-58.000
σ346.327-255.919=90.408
min2726.000-2841.000=-115.000
max3533.000-3348.000=185.000
mean8.528-8.720=-0.192
σ0.094-0.125=-0.031
min8.422-8.527=-0.105
max8.668-8.827=-0.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.953=0.020
σ0.064-0.056=0.008
min0.917-0.918=-0.001
max1.044-1.052=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-463.204=0.020
σ574.795-574.773=0.022
min175.814-175.811=0.003
max1325.416-1325.364=0.052
mean86.250
σ8.500
min82.000
max99.000
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean0.532-0.431=0.101
σ0.516-0.299=0.217
min0.271-0.279=-0.008
max1.305-0.880=0.426
policies=20
mean1758.507-1758.496=0.012
σ0.338-0.344=-0.006
min1758.295-1758.262=0.033
max1759.010-1759.004=0.006
mean820.000
σ0.000
min820.000
max820.000
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean2.705-2.795=-0.091
σ0.010-0.016=-0.005
min2.696-2.778=-0.082
max2.718-2.815=-0.097
policies=200
mean17592.100-17592.058=0.042
σ0.447-0.512=-0.066
min17591.849-17591.715=0.134
max17592.769-17592.819=-0.051
mean8200.000
σ0.000
min8200.000
max8200.000
mean2726.000-2841.000=-115.000
σ0.000
min2726.000-2841.000=-115.000
max2726.000-2841.000=-115.000
mean27.297-27.780=-0.483
σ0.079-0.353=-0.274
min27.207-27.358=-0.150
max27.387-28.164=-0.777