Compare commits

Home / Compare f6500cd8 .. eacfa25d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-35.618=-1.632
σ0.054-0.054=-0.000
min33.954-35.592=-1.639
max34.138-35.771=-1.634
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.082-0.083=-0.001
σ0.004-0.004=0.000
min0.076-0.077=-0.001
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.324-24.047=-0.723
σ0.003-0.003=-0.001
min23.319-24.044=-0.725
max23.328-24.053=-0.725
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.061-0.066=-0.005
σ0.004-0.004=-0.001
min0.059-0.061=-0.002
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.489=0.236
σ0.366-0.366=0.001
min1756.151-1755.914=0.237
max1757.317-1757.078=0.239
mean1675.900-1644.150=31.750
σ634.669-645.733=-11.065
min671.000-621.000=50.000
max2690.000-2726.000=-36.000
mean2.357-2.361=-0.004
σ0.100-0.120=-0.020
min2.244-2.234=0.010
max2.638-2.602=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.314-324.763=0.550
σ0.052-0.054=-0.002
min325.221-324.667=0.554
max325.341-324.794=0.547
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean0.427-0.428=-0.001
σ0.001-0.009=-0.007
min0.426-0.423=0.003
max0.429-0.443=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.878-1985.313=0.565
σ0.013-0.018=-0.005
min1985.854-1985.292=0.562
max1985.885-1985.332=0.553
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean2.721-2.673=0.048
σ0.096-0.096=-0.000
min2.602-2.554=0.048
max2.848-2.750=0.098
iters=5
new-facts=6402
prior-facts=1
mean4809.634-4808.938=0.696
σ7.713-7.824=-0.111
min4806.170-4805.000=1.169
max4823.431-4822.917=0.514
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean8.951-8.751=0.200
σ0.164-0.790=-0.626
min8.677-7.774=0.903
max9.088-9.361=-0.274
iters=5
new-facts=6402
prior-facts=6402
mean4997.115-4996.628=0.487
σ0.172-0.024=0.148
min4996.810-4996.601=0.209
max4997.213-4996.656=0.557
mean2964.800-3020.800=-56.000
σ323.851-346.327=-22.476
min2690.000-2726.000=-36.000
max3443.000-3533.000=-90.000
mean8.525-8.528=-0.003
σ0.073-0.094=-0.022
min8.443-8.422=0.021
max8.625-8.668=-0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-0.973=0.041
σ0.145-0.064=0.081
min0.917-0.917=0.000
max1.254-1.044=0.211

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.372-463.224=0.149
σ574.777-574.795=-0.018
min175.977-175.814=0.163
max1325.538-1325.416=0.122
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean0.551-0.532=0.019
σ0.550-0.516=0.034
min0.272-0.271=0.000
max1.376-1.305=0.070
policies=20
mean1760.132-1758.507=1.625
σ0.350-0.338=0.011
min1759.900-1758.295=1.605
max1760.652-1759.010=1.642
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean2.721-2.705=0.016
σ0.035-0.010=0.025
min2.695-2.696=-0.000
max2.773-2.718=0.055
policies=200
mean17608.406-17592.100=16.306
σ0.510-0.447=0.064
min17608.103-17591.849=16.255
max17609.169-17592.769=16.401
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2726.000=-36.000
σ0.000
min2690.000-2726.000=-36.000
max2690.000-2726.000=-36.000
mean27.562-27.297=0.265
σ0.179-0.079=0.100
min27.378-27.207=0.171
max27.791-27.387=0.403