Compare commits

Home / Compare 6426cdb2 .. 517577c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-35.618=-1.632
σ0.054-0.054=-0.000
min33.954-35.590=-1.636
max34.138-35.771=-1.634
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.082-0.086=-0.004
σ0.004-0.005=-0.001
min0.076-0.082=-0.006
max0.088-0.095=-0.007
cache=y
dps=1
iters=10
policies=100
mean23.324-24.042=-0.718
σ0.003-0.003=-0.000
min23.319-24.039=-0.720
max23.328-24.046=-0.718
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.049=0.012
σ0.004-0.008=-0.005
min0.059-0.033=0.026
max0.069-0.058=0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.491=0.234
σ0.366-0.364=0.002
min1756.151-1755.916=0.234
max1757.317-1757.076=0.240
mean1675.900-1650.750=25.150
σ634.669-643.529=-8.860
min671.000-630.000=41.000
max2690.000-2837.000=-147.000
mean2.357-2.358=-0.000
σ0.100-0.075=0.024
min2.244-2.279=-0.034
max2.638-2.544=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.314-324.769=0.545
σ0.052-0.036=0.016
min325.221-324.705=0.516
max325.341-324.787=0.553
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean0.427-0.419=0.008
σ0.001-0.008=-0.007
min0.426-0.415=0.011
max0.429-0.434=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.878-1985.316=0.562
σ0.013-0.014=-0.001
min1985.854-1985.294=0.561
max1985.885-1985.328=0.558
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean2.721-2.622=0.099
σ0.096-0.075=0.020
min2.602-2.559=0.042
max2.848-2.751=0.097
iters=5
new-facts=6402
prior-facts=1
mean4809.634-4809.101=0.533
σ7.713-7.745=-0.032
min4806.170-4805.538=0.631
max4823.431-4822.955=0.476
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean8.951-9.002=-0.051
σ0.164-0.349=-0.185
min8.677-8.504=0.173
max9.088-9.395=-0.307
iters=5
new-facts=6402
prior-facts=6402
mean4997.115-4996.628=0.487
σ0.172-0.024=0.148
min4996.810-4996.604=0.206
max4997.213-4996.658=0.554
mean2964.800-3026.200=-61.400
σ323.851-267.319=56.532
min2690.000-2837.000=-147.000
max3443.000-3454.000=-11.000
mean8.525-8.420=0.106
σ0.073-0.075=-0.002
min8.443-8.290=0.152
max8.625-8.477=0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-0.978=0.036
σ0.145-0.068=0.077
min0.917-0.921=-0.004
max1.254-1.058=0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.372-463.210=0.162
σ574.777-574.773=0.003
min175.977-175.817=0.160
max1325.538-1325.371=0.167
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean0.551-0.430=0.121
σ0.550-0.296=0.254
min0.272-0.279=-0.007
max1.376-0.874=0.501
policies=20
mean1760.132-1758.531=1.601
σ0.350-0.348=0.001
min1759.900-1758.296=1.604
max1760.652-1759.047=1.605
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean2.721-2.799=-0.077
σ0.035-0.013=0.022
min2.695-2.787=-0.091
max2.773-2.815=-0.042
policies=200
mean17608.406-17591.912=16.493
σ0.510-0.382=0.129
min17608.103-17591.561=16.542
max17609.169-17592.416=16.753
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2837.000=-147.000
σ0.000
min2690.000-2837.000=-147.000
max2690.000-2837.000=-147.000
mean27.562-27.966=-0.404
σ0.179-0.382=-0.204
min27.378-27.581=-0.202
max27.791-28.383=-0.592