Compare commits

Home / Compare 660937e4 .. cb936d8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.054-0.052=0.002
min35.590-35.592=-0.002
max35.771-35.765=0.006
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.086-0.085=0.001
σ0.005-0.004=0.001
min0.082-0.081=0.001
max0.095-0.092=0.003
cache=y
dps=1
iters=10
policies=100
mean24.042-24.048=-0.006
σ0.003-0.003=-0.000
min24.039-24.040=-0.001
max24.046-24.051=-0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.049-0.068=-0.019
σ0.008-0.003=0.005
min0.033-0.066=-0.033
max0.058-0.076=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.489=0.002
σ0.364-0.365=-0.000
min1755.916-1755.915=0.001
max1757.076-1757.075=0.001
mean1650.750-1652.200=-1.450
σ643.529-644.668=-1.140
min630.000-649.000=-19.000
max2837.000-2840.000=-3.000
mean2.358-2.352=0.006
σ0.075-0.080=-0.004
min2.279-2.267=0.012
max2.544-2.533=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.769-324.761=0.009
σ0.036-0.043=-0.007
min324.705-324.684=0.021
max324.787-324.790=-0.003
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean0.419-0.417=0.002
σ0.008-0.002=0.007
min0.415-0.416=-0.001
max0.434-0.420=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.313=0.003
σ0.014-0.015=-0.001
min1985.294-1985.292=0.002
max1985.328-1985.334=-0.006
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean2.622-2.636=-0.014
σ0.075-0.129=-0.054
min2.559-2.515=0.044
max2.751-2.817=-0.066
iters=5
new-facts=6402
prior-facts=1
mean4809.101-4809.111=-0.010
σ7.745-7.773=-0.028
min4805.538-4805.604=-0.065
max4822.955-4823.016=-0.061
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean9.002-9.162=-0.160
σ0.349-0.341=0.009
min8.504-8.925=-0.421
max9.395-9.755=-0.360
iters=5
new-facts=6402
prior-facts=6402
mean4996.628-4996.552=0.076
σ0.024-0.151=-0.127
min4996.604-4996.285=0.319
max4996.658-4996.646=0.012
mean3026.200-3047.600=-21.400
σ267.319-270.853=-3.533
min2837.000-2840.000=-3.000
max3454.000-3465.000=-11.000
mean8.420-8.503=-0.083
σ0.075-0.114=-0.039
min8.290-8.444=-0.153
max8.477-8.705=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.978-0.981=-0.003
σ0.068-0.068=0.000
min0.921-0.924=-0.002
max1.058-1.056=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.210-463.205=0.006
σ574.773-574.774=-0.001
min175.817-175.808=0.009
max1325.371-1325.366=0.005
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean0.430-0.430=-0.000
σ0.296-0.299=-0.002
min0.279-0.278=0.001
max0.874-0.878=-0.004
policies=20
mean1758.531-1758.488=0.043
σ0.348-0.353=-0.004
min1758.296-1758.241=0.055
max1759.047-1759.009=0.038
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean2.799-2.788=0.010
σ0.013-0.005=0.008
min2.787-2.781=0.006
max2.815-2.792=0.022
policies=200
mean17591.912-17591.980=-0.067
σ0.382-0.432=-0.050
min17591.561-17591.725=-0.163
max17592.416-17592.626=-0.210
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2840.000=-3.000
σ0.000
min2837.000-2840.000=-3.000
max2837.000-2840.000=-3.000
mean27.966-27.908=0.057
σ0.382-0.376=0.006
min27.581-27.527=0.054
max28.383-28.323=0.060