Compare commits

Home / Compare a11d8430 .. b3ccb124

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.055-0.054=0.001
min35.214-35.220=-0.006
max35.397-35.397=0.000
mean415.000-416.700=-1.700
σ0.000-0.483=-0.483
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.083-0.084=-0.001
σ0.005-0.005=-0.000
min0.077-0.077=0.000
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.003-0.002=0.001
min23.766-23.766=0.000
max23.775-23.773=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.068-0.067=0.001
σ0.004-0.003=0.001
min0.065-0.060=0.005
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.484=-0.001
σ0.364-0.365=-0.001
min1755.912-1755.909=0.002
max1757.074-1757.077=-0.003
mean1662.850-1663.850=-1.000
σ647.304-647.360=-0.056
min630.000-631.000=-1.000
max2811.000-2816.000=-5.000
mean2.355-2.371=-0.015
σ0.093-0.120=-0.028
min2.248-2.266=-0.018
max2.632-2.789=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.713=-0.001
σ0.034-0.030=0.003
min324.653-324.659=-0.006
max324.738-324.733=0.005
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean0.422-0.421=0.001
σ0.001-0.000=0.001
min0.421-0.421=-0.000
max0.424-0.422=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.264=0.006
σ0.006-0.011=-0.005
min1985.263-1985.245=0.018
max1985.277-1985.274=0.004
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean2.598-2.563=0.035
σ0.049-0.041=0.008
min2.552-2.522=0.030
max2.669-2.628=0.041
iters=5
new-facts=6402
prior-facts=1
mean4808.856-4808.879=-0.023
σ7.671-7.657=0.014
min4805.371-4805.330=0.042
max4822.578-4822.575=0.003
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean8.887-8.887=-0.000
σ0.200-0.499=-0.299
min8.618-8.480=0.138
max9.123-9.740=-0.617
iters=5
new-facts=6402
prior-facts=6402
mean4996.465-4996.464=0.001
σ0.019-0.012=0.007
min4996.438-4996.449=-0.012
max4996.488-4996.475=0.014
mean3045.400-3053.000=-7.600
σ204.831-227.553=-22.722
min2811.000-2816.000=-5.000
max3338.000-3390.000=-52.000
mean8.699-8.696=0.004
σ0.200-0.143=0.056
min8.498-8.469=0.029
max9.009-8.829=0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-0.965=-0.015
σ0.055-0.066=-0.011
min0.916-0.903=0.013
max1.046-1.040=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.973-462.975=-0.002
σ574.254-574.252=0.002
min175.834-175.836=-0.001
max1324.354-1324.353=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean0.467-0.433=0.034
σ0.380-0.302=0.078
min0.268-0.280=-0.011
max1.036-0.885=0.151
policies=20
mean1758.686-1758.708=-0.022
σ0.355-0.347=0.008
min1758.448-1758.466=-0.018
max1759.211-1759.220=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean2.797-2.794=0.003
σ0.008-0.042=-0.035
min2.786-2.757=0.030
max2.804-2.848=-0.044
policies=200
mean17592.343-17592.413=-0.071
σ0.576-0.479=0.097
min17591.971-17591.958=0.013
max17593.189-17593.000=0.190
mean8200.000
σ0.000
min8200.000
max8200.000
mean2811.000-2816.000=-5.000
σ0.000
min2811.000-2816.000=-5.000
max2811.000-2816.000=-5.000
mean27.513-27.488=0.025
σ0.227-0.109=0.118
min27.270-27.416=-0.146
max27.739-27.649=0.090