Compare commits

Home / Compare c1becf0c .. 9ba6889c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=0.000
σ0.053-0.054=-0.000
min35.594-35.590=0.003
max35.768-35.770=-0.001
mean414.800-412.000=2.800
σ0.422-0.000=0.422
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.083-0.085=-0.002
σ0.006-0.003=0.002
min0.077-0.082=-0.006
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.048=-0.000
σ0.003-0.003=0.000
min24.044-24.044=0.000
max24.053-24.051=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.069-0.067=0.001
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.076-0.076=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.364-0.365=-0.002
min1755.915-1755.916=-0.001
max1757.074-1757.085=-0.011
mean1649.100-1645.650=3.450
σ642.844-640.550=2.295
min650.000-630.000=20.000
max2833.000-2823.000=10.000
mean2.326-2.351=-0.025
σ0.071-0.067=0.003
min2.152-2.270=-0.118
max2.427-2.484=-0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.769-324.736=0.033
σ0.043-0.043=0.000
min324.694-324.661=0.034
max324.807-324.771=0.036
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean0.425-0.427=-0.003
σ0.001-0.005=-0.004
min0.423-0.424=-0.001
max0.425-0.436=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.325-1985.328=-0.003
σ0.013-0.007=0.006
min1985.306-1985.319=-0.013
max1985.342-1985.337=0.005
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean2.675-2.639=0.036
σ0.189-0.091=0.098
min2.563-2.580=-0.017
max3.007-2.794=0.212
iters=5
new-facts=6402
prior-facts=1
mean4809.001-4808.986=0.015
σ7.758-7.756=0.002
min4804.971-4804.968=0.003
max4822.867-4822.848=0.019
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean8.719-8.776=-0.057
σ0.555-0.563=-0.008
min7.737-7.784=-0.048
max9.060-9.115=-0.054
iters=5
new-facts=6402
prior-facts=6402
mean4996.544-4996.634=-0.089
σ0.157-0.019=0.138
min4996.266-4996.610=-0.345
max4996.642-4996.656=-0.014
mean3063.000-3035.200=27.800
σ303.680-205.359=98.321
min2833.000-2823.000=10.000
max3534.000-3288.000=246.000
mean8.526-8.670=-0.144
σ0.143-0.150=-0.007
min8.435-8.506=-0.071
max8.778-8.847=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-0.945=0.032
σ0.068-0.049=0.019
min0.922-0.911=0.011
max1.059-1.030=0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-463.202=0.010
σ574.772-574.767=0.005
min175.817-175.813=0.004
max1325.371-1325.353=0.018
mean86.250
σ8.500
min82.000
max99.000
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean0.430-0.433=-0.003
σ0.297-0.300=-0.003
min0.279-0.283=-0.004
max0.876-0.884=-0.008
policies=20
mean1758.495-1758.503=-0.008
σ0.356-0.355=0.000
min1758.257-1758.272=-0.015
max1759.022-1759.030=-0.008
mean820.000
σ0.000
min820.000
max820.000
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean2.789-2.803=-0.014
σ0.017-0.005=0.011
min2.770-2.799=-0.029
max2.808-2.810=-0.001
policies=200
mean17592.076-17592.068=0.009
σ0.525-0.493=0.032
min17591.807-17591.768=0.039
max17592.864-17592.799=0.064
mean8200.000
σ0.000
min8200.000
max8200.000
mean2833.000-2823.000=10.000
σ0.000
min2833.000-2823.000=10.000
max2833.000-2823.000=10.000
mean27.930-28.004=-0.074
σ0.368-0.559=-0.191
min27.541-27.504=0.037
max28.328-28.701=-0.373