Compare commits

Home / Compare a48f9817 .. e885c315

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.054-0.055=-0.001
min35.588-35.588=0.000
max35.770-35.774=-0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.085-0.085=-0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.003-0.002=0.001
min24.042-24.044=-0.002
max24.053-24.051=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.064-0.069=-0.004
σ0.004-0.003=0.002
min0.061-0.066=-0.006
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.539-1756.490=-37.951
σ169.588-0.365=169.223
min998.041-1755.914=-757.873
max1757.019-1757.077=-0.058
mean1631.250-1663.150=-31.900
σ607.770-617.635=-9.865
min620.000-624.000=-4.000
max2455.000-2497.000=-42.000
mean2.270-2.339=-0.069
σ0.225-0.082=0.143
min1.366-2.231=-0.865
max2.435-2.550=-0.114

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.760-324.757=0.003
σ0.048-0.050=-0.002
min324.675-324.668=0.007
max324.791-324.780=0.011
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean0.425-0.423=0.003
σ0.004-0.001=0.003
min0.422-0.421=0.002
max0.433-0.424=0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.310-1985.328=-0.018
σ0.023-0.007=0.016
min1985.274-1985.319=-0.045
max1985.330-1985.339=-0.008
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean2.712-2.566=0.146
σ0.282-0.108=0.174
min2.483-2.456=0.027
max3.179-2.709=0.470
iters=5
new-facts=6402
prior-facts=1
mean4808.996-4809.087=-0.091
σ7.475-7.712=-0.237
min4805.610-4805.551=0.059
max4822.367-4822.881=-0.514
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean9.155-8.925=0.231
σ0.406-0.232=0.174
min8.831-8.521=0.310
max9.787-9.090=0.697
iters=5
new-facts=6402
prior-facts=6402
mean4996.633-4996.415=0.217
σ0.022-0.199=-0.177
min4996.606-4996.262=0.345
max4996.655-4996.637=0.018
mean2989.000-3029.400=-40.400
σ312.652-334.454=-21.802
min2586.000-2560.000=26.000
max3391.000-3328.000=63.000
mean8.590-8.784=-0.195
σ0.092-0.356=-0.264
min8.470-8.347=0.122
max8.679-9.266=-0.587

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.545-1.717=-0.172
σ0.244-0.202=0.042
min1.134-1.418=-0.284
max1.777-1.893=-0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.202=0.004
σ574.775-574.761=0.014
min175.815-175.818=-0.003
max1325.368-1325.343=0.026
mean86.250
σ8.500
min82.000
max99.000
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean0.538-0.543=-0.005
σ0.546-0.539=0.007
min0.252-0.272=-0.020
max1.356-1.352=0.004
policies=20
mean1758.490-1758.501=-0.011
σ0.338-0.360=-0.021
min1758.252-1758.267=-0.015
max1758.990-1759.034=-0.044
mean820.000
σ0.000
min820.000
max820.000
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean2.698-2.726=-0.028
σ0.023-0.014=0.009
min2.672-2.709=-0.037
max2.725-2.740=-0.015
policies=200
mean17592.051-17592.019=0.032
σ0.459-0.556=-0.097
min17591.674-17591.667=0.008
max17592.719-17592.837=-0.118
mean8200.000
σ0.000
min8200.000
max8200.000
mean2455.000-2497.000=-42.000
σ0.000
min2455.000-2497.000=-42.000
max2455.000-2497.000=-42.000
mean27.333-27.522=-0.189
σ0.141-0.221=-0.080
min27.179-27.332=-0.153
max27.497-27.820=-0.324