Compare commits

Home / Compare 86b1ba6b .. 37d27ff0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.985-35.617=-1.632
σ0.048-0.055=-0.007
min33.956-35.587=-1.632
max34.118-35.771=-1.653
mean415.000-411.500=3.500
σ0.000-0.527=-0.527
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.081-0.083=-0.002
σ0.004-0.006=-0.002
min0.076-0.077=-0.000
max0.086-0.093=-0.008
cache=y
dps=1
iters=10
policies=100
mean23.324-24.046=-0.722
σ0.003-0.002=0.001
min23.320-24.041=-0.721
max23.329-24.049=-0.720
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.066-0.066=-0.000
σ0.002-0.004=-0.001
min0.064-0.061=0.003
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.297-1756.488=0.809
σ0.365-0.366=-0.001
min1756.725-1755.917=0.808
max1757.887-1757.079=0.809
mean1651.450-1642.400=9.050
σ640.124-646.000=-5.876
min624.000-619.000=5.000
max2791.000-2724.000=67.000
mean2.373-2.372=0.001
σ0.115-0.124=-0.009
min2.241-2.182=0.059
max2.657-2.629=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.436-324.761=1.675
σ0.058-0.049=0.009
min326.333-324.673=1.659
max326.472-324.787=1.686
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean0.427-0.424=0.003
σ0.001-0.001=0.000
min0.426-0.423=0.003
max0.428-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.606-1985.322=3.285
σ0.012-0.014=-0.002
min1988.594-1985.299=3.295
max1988.626-1985.337=3.288
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean2.789-2.633=0.156
σ0.118-0.067=0.050
min2.645-2.568=0.076
max2.968-2.739=0.229
iters=5
new-facts=6402
prior-facts=1
mean4812.386-4808.971=3.416
σ7.717-7.799=-0.082
min4808.836-4805.119=3.716
max4826.190-4822.917=3.272
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean8.593-8.800=-0.207
σ0.564-0.506=0.059
min7.937-8.034=-0.097
max9.185-9.328=-0.142
iters=5
new-facts=6402
prior-facts=6402
mean4999.942-4996.620=3.321
σ0.029-0.021=0.008
min4999.908-4996.599=3.308
max4999.973-4996.652=3.321
mean3025.600-3022.000=3.600
σ306.457-351.019=-44.562
min2791.000-2724.000=67.000
max3493.000-3541.000=-48.000
mean9.942-8.494=1.448
σ0.097-0.130=-0.033
min9.844-8.384=1.460
max10.096-8.716=1.379

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.991-0.954=0.037
σ0.138-0.060=0.078
min0.921-0.923=-0.002
max1.237-1.060=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.430-463.219=1.211
σ574.771-574.797=-0.026
min177.032-175.808=1.224
max1326.587-1325.415=1.172
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean0.417-0.547=-0.131
σ0.266-0.546=-0.280
min0.281-0.273=0.008
max0.815-1.366=-0.550
policies=20
mean1770.711-1758.488=12.223
σ0.453-0.336=0.117
min1770.411-1758.277=12.133
max1771.384-1758.988=12.396
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean2.832-2.706=0.126
σ0.060-0.009=0.051
min2.785-2.697=0.087
max2.920-2.717=0.203
policies=200
mean17713.786-17592.146=121.639
σ0.529-0.475=0.054
min17713.413-17591.865=121.548
max17714.568-17592.855=121.713
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2791.000-2724.000=67.000
σ0.000
min2791.000-2724.000=67.000
max2791.000-2724.000=67.000
mean27.659-27.489=0.170
σ0.157-0.113=0.044
min27.520-27.376=0.144
max27.824-27.599=0.225