Compare commits

Home / Compare 31feb1ad .. 96b77bfa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.056-0.056=0.001
min35.591-35.588=0.002
max35.776-35.775=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.083-0.083=-0.000
σ0.005-0.006=-0.000
min0.076-0.076=0.000
max0.092-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean24.046-24.048=-0.001
σ0.003-0.004=-0.001
min24.042-24.042=-0.000
max24.051-24.053=-0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.067-0.066=0.001
σ0.005-0.003=0.002
min0.060-0.061=-0.000
max0.074-0.067=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.563-1756.489=-37.926
σ169.703-0.364=169.339
min997.577-1755.916=-758.339
max1757.080-1757.082=-0.002
mean1593.350-1650.700=-57.350
σ603.188-641.545=-38.357
min629.000-634.000=-5.000
max2429.000-2834.000=-405.000
mean2.263-2.371=-0.107
σ0.218-0.144=0.074
min1.397-2.265=-0.868
max2.444-2.903=-0.459

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.764=0.003
σ0.050-0.046=0.004
min324.678-324.683=-0.005
max324.795-324.794=0.002
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean0.431-0.422=0.009
σ0.012-0.001=0.011
min0.421-0.421=0.000
max0.448-0.424=0.025
iters=5
new-facts=1
prior-facts=6402
mean1985.319-1985.327=-0.009
σ0.013-0.004=0.010
min1985.305-1985.322=-0.017
max1985.334-1985.330=0.003
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean2.624-2.691=-0.067
σ0.096-0.176=-0.081
min2.535-2.543=-0.008
max2.739-2.905=-0.166
iters=5
new-facts=6402
prior-facts=1
mean4808.980-4809.078=-0.099
σ7.745-7.694=0.051
min4805.008-4805.584=-0.576
max4822.824-4822.842=-0.018
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean8.930-8.797=0.132
σ0.424-0.144=0.280
min8.587-8.591=-0.005
max9.613-8.944=0.669
iters=5
new-facts=6402
prior-facts=6402
mean4996.632-4996.624=0.007
σ0.013-0.021=-0.008
min4996.614-4996.596=0.019
max4996.646-4996.647=-0.001
mean2995.400-3035.000=-39.600
σ324.019-207.434=116.585
min2571.000-2834.000=-263.000
max3408.000-3327.000=81.000
mean8.612-8.692=-0.079
σ0.108-0.191=-0.083
min8.491-8.476=0.015
max8.716-8.994=-0.279

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.629-1.009=0.620
σ0.245-0.134=0.111
min1.198-0.921=0.278
max1.791-1.226=0.566

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.214=-0.012
σ574.763-574.770=-0.007
min175.816-175.819=-0.003
max1325.346-1325.369=-0.022
mean86.250
σ8.500
min82.000
max99.000
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean0.542-0.434=0.108
σ0.545-0.307=0.238
min0.266-0.278=-0.012
max1.359-0.895=0.464
policies=20
mean1758.496-1758.503=-0.007
σ0.348-0.339=0.009
min1758.258-1758.274=-0.016
max1759.010-1759.006=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean2.701-2.786=-0.084
σ0.013-0.004=0.008
min2.685-2.780=-0.095
max2.715-2.791=-0.076
policies=200
mean17592.001-17592.146=-0.146
σ0.615-0.515=0.100
min17591.648-17591.826=-0.178
max17592.922-17592.910=0.012
mean8200.000
σ0.000
min8200.000
max8200.000
mean2429.000-2834.000=-405.000
σ0.000
min2429.000-2834.000=-405.000
max2429.000-2834.000=-405.000
mean27.299-27.868=-0.569
σ0.133-0.344=-0.211
min27.158-27.550=-0.392
max27.474-28.272=-0.798