Compare commits

Home / Compare c0446d91 .. d73eeeaa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.619-35.618=0.001
σ0.055-0.056=-0.001
min35.590-35.587=0.003
max35.774-35.775=-0.001
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.086-0.085=0.001
σ0.005-0.003=0.001
min0.082-0.082=-0.001
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.002-0.002=0.000
min24.043-24.044=-0.001
max24.051-24.049=0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.064-0.069=-0.004
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.489=0.001
σ0.366-0.364=0.001
min1755.913-1755.915=-0.001
max1757.080-1757.075=0.005
mean1633.800-1655.850=-22.050
σ592.992-644.014=-51.022
min646.000-635.000=11.000
max2432.000-2843.000=-411.000
mean2.330-2.332=-0.002
σ0.083-0.063=0.020
min2.233-2.254=-0.021
max2.552-2.466=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.769-324.738=0.031
σ0.046-0.043=0.003
min324.687-324.662=0.025
max324.795-324.763=0.032
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean0.430-0.426=0.005
σ0.008-0.005=0.004
min0.422-0.423=-0.000
max0.443-0.434=0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.320-1985.322=-0.002
σ0.014-0.014=0.000
min1985.301-1985.300=0.001
max1985.334-1985.335=-0.001
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean2.664-2.672=-0.008
σ0.149-0.132=0.017
min2.464-2.520=-0.056
max2.806-2.872=-0.066
iters=5
new-facts=6402
prior-facts=1
mean4808.998-4809.089=-0.091
σ7.715-7.736=-0.022
min4805.079-4805.605=-0.525
max4822.789-4822.928=-0.140
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean8.834-8.969=-0.135
σ0.430-0.487=-0.057
min8.238-8.245=-0.007
max9.367-9.565=-0.199
iters=5
new-facts=6402
prior-facts=6402
mean4996.626-4996.566=0.060
σ0.034-0.181=-0.147
min4996.583-4996.247=0.336
max4996.660-4996.674=-0.014
mean2928.600-3086.000=-157.400
σ411.732-259.533=152.199
min2459.000-2843.000=-384.000
max3491.000-3358.000=133.000
mean8.495-9.158=-0.663
σ0.106-0.551=-0.445
min8.389-8.528=-0.139
max8.665-9.899=-1.234

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.678-1.068=0.610
σ0.132-0.264=-0.132
min1.510-0.916=0.594
max1.807-1.529=0.278

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-463.219=-0.017
σ574.764-574.771=-0.008
min175.811-175.821=-0.010
max1325.347-1325.376=-0.028
mean86.250
σ8.500
min82.000
max99.000
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean0.535-0.421=0.114
σ0.526-0.284=0.243
min0.270-0.273=-0.003
max1.324-0.846=0.478
policies=20
mean1758.491-1758.533=-0.041
σ0.338-0.366=-0.028
min1758.258-1758.284=-0.026
max1758.991-1759.075=-0.084
mean820.000
σ0.000
min820.000
max820.000
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean2.717-2.786=-0.068
σ0.016-0.012=0.004
min2.700-2.771=-0.072
max2.736-2.798=-0.062
policies=200
mean17592.143-17592.089=0.054
σ0.492-0.498=-0.006
min17591.883-17591.686=0.197
max17592.881-17592.805=0.076
mean8200.000
σ0.000
min8200.000
max8200.000
mean2432.000-2843.000=-411.000
σ0.000
min2432.000-2843.000=-411.000
max2432.000-2843.000=-411.000
mean27.348-27.794=-0.446
σ0.152-0.317=-0.165
min27.200-27.446=-0.246
max27.492-28.168=-0.676