Compare commits

Home / Compare 4e69a8a1 .. dd16af8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.053=-0.000
min35.230-35.237=-0.007
max35.414-35.413=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.083=0.002
σ0.004-0.005=-0.001
min0.083-0.077=0.005
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.001
σ0.002-0.004=-0.002
min23.766-23.765=0.000
max23.773-23.780=-0.007
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.066-0.066=-0.000
σ0.004-0.004=-0.001
min0.061-0.062=-0.001
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.365-0.364=0.001
min1755.908-1755.910=-0.002
max1757.072-1757.071=0.001
mean1650.650-1627.200=23.450
σ628.503-592.688=35.815
min620.000-650.000=-30.000
max2696.000-2424.000=272.000
mean2.341-2.329=0.012
σ0.113-0.083=0.030
min2.148-2.194=-0.046
max2.629-2.531=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.711-324.705=0.006
σ0.044-0.044=0.000
min324.633-324.627=0.006
max324.739-324.732=0.006
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean0.423-0.423=0.000
σ0.001-0.002=-0.000
min0.421-0.421=0.001
max0.424-0.425=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.267-1985.258=0.010
σ0.007-0.013=-0.006
min1985.255-1985.246=0.009
max1985.275-1985.280=-0.005
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean2.606-2.664=-0.058
σ0.067-0.131=-0.064
min2.534-2.506=0.029
max2.692-2.810=-0.118
iters=5
new-facts=6402
prior-facts=1
mean4808.859-4808.861=-0.002
σ7.685-7.668=0.016
min4805.365-4805.395=-0.031
max4822.606-4822.578=0.028
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean8.910-8.905=0.005
σ0.196-0.122=0.074
min8.599-8.765=-0.166
max9.081-9.072=0.008
iters=5
new-facts=6402
prior-facts=6402
mean4996.342-4996.398=-0.055
σ0.181-0.151=0.030
min4996.129-4996.128=0.002
max4996.487-4996.481=0.006
mean2986.200-2954.800=31.400
σ258.436-422.385=-163.949
min2696.000-2474.000=222.000
max3342.000-3524.000=-182.000
mean8.693-8.618=0.075
σ0.160-0.238=-0.077
min8.522-8.429=0.093
max8.907-8.987=-0.080

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.615=-0.612
σ0.138-0.183=-0.045
min0.912-1.349=-0.437
max1.230-1.804=-0.574

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.957-462.947=0.010
σ574.251-574.250=0.000
min175.822-175.814=0.008
max1324.333-1324.322=0.011
mean86.250
σ8.500
min82.000
max99.000
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean0.528-0.553=-0.025
σ0.511-0.551=-0.040
min0.269-0.277=-0.008
max1.295-1.380=-0.084
policies=20
mean1758.536-1758.502=0.034
σ0.330-0.346=-0.016
min1758.313-1758.273=0.040
max1759.026-1759.015=0.011
mean820.000
σ0.000
min820.000
max820.000
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean2.706-2.723=-0.017
σ0.010-0.018=-0.008
min2.697-2.709=-0.012
max2.720-2.749=-0.029
policies=200
mean17592.499-17592.225=0.274
σ0.493-0.495=-0.002
min17592.211-17591.944=0.267
max17593.237-17592.967=0.270
mean8200.000
σ0.000
min8200.000
max8200.000
mean2696.000-2424.000=272.000
σ0.000
min2696.000-2424.000=272.000
max2696.000-2424.000=272.000
mean27.333-27.404=-0.071
σ0.074-0.129=-0.055
min27.274-27.245=0.028
max27.440-27.524=-0.084