Compare commits

Home / Compare 34c7eb39 .. ce1ea61c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.049=-0.000
min33.953-33.953=0.001
max34.112-34.114=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=0.001
max0.090-0.094=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.002=0.001
min23.314-23.314=-0.000
max23.323-23.322=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.066-0.066=0.000
σ0.003-0.003=0.001
min0.064-0.063=0.000
max0.074-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.429=0.063
σ0.364-0.365=-0.001
min1756.919-1756.854=0.066
max1758.080-1758.024=0.056
mean1666.300-1662.000=4.300
σ623.379-622.841=0.537
min689.000-667.000=22.000
max2760.000-2591.000=169.000
mean2.375-2.364=0.011
σ0.122-0.122=0.000
min2.168-2.245=-0.078
max2.768-2.676=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.571=0.061
σ0.061-0.046=0.016
min326.523-326.492=0.031
max326.671-326.604=0.066
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean0.429-0.422=0.007
σ0.006-0.001=0.004
min0.424-0.420=0.004
max0.439-0.423=0.015
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.726=0.073
σ0.015-0.019=-0.004
min1988.782-1988.710=0.072
max1988.820-1988.748=0.072
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean2.679-2.671=0.008
σ0.143-0.100=0.043
min2.576-2.551=0.024
max2.926-2.816=0.110
iters=5
new-facts=6402
prior-facts=1
mean4813.553-4813.457=0.096
σ7.513-7.470=0.043
min4810.142-4810.091=0.051
max4826.992-4826.819=0.172
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean8.923-8.919=0.005
σ0.444-0.194=0.250
min8.467-8.606=-0.139
max9.539-9.114=0.425
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.134=-0.003
σ0.156-0.026=0.131
min5000.855-5001.105=-0.251
max5001.231-5001.168=0.063
mean2989.200-3003.200=-14.000
σ228.327-318.399=-90.072
min2760.000-2591.000=169.000
max3322.000-3408.000=-86.000
mean9.645-9.722=-0.076
σ0.182-0.233=-0.051
min9.460-9.319=0.141
max9.901-9.882=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.350=-0.347
σ0.141-0.350=-0.209
min0.912-1.048=-0.136
max1.234-1.853=-0.619

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.564=0.073
σ574.772-574.779=-0.007
min177.240-177.170=0.070
max1326.795-1326.732=0.062
mean88.250
σ8.500
min84.000
max101.000
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean0.433-0.550=-0.116
σ0.310-0.551=-0.241
min0.278-0.272=0.005
max0.898-1.376=-0.478
policies=20
mean1772.712-1772.019=0.693
σ0.407-0.349=0.058
min1772.443-1771.796=0.647
max1773.317-1772.538=0.779
mean840.000
σ0.000
min840.000
max840.000
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean2.839-2.706=0.133
σ0.076-0.012=0.064
min2.799-2.693=0.106
max2.953-2.718=0.235
policies=200
mean17733.884-17727.501=6.383
σ0.432-0.446=-0.014
min17733.480-17727.072=6.409
max17734.496-17728.128=6.368
mean8400.000
σ0.000
min8400.000
max8400.000
mean2760.000-2591.000=169.000
σ0.000
min2760.000-2591.000=169.000
max2760.000-2591.000=169.000
mean27.476-27.474=0.002
σ0.129-0.232=-0.104
min27.321-27.270=0.051
max27.616-27.785=-0.169