Compare commits

Home / Compare ac6c4827 .. 243cd5a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.049=-0.001
min33.949-33.953=-0.004
max34.110-34.114=-0.004
mean412.000
σ0.000
min412.000
max412.000
mean0.081-0.085=-0.005
σ0.005-0.004=0.000
min0.076-0.082=-0.006
max0.088-0.094=-0.006
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.002
σ0.002-0.002=0.000
min23.313-23.314=-0.001
max23.322-23.322=-0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.066=-0.002
σ0.003-0.003=0.000
min0.061-0.063=-0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.429=0.065
σ0.365-0.365=-0.001
min1756.919-1756.854=0.065
max1758.082-1758.024=0.058
mean1644.700-1662.000=-17.300
σ625.264-622.841=2.422
min634.000-667.000=-33.000
max2833.000-2591.000=242.000
mean2.394-2.364=0.030
σ0.087-0.122=-0.034
min2.284-2.245=0.039
max2.670-2.676=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.571=0.067
σ0.060-0.046=0.015
min326.532-326.492=0.040
max326.681-326.604=0.077
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean0.432-0.422=0.010
σ0.010-0.001=0.009
min0.425-0.420=0.004
max0.449-0.423=0.026
iters=5
new-facts=1
prior-facts=6402
mean1988.803-1988.726=0.077
σ0.011-0.019=-0.008
min1988.790-1988.710=0.080
max1988.815-1988.748=0.067
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean2.727-2.671=0.056
σ0.076-0.100=-0.024
min2.636-2.551=0.085
max2.841-2.816=0.026
iters=5
new-facts=6402
prior-facts=1
mean4813.702-4813.457=0.245
σ7.753-7.470=0.283
min4810.122-4810.091=0.031
max4827.569-4826.819=0.750
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean8.761-8.919=-0.157
σ0.642-0.194=0.448
min7.727-8.606=-0.880
max9.358-9.114=0.244
iters=5
new-facts=6402
prior-facts=6402
mean5001.203-5001.134=0.069
σ0.015-0.026=-0.011
min5001.189-5001.105=0.083
max5001.224-5001.168=0.057
mean3007.400-3003.200=4.200
σ237.126-318.399=-81.273
min2833.000-2591.000=242.000
max3381.000-3408.000=-27.000
mean9.736-9.722=0.014
σ0.233-0.233=0.000
min9.386-9.319=0.066
max10.005-9.882=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.350=-0.349
σ0.067-0.350=-0.283
min0.917-1.048=-0.130
max1.051-1.853=-0.802

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.564=0.066
σ574.770-574.779=-0.009
min177.236-177.170=0.066
max1326.784-1326.732=0.052
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean0.437-0.550=-0.113
σ0.305-0.551=-0.245
min0.282-0.272=0.010
max0.895-1.376=-0.481
policies=20
mean1772.685-1772.019=0.666
σ0.369-0.349=0.020
min1772.427-1771.796=0.630
max1773.229-1772.538=0.691
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean2.804-2.706=0.098
σ0.011-0.012=-0.001
min2.788-2.693=0.095
max2.812-2.718=0.094
policies=200
mean17734.019-17727.501=6.517
σ0.516-0.446=0.069
min17733.701-17727.072=6.629
max17734.789-17728.128=6.661
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2591.000=242.000
σ0.000
min2833.000-2591.000=242.000
max2833.000-2591.000=242.000
mean28.004-27.474=0.530
σ0.449-0.232=0.217
min27.607-27.270=0.338
max28.495-27.785=0.710