Compare commits

Home / Compare 1352527e .. fcf5a3d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.049-0.050=-0.002
min33.953-33.954=-0.001
max34.114-34.120=-0.006
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.085=0.001
σ0.004-0.003=0.001
min0.082-0.082=-0.000
max0.094-0.091=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.002-0.002=0.001
min23.314-23.314=0.001
max23.322-23.319=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.429=0.001
σ0.365-0.364=0.002
min1756.854-1756.854=-0.001
max1758.024-1758.015=0.009
mean1662.000-1649.150=12.850
σ622.841-627.580=-4.738
min667.000-636.000=31.000
max2591.000-2823.000=-232.000
mean2.364-2.325=0.039
σ0.122-0.082=0.039
min2.245-2.238=0.007
max2.676-2.556=0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.586=-0.015
σ0.046-0.029=0.017
min326.492-326.537=-0.045
max326.604-326.608=-0.003
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean0.422-0.422=0.000
σ0.001-0.005=-0.003
min0.420-0.419=0.002
max0.423-0.431=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.726-1988.741=-0.015
σ0.019-0.006=0.013
min1988.710-1988.735=-0.025
max1988.748-1988.751=-0.003
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean2.671-2.699=-0.028
σ0.100-0.076=0.024
min2.551-2.628=-0.076
max2.816-2.786=0.029
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.374=0.083
σ7.470-7.562=-0.092
min4810.091-4809.578=0.513
max4826.819-4826.894=-0.075
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean8.919-8.818=0.100
σ0.194-0.390=-0.197
min8.606-8.283=0.324
max9.114-9.210=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean5001.134-5001.147=-0.013
σ0.026-0.030=-0.005
min5001.105-5001.113=-0.007
max5001.168-5001.187=-0.020
mean3003.200-3036.800=-33.600
σ318.399-199.371=119.029
min2591.000-2823.000=-232.000
max3408.000-3322.000=86.000
mean9.722-9.797=-0.075
σ0.233-0.253=-0.020
min9.319-9.547=-0.227
max9.882-10.217=-0.335

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.350-0.940=0.410
σ0.350-0.060=0.290
min1.048-0.904=0.144
max1.853-1.045=0.808

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.562=0.001
σ574.779-574.767=0.012
min177.170-177.177=-0.006
max1326.732-1326.712=0.020
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean0.550-0.434=0.116
σ0.551-0.304=0.247
min0.272-0.278=-0.006
max1.376-0.889=0.487
policies=20
mean1772.019-1772.045=-0.026
σ0.349-0.353=-0.004
min1771.796-1771.811=-0.014
max1772.538-1772.569=-0.032
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean2.706-2.776=-0.069
σ0.012-0.007=0.005
min2.693-2.770=-0.076
max2.718-2.787=-0.068
policies=200
mean17727.501-17727.652=-0.151
σ0.446-0.506=-0.060
min17727.072-17727.321=-0.249
max17728.128-17728.399=-0.271
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2823.000=-232.000
σ0.000
min2591.000-2823.000=-232.000
max2591.000-2823.000=-232.000
mean27.474-27.875=-0.400
σ0.232-0.441=-0.209
min27.270-27.497=-0.227
max27.785-28.389=-0.604