Compare commits

Home / Compare a052f6af .. 2db0d24f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.981-33.980=0.001
σ0.048-0.048=0.001
min33.953-33.953=0.000
max34.116-34.111=0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.086-0.084=0.002
σ0.003-0.003=0.000
min0.083-0.082=0.002
max0.091-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.003-0.003=-0.000
min23.315-23.315=0.000
max23.324-23.325=-0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.066-0.065=0.000
σ0.003-0.002=0.001
min0.061-0.064=-0.003
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.427-1757.428=-0.001
σ0.364-0.365=-0.000
min1756.854-1756.853=0.001
max1758.017-1758.016=0.001
mean1671.050-1660.800=10.250
σ643.789-621.225=22.564
min677.000-669.000=8.000
max2649.000-2589.000=60.000
mean2.394-2.372=0.022
σ0.115-0.109=0.006
min2.272-2.255=0.016
max2.682-2.683=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.564-326.575=-0.011
σ0.058-0.041=0.017
min326.460-326.505=-0.045
max326.598-326.615=-0.017
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean0.433-0.428=0.005
σ0.002-0.005=-0.003
min0.430-0.423=0.007
max0.435-0.434=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.739=-0.000
σ0.010-0.012=-0.002
min1988.724-1988.721=0.003
max1988.749-1988.751=-0.002
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean2.690-2.739=-0.050
σ0.036-0.130=-0.094
min2.668-2.623=0.046
max2.753-2.955=-0.201
iters=5
new-facts=6402
prior-facts=1
mean4813.658-4813.457=0.201
σ7.740-7.795=-0.055
min4810.038-4809.536=0.502
max4827.504-4827.394=0.109
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean8.408-8.836=-0.428
σ0.760-0.289=0.471
min7.884-8.512=-0.627
max9.718-9.243=0.475
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5001.139=0.007
σ0.026-0.021=0.005
min5001.112-5001.113=-0.001
max5001.172-5001.162=0.010
mean2970.600-3029.200=-58.600
σ365.137-322.845=42.292
min2649.000-2589.000=60.000
max3502.000-3335.000=167.000
mean9.909-9.841=0.067
σ0.097-0.154=-0.057
min9.833-9.639=0.194
max10.068-9.962=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.143-1.248=-0.105
σ0.372-0.352=0.021
min0.919-0.946=-0.027
max1.788-1.802=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.567=-0.001
σ574.775-574.792=-0.017
min177.168-177.165=0.002
max1326.729-1326.755=-0.026
mean88.250
σ8.500
min84.000
max101.000
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean0.533-0.552=-0.019
σ0.510-0.558=-0.047
min0.275-0.271=0.004
max1.298-1.388=-0.090
policies=20
mean1772.037-1772.016=0.021
σ0.366-0.360=0.007
min1771.784-1771.772=0.012
max1772.579-1772.549=0.030
mean840.000
σ0.000
min840.000
max840.000
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean2.795-2.767=0.028
σ0.028-0.050=-0.022
min2.772-2.717=0.055
max2.835-2.819=0.016
policies=200
mean17727.635-17727.465=0.170
σ0.533-0.599=-0.066
min17727.313-17727.085=0.228
max17728.432-17728.356=0.076
mean8400.000
σ0.000
min8400.000
max8400.000
mean2649.000-2589.000=60.000
σ0.000
min2649.000-2589.000=60.000
max2649.000-2589.000=60.000
mean28.041-27.545=0.496
σ0.225-0.117=0.108
min27.859-27.409=0.449
max28.350-27.694=0.656