Compare commits

Home / Compare 264e0ede .. b7d99988

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.049-0.049=0.000
min33.949-33.947=0.001
max34.114-34.114=-0.000
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.085-0.083=0.002
σ0.003-0.004=-0.001
min0.082-0.077=0.005
max0.091-0.089=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.003=0.000
min23.313-23.314=-0.001
max23.322-23.323=-0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.066-0.066=-0.000
σ0.002-0.002=-0.000
min0.064-0.064=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1758.252=-0.759
σ0.365-0.365=-0.000
min1756.920-1757.678=-0.758
max1758.082-1758.843=-0.761
mean1645.900-1647.550=-1.650
σ625.838-625.413=0.425
min634.000-637.000=-3.000
max2833.000-2838.000=-5.000
mean2.364-2.388=-0.023
σ0.079-0.096=-0.017
min2.199-2.257=-0.059
max2.569-2.705=-0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.634-327.399=-0.766
σ0.058-0.050=0.008
min326.530-327.311=-0.781
max326.668-327.434=-0.766
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean0.428-0.427=0.001
σ0.011-0.004=0.007
min0.423-0.423=-0.000
max0.447-0.433=0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.802-1989.560=-0.758
σ0.012-0.015=-0.003
min1988.789-1989.536=-0.747
max1988.815-1989.576=-0.761
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean2.723-2.696=0.027
σ0.099-0.093=0.006
min2.605-2.576=0.029
max2.831-2.835=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4813.421-4814.308=-0.886
σ7.858-7.831=0.027
min4809.546-4810.416=-0.871
max4827.468-4828.310=-0.842
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean8.827-8.502=0.325
σ0.287-0.470=-0.184
min8.513-7.756=0.757
max9.152-9.045=0.107
iters=5
new-facts=6402
prior-facts=6402
mean5001.220-5001.969=-0.749
σ0.027-0.025=0.002
min5001.181-5001.939=-0.758
max5001.248-5002.007=-0.759
mean3045.800-3053.600=-7.800
σ210.851-224.002=-13.151
min2833.000-2838.000=-5.000
max3352.000-3372.000=-20.000
mean9.989-9.830=0.159
σ0.319-0.185=0.135
min9.655-9.539=0.117
max10.375-9.993=0.382

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.955=0.017
σ0.062-0.060=0.001
min0.914-0.917=-0.003
max1.040-1.060=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-466.147=-1.513
σ574.772-574.773=-0.001
min177.239-178.754=-1.514
max1326.792-1328.307=-1.515
mean88.250-90.250=-2.000
σ8.500
min84.000-86.000=-2.000
max101.000-103.000=-2.000
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean0.429-0.441=-0.013
σ0.292-0.308=-0.016
min0.279-0.285=-0.006
max0.866-0.903=-0.036
policies=20
mean1772.702-1787.880=-15.179
σ0.359-0.380=-0.021
min1772.450-1787.617=-15.167
max1773.232-1788.441=-15.209
mean840.000-860.000=-20.000
σ0.000
min840.000-860.000=-20.000
max840.000-860.000=-20.000
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean2.799-2.822=-0.023
σ0.014-0.014=-0.001
min2.786-2.808=-0.021
max2.818-2.841=-0.023
policies=200
mean17734.063-17885.598=-151.535
σ0.440-0.340=0.100
min17733.570-17885.117=-151.547
max17734.642-17885.910=-151.268
mean8400.000-8600.000=-200.000
σ0.000
min8400.000-8600.000=-200.000
max8400.000-8600.000=-200.000
mean2833.000-2838.000=-5.000
σ0.000
min2833.000-2838.000=-5.000
max2833.000-2838.000=-5.000
mean28.018-28.287=-0.270
σ0.450-0.411=0.039
min27.576-27.935=-0.359
max28.540-28.719=-0.179