Compare commits

Home / Compare b63b03c7 .. f6b8c529

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.973=-0.174
σ0.108-0.108=-0.000
min35.753-35.924=-0.172
max36.105-36.279=-0.174
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.073-0.078=-0.004
σ0.004-0.004=-0.000
min0.068-0.074=-0.005
max0.080-0.086=-0.005
cache=y
dps=1
iters=10
policies=100
mean26.065-26.208=-0.143
σ0.002-0.004=-0.002
min26.062-26.202=-0.140
max26.069-26.216=-0.147
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.061-0.061=-0.001
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.068-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1758.363=-2.442
σ0.370-0.372=-0.002
min1755.352-1757.786=-2.434
max1756.518-1758.965=-2.447
mean1666.200-1659.450=6.750
σ630.062-621.733=8.329
min665.000-690.000=-25.000
max2621.000-2760.000=-139.000
mean2.819-2.394=0.424
σ0.180-0.114=0.066
min2.290-2.287=0.003
max3.111-2.665=0.446

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-279.498=-2.305
σ0.004-0.016=-0.012
min277.190-279.480=-2.290
max277.197-279.514=-2.317
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean0.396-0.410=-0.014
σ0.004-0.002=0.002
min0.393-0.407=-0.015
max0.403-0.414=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2174.432-2178.423=-3.991
σ0.012-0.032=-0.020
min2174.415-2178.378=-3.963
max2174.449-2178.465=-4.017
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean3.050-3.432=-0.383
σ0.225-0.087=0.138
min2.830-3.291=-0.461
max3.333-3.517=-0.184
iters=5
new-facts=6402
prior-facts=1
mean5052.580-5056.380=-3.800
σ0.970-0.979=-0.009
min5052.020-5055.815=-3.795
max5054.305-5058.125=-3.820
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean9.005-8.860=0.145
σ0.328-0.612=-0.284
min8.538-8.061=0.478
max9.336-9.556=-0.220
iters=5
new-facts=6402
prior-facts=6402
mean5188.422-5193.747=-5.326
σ0.095-0.101=-0.006
min5188.335-5193.641=-5.306
max5188.525-5193.857=-5.333
mean3269.800-3296.000=-26.200
σ386.731-400.590=-13.859
min2729.000-2760.000=-31.000
max3741.000-3680.000=61.000
mean9.225-8.879=0.346
σ0.531-0.169=0.362
min8.729-8.611=0.118
max9.795-9.049=0.746

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.307-0.969=0.338
σ0.332-0.054=0.278
min0.940-0.937=0.003
max1.783-1.064=0.719

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-465.478=-0.622
σ572.660-572.662=-0.002
min178.520-179.140=-0.620
max1323.846-1324.471=-0.625
mean79.500
σ7.000
min76.000
max90.000
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean0.549-0.480=0.069
σ0.534-0.397=0.137
min0.279-0.279=-0.000
max1.350-1.075=0.274
policies=20
mean1785.488-1791.671=-6.183
σ0.347-0.339=0.008
min1785.259-1791.476=-6.217
max1786.004-1792.177=-6.173
mean760.000
σ0.000
min760.000
max760.000
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean2.807-2.811=-0.004
σ0.004-0.017=-0.013
min2.801-2.790=0.011
max2.811-2.827=-0.015
policies=200
mean17861.430-17923.160=-61.731
σ0.617-0.313=0.304
min17861.094-17922.894=-61.800
max17862.355-17923.612=-61.257
mean7600.000
σ0.000
min7600.000
max7600.000
mean2621.000-2760.000=-139.000
σ0.000
min2621.000-2760.000=-139.000
max2621.000-2760.000=-139.000
mean28.358-28.333=0.025
σ0.208-0.123=0.085
min28.147-28.220=-0.073
max28.636-28.453=0.184