Compare commits

Home / Compare b6330a1b .. 1d77e8fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.951=0.022
σ0.107-0.103=0.004
min35.922-35.905=0.017
max36.276-36.243=0.033
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.076=0.002
σ0.004-0.003=0.000
min0.075-0.074=0.001
max0.085-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.200=0.008
σ0.002-0.004=-0.002
min26.204-26.192=0.012
max26.211-26.209=0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.061=0.000
σ0.003-0.002=0.000
min0.059-0.059=-0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1756.299=2.063
σ0.372-0.367=0.004
min1757.786-1755.724=2.062
max1758.961-1756.889=2.072
mean1655.150-1655.700=-0.550
σ620.424-641.124=-20.700
min685.000-610.000=75.000
max2746.000-2617.000=129.000
mean2.368-2.364=0.004
σ0.114-0.171=-0.057
min2.178-2.148=0.030
max2.634-2.988=-0.354

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-278.818=0.694
σ0.007-0.006=0.001
min279.503-278.809=0.694
max279.517-278.823=0.695
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean0.409-0.413=-0.004
σ0.002-0.006=-0.005
min0.405-0.407=-0.002
max0.410-0.423=-0.013
iters=5
new-facts=1
prior-facts=6402
mean2178.418-2268.878=-90.460
σ0.034-0.008=0.026
min2178.359-2268.866=-90.507
max2178.443-2268.889=-90.446
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean3.432-2.973=0.459
σ0.172-0.116=0.056
min3.271-2.881=0.390
max3.620-3.163=0.457
iters=5
new-facts=6402
prior-facts=1
mean5056.392-4954.197=102.195
σ1.004-0.863=0.140
min5055.790-4953.693=102.097
max5058.177-4955.735=102.442
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean8.715-8.272=0.443
σ0.657-0.217=0.441
min8.163-7.939=0.224
max9.736-8.490=1.246
iters=5
new-facts=6402
prior-facts=6402
mean5193.689-5168.720=24.969
σ0.212-0.195=0.017
min5193.338-5168.397=24.941
max5193.874-5168.878=24.997
mean3285.800-3442.400=-156.600
σ404.146-463.570=-59.424
min2746.000-2867.000=-121.000
max3673.000-4114.000=-441.000
mean8.832-9.277=-0.445
σ0.095-0.126=-0.031
min8.705-9.142=-0.436
max8.970-9.442=-0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.267=-0.266
σ0.072-0.409=-0.337
min0.937-0.939=-0.002
max1.080-1.880=-0.801

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-459.806=5.670
σ572.661-571.598=1.063
min179.137-174.000=5.138
max1324.468-1317.203=7.264
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean0.474-0.534=-0.060
σ0.379-0.532=-0.154
min0.282-0.265=0.018
max1.042-1.332=-0.290
policies=20
mean1791.671-1740.288=51.383
σ0.340-0.323=0.017
min1791.474-1740.088=51.386
max1792.178-1740.770=51.408
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean2.818-2.685=0.133
σ0.006-0.016=-0.009
min2.811-2.670=0.141
max2.824-2.706=0.118
policies=200
mean17923.168-17410.001=513.167
σ0.510-0.428=0.083
min17922.880-17409.714=513.166
max17923.933-17410.631=513.302
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2617.000=129.000
σ0.000
min2746.000-2617.000=129.000
max2746.000-2617.000=129.000
mean28.237-27.070=1.167
σ0.094-0.051=0.043
min28.152-27.008=1.144
max28.368-27.132=1.236