Compare commits

Home / Compare d29ca17f .. 7f278d34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.847-34.477=-1.630
σ0.371-0.369=0.002
min32.710-34.350=-1.640
max33.902-35.527=-1.625
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.084-0.082=0.002
σ0.004-0.004=-0.000
min0.082-0.078=0.004
max0.093-0.088=0.005
cache=y
dps=1
iters=10
policies=100
mean22.088-22.810=-0.722
σ0.003-0.003=0.000
min22.081-22.806=-0.725
max22.092-22.815=-0.723
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.001
min0.064-0.061=0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1733.175-1732.939=0.237
σ1.032-1.042=-0.009
min1732.407-1732.163=0.244
max1737.321-1737.125=0.195
mean1655.650-1668.450=-12.800
σ628.864-637.856=-8.992
min671.000-675.000=-4.000
max2714.000-2756.000=-42.000
mean2.725-2.766=-0.041
σ0.286-0.176=0.110
min2.253-2.245=0.008
max3.136-3.008=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean292.658-292.100=0.558
σ0.008-0.006=0.002
min292.649-292.092=0.557
max292.670-292.107=0.563
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean0.400-0.394=0.006
σ0.005-0.001=0.003
min0.396-0.392=0.004
max0.408-0.395=0.013
iters=5
new-facts=1
prior-facts=6402
mean1953.039-1952.480=0.560
σ0.035-0.030=0.005
min1952.977-1952.432=0.546
max1953.059-1952.509=0.551
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean2.855-2.646=0.209
σ0.082-0.234=-0.152
min2.759-2.412=0.347
max2.979-3.025=-0.046
iters=5
new-facts=6402
prior-facts=1
mean2749.245-2748.694=0.551
σ7.179-7.204=-0.025
min2745.906-2745.349=0.558
max2762.081-2761.575=0.505
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean5.593-5.368=0.225
σ0.291-0.475=-0.183
min5.112-4.829=0.282
max5.888-5.808=0.081
iters=5
new-facts=6402
prior-facts=6402
mean2936.107-2935.558=0.549
σ0.040-0.040=0.001
min2936.069-2935.521=0.548
max2936.176-2935.625=0.550
mean3051.200-2968.800=82.400
σ287.087-284.978=2.109
min2714.000-2756.000=-42.000
max3317.000-3422.000=-105.000
mean6.015-5.706=0.309
σ0.379-0.189=0.190
min5.592-5.497=0.095
max6.553-5.939=0.615

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.070=-0.049
σ0.245-0.227=0.018
min0.910-0.903=0.007
max1.459-1.459=0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.058-435.889=0.169
σ572.823-572.824=-0.001
min149.634-149.468=0.166
max1295.292-1295.124=0.168
mean86.250
σ8.500
min82.000
max99.000
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean0.525-0.511=0.014
σ0.558-0.526=0.032
min0.246-0.247=-0.001
max1.362-1.300=0.061
policies=20
mean1496.576-1494.947=1.630
σ0.208-0.202=0.006
min1496.416-1494.792=1.624
max1496.878-1495.239=1.639
mean820.000
σ0.000
min820.000
max820.000
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean2.491-2.483=0.008
σ0.018-0.019=-0.001
min2.473-2.460=0.013
max2.515-2.504=0.011
policies=200
mean14973.241-14957.140=16.101
σ0.580-0.487=0.093
min14972.895-14956.872=16.023
max14974.109-14957.869=16.239
mean8200.000
σ0.000
min8200.000
max8200.000
mean2714.000-2756.000=-42.000
σ0.000
min2714.000-2756.000=-42.000
max2714.000-2756.000=-42.000
mean25.166-25.092=0.074
σ0.121-0.092=0.028
min25.075-25.016=0.060
max25.341-25.226=0.114