Compare commits

Home / Compare e13e8c36 .. bff51cda

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.868
σ0.106
min34.823
max35.169
mean416.000
σ0.000
min416.000
max416.000
mean0.072
σ0.004
min0.068
max0.081
cache=y
dps=1
iters=10
policies=100
mean26.052
σ0.003
min26.045
max26.057
mean416.000
σ0.000
min416.000
max416.000
mean0.061
σ0.002
min0.059
max0.067

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.041-1752.988=3.053
σ0.365-0.362=0.004
min1755.463-1752.413=3.050
max1756.629-1753.579=3.050
mean1670.850-1666.700=4.150
σ630.612-636.184=-5.572
min670.000-620.000=50.000
max2626.000-2707.000=-81.000
mean2.830-2.760=0.070
σ0.127-0.204=-0.077
min2.527-2.211=0.316
max3.070-2.949=0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.330-275.506=1.825
σ0.005-0.009=-0.004
min277.326-275.497=1.829
max277.337-275.517=1.820
mean2626.000-2707.000=-81.000
σ0.000
min2626.000-2707.000=-81.000
max2626.000-2707.000=-81.000
mean0.406-0.413=-0.006
σ0.008-0.001=0.008
min0.401-0.412=-0.011
max0.421-0.414=0.007
iters=5
new-facts=1
prior-facts=6402
mean2174.575-2263.979=-89.405
σ0.020-0.018=0.002
min2174.560-2263.948=-89.388
max2174.609-2263.993=-89.385
mean2626.000-2707.000=-81.000
σ0.000
min2626.000-2707.000=-81.000
max2626.000-2707.000=-81.000
mean3.028-3.197=-0.170
σ0.125-0.177=-0.052
min2.849-3.062=-0.213
max3.150-3.467=-0.317
iters=5
new-facts=6402
prior-facts=1
mean5052.612-4951.976=100.635
σ1.069-0.826=0.243
min5051.879-4951.541=100.338
max5054.493-4953.450=101.043
mean2626.000-2707.000=-81.000
σ0.000
min2626.000-2707.000=-81.000
max2626.000-2707.000=-81.000
mean8.978-7.942=1.036
σ0.564-0.371=0.193
min8.166-7.690=0.477
max9.526-8.574=0.952
iters=5
new-facts=6402
prior-facts=6402
mean5188.558-5164.834=23.724
σ0.084-0.140=-0.056
min5188.488-5164.621=23.867
max5188.651-5164.982=23.669
mean3240.600-3466.200=-225.600
σ372.602-472.548=-99.946
min2717.000-2883.000=-166.000
max3693.000-4146.000=-453.000
mean9.030-9.364=-0.334
σ0.371-0.465=-0.094
min8.727-8.546=0.181
max9.676-9.630=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.339-1.050=0.289
σ0.281-0.138=0.143
min1.082-0.933=0.150
max1.640-1.271=0.369

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.058-455.855=9.203
σ572.659-572.606=0.052
min178.726-169.550=9.176
max1324.046-1314.764=9.282
mean79.500
σ7.000
min76.000
max90.000
mean2626.000-431.500=2194.500
σ0.000-0.577=-0.577
min2626.000-431.000=2195.000
max2626.000-432.000=2194.000
mean0.564-0.540=0.024
σ0.561-0.529=0.031
min0.281-0.263=0.018
max1.405-1.334=0.071
policies=20
mean1787.530-1695.999=91.531
σ0.343-0.296=0.047
min1787.297-1695.788=91.509
max1788.039-1696.434=91.604
mean760.000
σ0.000
min760.000
max760.000
mean2626.000-444.500=2181.500
σ0.000-11.240=-11.240
min2626.000-432.000=2194.000
max2626.000-454.000=2172.000
mean2.795-2.623=0.172
σ0.016-0.018=-0.002
min2.776-2.607=0.169
max2.814-2.648=0.167
policies=200
mean17881.890-16969.525=912.365
σ0.467-0.057=0.411
min17881.562-16969.446=912.116
max17882.576-16969.580=912.996
mean7600.000
σ0.000
min7600.000
max7600.000
mean2626.000-490.500=2135.500
σ0.000-3.000=-3.000
min2626.000-487.000=2139.000
max2626.000-493.000=2133.000
mean28.256-26.310=1.945
σ0.083-0.089=-0.006
min28.179-26.241=1.938
max28.331-26.429=1.902