Compare commits

Home / Compare 02238982 .. dc762aa0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.987=-0.001
σ0.054-0.054=0.000
min33.958-33.956=0.002
max34.140-34.140=-0.001
mean416.600-417.000=-0.400
σ0.516-0.000=0.516
min416.000-417.000=-1.000
max417.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.083=-0.001
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.324-23.326=-0.002
σ0.003-0.003=0.000
min23.320-23.321=-0.002
max23.330-23.332=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.065-0.066=-0.001
σ0.004-0.003=0.001
min0.062-0.065=-0.003
max0.073-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.726-1756.725=0.001
σ0.365-0.364=0.001
min1756.151-1756.150=0.001
max1757.320-1757.310=0.009
mean1645.000-1649.300=-4.300
σ637.517-632.304=5.213
min641.000-618.000=23.000
max2865.000-2731.000=134.000
mean2.375-2.394=-0.018
σ0.095-0.125=-0.030
min2.265-2.267=-0.002
max2.651-2.819=-0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.327-325.323=0.004
σ0.036-0.045=-0.009
min325.264-325.243=0.021
max325.354-325.350=0.004
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean0.426-0.431=-0.005
σ0.002-0.007=-0.005
min0.423-0.424=-0.001
max0.430-0.440=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.880-1985.878=0.002
σ0.005-0.009=-0.004
min1985.874-1985.863=0.011
max1985.886
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean2.709-2.682=0.028
σ0.108-0.052=0.056
min2.651-2.613=0.038
max2.901-2.735=0.166
iters=5
new-facts=6402
prior-facts=1
mean4809.642-4809.524=0.119
σ7.688-7.746=-0.058
min4806.150-4805.668=0.482
max4823.396-4823.374=0.021
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean9.008-8.839=0.169
σ0.302-0.169=0.134
min8.716-8.637=0.079
max9.478-8.966=0.512
iters=5
new-facts=6402
prior-facts=6402
mean4997.044-4997.182=-0.138
σ0.330-0.021=0.309
min4996.454-4997.159=-0.705
max4997.215-4997.210=0.005
mean3100.400-3025.800=74.600
σ245.939-267.057=-21.118
min2865.000-2731.000=134.000
max3355.000-3389.000=-34.000
mean9.038-8.650=0.388
σ0.534-0.212=0.323
min8.457-8.474=-0.017
max9.818-9.001=0.817

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.965-0.979=-0.014
σ0.070-0.065=0.004
min0.908-0.922=-0.015
max1.042-1.054=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.378-463.377=0.001
σ574.773-574.769=0.004
min175.980-175.984=-0.004
max1325.537-1325.530=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean0.472-0.539=-0.067
σ0.376-0.533=-0.157
min0.280-0.270=0.010
max1.036-1.339=-0.303
policies=20
mean1760.162-1760.142=0.021
σ0.352-0.352=-0.000
min1759.917-1759.924=-0.008
max1760.680-1760.667=0.013
mean820.000
σ0.000
min820.000
max820.000
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean2.813-2.731=0.083
σ0.015-0.014=0.001
min2.796-2.714=0.082
max2.833-2.749=0.084
policies=200
mean17608.440-17608.393=0.047
σ0.482-0.511=-0.029
min17608.069-17608.084=-0.015
max17609.148-17609.156=-0.008
mean8200.000
σ0.000
min8200.000
max8200.000
mean2865.000-2731.000=134.000
σ0.000
min2865.000-2731.000=134.000
max2865.000-2731.000=134.000
mean27.968-27.588=0.380
σ0.417-0.130=0.287
min27.592-27.452=0.139
max28.393-27.757=0.636