Compare commits

Home / Compare e2c7318e .. 279065e0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.612-35.613=-0.001
σ0.053-0.054=-0.001
min35.586-35.588=-0.002
max35.763-35.766=-0.003
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.084-0.086=-0.002
σ0.005-0.004=0.001
min0.077-0.083=-0.006
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.042-24.042=0.000
σ0.003-0.003=-0.000
min24.036-24.036=-0.000
max24.047-24.047=-0.000
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.067-0.069=-0.002
σ0.001-0.003=-0.002
min0.066-0.066=-0.001
max0.068-0.076=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.495-1756.493=0.002
σ0.365-0.365=0.001
min1755.919-1755.920=-0.001
max1757.081-1757.085=-0.004
mean1627.550-1665.000=-37.450
σ592.405-647.311=-54.906
min640.000-633.000=7.000
max2425.000-2818.000=-393.000
mean2.355-2.379=-0.024
σ0.091-0.122=-0.031
min2.246-2.272=-0.027
max2.618-2.834=-0.216

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.752-324.774=-0.021
σ0.042-0.040=0.002
min324.683-324.702=-0.020
max324.797-324.799=-0.002
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean0.425-0.430=-0.005
σ0.005-0.010=-0.005
min0.421-0.422=-0.002
max0.431-0.446=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.323=0.003
σ0.008-0.014=-0.007
min1985.316-1985.300=0.015
max1985.333-1985.338=-0.005
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean2.640-2.661=-0.021
σ0.096-0.121=-0.025
min2.569-2.559=0.010
max2.794-2.824=-0.030
iters=5
new-facts=6402
prior-facts=1
mean4810.062-4810.190=-0.128
σ7.756-7.633=0.123
min4806.362-4806.623=-0.261
max4823.934-4823.844=0.090
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean8.678-8.532=0.146
σ0.613-0.658=-0.045
min7.773-7.766=0.007
max9.421-9.229=0.192
iters=5
new-facts=6402
prior-facts=6402
mean4997.572-4997.714=-0.142
σ0.310-0.023=0.287
min4997.020-4997.685=-0.665
max4997.742-4997.737=0.005
mean2980.200-3021.800=-41.600
σ301.935-260.947=40.988
min2591.000-2818.000=-227.000
max3369.000-3423.000=-54.000
mean8.615-8.739=-0.125
σ0.087-0.233=-0.146
min8.494-8.514=-0.020
max8.706-9.081=-0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.740-0.979=0.761
σ0.213-0.070=0.142
min1.366-0.919=0.447
max1.869-1.064=0.805

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.212-463.227=-0.016
σ574.767-574.771=-0.003
min175.825-175.834=-0.009
max1325.362-1325.383=-0.021
mean86.250
σ8.500
min82.000
max99.000
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean0.570-0.435=0.135
σ0.595-0.299=0.296
min0.270-0.282=-0.011
max1.462-0.884=0.578
policies=20
mean1758.583-1758.638=-0.055
σ0.314-0.349=-0.035
min1758.365-1758.385=-0.020
max1759.047-1759.152=-0.105
mean820.000
σ0.000
min820.000
max820.000
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean2.693-2.798=-0.105
σ0.008-0.010=-0.002
min2.686-2.784=-0.098
max2.704-2.807=-0.103
policies=200
mean17593.099-17593.224=-0.125
σ0.520-0.487=0.033
min17592.746-17592.962=-0.216
max17593.856-17593.954=-0.098
mean8200.000
σ0.000
min8200.000
max8200.000
mean2425.000-2818.000=-393.000
σ0.000
min2425.000-2818.000=-393.000
max2425.000-2818.000=-393.000
mean27.274-27.584=-0.310
σ0.125-0.168=-0.043
min27.117-27.387=-0.270
max27.415-27.793=-0.377