Compare commits

Home / Compare 2b43d4f4 .. 0bb59668

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.773-70.775=-0.002
σ0.053-0.051=0.002
min70.740-70.744=-0.004
max70.919-70.916=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.159-0.161=-0.002
σ0.004-0.003=0.001
min0.155-0.158=-0.004
max0.166-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.490-21.490=-0.000
σ0.002-0.002=0.000
min21.487-21.488=-0.001
max21.493-21.493=-0.000
mean417.000
σ0.000
min417.000
max417.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.001
min0.063-0.064=-0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1755.288=-0.002
σ0.357-0.360=-0.003
min1754.724-1754.711=0.013
max1755.851-1755.870=-0.019
mean1629.400-1646.300=-16.900
σ593.982-602.242=-8.260
min640.000-634.000=6.000
max2421.000-2455.000=-34.000
mean2.820-2.838=-0.018
σ0.219-0.163=0.057
min2.277-2.396=-0.119
max3.182-3.085=0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.769-272.769=0.000
σ0.008-0.008=0.000
min272.758-272.756=0.002
max272.778-272.775=0.002
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean0.383-0.384=-0.000
σ0.005-0.006=-0.000
min0.379-0.378=0.001
max0.390-0.391=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1933.154=0.004
σ0.021-0.003=0.019
min1933.124-1933.151=-0.027
max1933.177-1933.157=0.020
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean3.127-3.095=0.032
σ0.152-0.138=0.013
min2.953-2.992=-0.039
max3.352-3.321=0.031
iters=5
new-facts=6402
prior-facts=1
mean4753.937-4753.684=0.253
σ0.824-1.052=-0.229
min4753.521-4752.467=1.054
max4755.409-4755.374=0.035
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean8.342-8.446=-0.104
σ0.336-0.386=-0.050
min7.765-7.890=-0.125
max8.557-8.933=-0.376
iters=5
new-facts=6402
prior-facts=6402
mean4944.317-4944.387=-0.070
σ0.163-0.018=0.145
min4944.027-4944.371=-0.343
max4944.409-4944.415=-0.005
mean2906.800-2963.600=-56.800
σ406.809-274.965=131.844
min2438.000-2598.000=-160.000
max3461.000-3321.000=140.000
mean8.498-8.511=-0.013
σ0.168-0.052=0.116
min8.343-8.431=-0.088
max8.781-8.576=0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.616=0.139
σ0.226-0.109=0.117
min1.362-1.509=-0.147
max1.913-1.758=0.155

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.833-472.836=-0.002
σ574.920-574.928=-0.008
min185.368-185.370=-0.002
max1335.213-1335.228=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean0.583-0.547=0.036
σ0.593-0.517=0.077
min0.284-0.288=-0.004
max1.473-1.322=0.151
policies=20
mean1853.967-1853.995=-0.028
σ0.372-0.373=-0.001
min1853.719-1853.740=-0.022
max1854.518-1854.546=-0.028
mean840.000
σ0.000
min840.000
max840.000
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean2.851-2.873=-0.023
σ0.016-0.019=-0.003
min2.827-2.854=-0.027
max2.864-2.898=-0.034
policies=200
mean18546.668-18546.670=-0.002
σ0.418-0.394=0.024
min18546.378-18546.314=0.064
max18547.287-18547.226=0.061
mean8400.000
σ0.000
min8400.000
max8400.000
mean2421.000-2455.000=-34.000
σ0.000
min2421.000-2455.000=-34.000
max2421.000-2455.000=-34.000
mean28.819-28.820=-0.000
σ0.072-0.098=-0.026
min28.732-28.685=0.047
max28.882-28.919=-0.037