Compare commits

Home / Compare 82be9b55 .. d3e0d67c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.648=-0.001
σ0.368-0.367=0.001
min53.507-53.520=-0.013
max54.694-54.692=0.002
mean413.000-419.300=-6.300
σ0.000-0.483=-0.483
min413.000-419.000=-6.000
max413.000-420.000=-7.000
mean0.136-0.139=-0.003
σ0.006-0.004=0.002
min0.129-0.136=-0.007
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.946-42.941=0.005
σ0.014-0.005=0.009
min42.928-42.933=-0.004
max42.981-42.948=0.034
mean413.000-420.000=-7.000
σ0.000
min413.000-420.000=-7.000
max413.000-420.000=-7.000
mean0.121-0.117=0.003
σ0.004-0.004=0.001
min0.114-0.113=0.000
max0.128-0.124=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.861-991.864=-0.004
σ1.218-1.207=0.010
min991.324-991.331=-0.006
max996.965-996.918=0.047
mean1063.950-1067.000=-3.050
σ324.507-318.964=5.543
min600.000-595.000=5.000
max1637.000-1558.000=79.000
mean1.531-1.537=-0.006
σ0.105-0.067=0.039
min1.441-1.460=-0.019
max1.777-1.652=0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.440-285.436=0.004
σ0.007-0.010=-0.002
min285.434-285.421=0.013
max285.450-285.447=0.003
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean0.381-0.380=0.001
σ0.017-0.008=0.010
min0.372-0.374=-0.002
max0.412-0.389=0.022
iters=5
new-facts=1
prior-facts=6402
mean1285.510-1285.515=-0.005
σ0.071-0.092=-0.021
min1285.402-1285.351=0.051
max1285.575-1285.565=0.010
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean1.825-2.008=-0.183
σ0.108-0.213=-0.105
min1.712-1.827=-0.115
max2.003-2.322=-0.318
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1705.821=0.008
σ6.855-6.862=-0.007
min1702.642-1702.598=0.043
max1718.089-1718.093=-0.004
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean2.886-3.223=-0.337
σ0.291-0.216=0.075
min2.544-2.937=-0.393
max3.329-3.427=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean1968.424-1968.412=0.012
σ0.032-0.032=-0.001
min1968.374-1968.355=0.019
max1968.453-1968.431=0.022
mean1790.800-1808.200=-17.400
σ165.355-227.405=-62.051
min1637.000-1558.000=79.000
max2017.000-2124.000=-107.000
mean3.308-3.367=-0.059
σ0.370-0.376=-0.006
min3.053-3.131=-0.078
max3.963-4.035=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.273-1.566=-0.293
σ0.281-0.262=0.019
min0.981-1.226=-0.245
max1.606-1.801=-0.195

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.777-436.765=0.012
σ572.366-572.352=0.014
min150.592-150.586=0.006
max1295.326-1295.293=0.033
mean90.250
σ8.500
min86.000
max103.000
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean0.516-0.525=-0.010
σ0.533-0.550=-0.017
min0.246-0.249=-0.003
max1.315-1.350=-0.034
policies=20
mean1506.178-1506.166=0.013
σ0.230-0.250=-0.020
min1506.023-1505.995=0.028
max1506.521-1506.537=-0.016
mean860.000
σ0.000
min860.000
max860.000
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean2.505-2.533=-0.028
σ0.019-0.023=-0.004
min2.480-2.503=-0.024
max2.526-2.559=-0.033
policies=200
mean15069.430-15069.476=-0.046
σ0.097-0.103=-0.006
min15069.306-15069.388=-0.083
max15069.529-15069.588=-0.059
mean8600.000
σ0.000
min8600.000
max8600.000
mean1637.000-1558.000=79.000
σ0.000
min1637.000-1558.000=79.000
max1637.000-1558.000=79.000
mean25.331-25.507=-0.177
σ0.101-0.088=0.013
min25.236-25.415=-0.179
max25.419-25.588=-0.169