Compare commits

Home / Compare 5e67b3f4 .. acc85487

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.397-70.393=0.004
σ0.046-0.045=0.001
min70.373-70.369=0.004
max70.521-70.517=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.159-0.158=0.000
σ0.002-0.003=-0.001
min0.156-0.155=0.000
max0.162-0.163=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.148=-0.003
σ0.003-0.010=-0.007
min21.139-21.140=-0.001
max21.150-21.176=-0.026
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.064-0.059=0.005
σ0.004-0.005=-0.002
min0.061-0.047=0.013
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.395=0.001
σ0.362-0.360=0.002
min1751.820-1751.826=-0.006
max1752.991-1752.973=0.019
mean1657.300-1657.350=-0.050
σ629.725-629.837=-0.112
min618.000
max2775.000-2776.000=-1.000
mean2.849-2.872=-0.023
σ0.094-0.094=-0.000
min2.666-2.657=0.008
max3.055-3.081=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.240=-0.001
σ0.008-0.007=0.001
min270.228-270.234=-0.006
max270.251-270.250=0.001
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean0.378-0.379=-0.001
σ0.009-0.008=0.000
min0.369-0.372=-0.003
max0.393-0.393=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.700-1930.699=0.001
σ0.016-0.007=0.009
min1930.676-1930.694=-0.018
max1930.715-1930.706=0.008
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean2.536-2.543=-0.007
σ0.084-0.112=-0.028
min2.465-2.381=0.084
max2.651-2.661=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4751.381-4751.398=-0.017
σ0.859-0.848=0.012
min4750.877-4750.915=-0.038
max4752.912-4752.905=0.008
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean8.618-8.524=0.094
σ0.323-0.443=-0.120
min8.285-7.823=0.462
max9.136-8.944=0.192
iters=5
new-facts=6402
prior-facts=6402
mean4941.869-4941.796=0.072
σ0.018-0.139=-0.121
min4941.849-4941.548=0.301
max4941.893-4941.872=0.022
mean2998.800-3039.400=-40.600
σ226.992-250.597=-23.605
min2775.000-2776.000=-1.000
max3332.000-3383.000=-51.000
mean8.750-8.584=0.166
σ0.320-0.112=0.208
min8.424-8.493=-0.069
max9.120-8.710=0.410

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.026=-0.002
σ0.145-0.130=0.015
min0.925-0.939=-0.014
max1.261-1.235=0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.757-466.756=0.001
σ575.928-575.929=-0.002
min178.788-178.783=0.005
max1330.649-1330.650=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean0.446-0.443=0.003
σ0.309-0.309=-0.001
min0.289-0.285=0.004
max0.909-0.907=0.002
policies=20
mean1788.136-1788.139=-0.003
σ0.360-0.378=-0.018
min1787.903-1787.894=0.009
max1788.672-1788.700=-0.028
mean820.000
σ0.000
min820.000
max820.000
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean2.856-2.851=0.004
σ0.085-0.132=-0.047
min2.785-2.781=0.003
max2.969-3.050=-0.080
policies=200
mean17888.070-17888.176=-0.106
σ0.642-0.540=0.102
min17887.614-17887.871=-0.256
max17889.004-17888.984=0.020
mean8200.000
σ0.000
min8200.000
max8200.000
mean2775.000-2776.000=-1.000
σ0.000
min2775.000-2776.000=-1.000
max2775.000-2776.000=-1.000
mean28.196-28.043=0.153
σ0.347-0.135=0.212
min27.955-27.844=0.111
max28.709-28.143=0.566