Compare commits

Home / Compare d4e0284b .. 0da7a425

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.384=0.009
σ0.046-0.047=-0.002
min70.371-70.356=0.014
max70.522-70.517=0.006
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.159=0.001
σ0.003-0.003=-0.000
min0.156-0.155=0.001
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.002
σ0.003-0.002=0.001
min21.137-21.137=-0.000
max21.148-21.146=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.001
min0.062-0.063=-0.001
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=0.000
σ0.362-0.360=0.002
min1751.828-1751.824=0.004
max1752.977-1752.975=0.002
mean1660.550-1654.400=6.150
σ637.810-627.581=10.229
min625.000-618.000=7.000
max2814.000-2769.000=45.000
mean2.791-2.806=-0.015
σ0.136-0.190=-0.055
min2.495-2.322=0.173
max3.083-2.981=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.139=0.099
σ0.009-0.009=0.000
min270.224-270.131=0.093
max270.246-270.154=0.093
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean0.382-0.377=0.005
σ0.008-0.004=0.004
min0.374-0.371=0.003
max0.396-0.382=0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.707-1930.607=0.100
σ0.006-0.007=-0.001
min1930.698-1930.596=0.102
max1930.714-1930.615=0.099
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean2.519-2.512=0.007
σ0.077-0.085=-0.008
min2.446-2.431=0.015
max2.613-2.654=-0.041
iters=5
new-facts=6402
prior-facts=1
mean4751.397-4751.332=0.064
σ0.845-0.888=-0.043
min4750.919-4750.819=0.101
max4752.898-4752.914=-0.016
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean8.436-8.413=0.024
σ0.450-0.465=-0.015
min7.862-7.741=0.121
max8.918-8.979=-0.061
iters=5
new-facts=6402
prior-facts=6402
mean4941.870-4941.699=0.171
σ0.019-0.144=-0.126
min4941.851-4941.443=0.408
max4941.894-4941.790=0.105
mean3029.000-3044.400=-15.400
σ215.841-235.302=-19.460
min2814.000-2769.000=45.000
max3319.000-3371.000=-52.000
mean8.552-8.680=-0.127
σ0.169-0.208=-0.039
min8.361-8.394=-0.033
max8.805-8.925=-0.120

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.019=0.001
σ0.138-0.117=0.021
min0.931-0.940=-0.009
max1.247-1.209=0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.371=0.385
σ575.926-575.930=-0.004
min178.786-178.400=0.386
max1330.645-1330.266=0.380
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean0.438-0.448=-0.010
σ0.302-0.304=-0.002
min0.283-0.293=-0.009
max0.891-0.904=-0.013
policies=20
mean1788.138-1784.336=3.802
σ0.360-0.336=0.024
min1787.892-1784.101=3.790
max1788.668-1784.823=3.845
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean2.881-2.847=0.033
σ0.108-0.128=-0.020
min2.766-2.780=-0.014
max3.026-3.040=-0.013
policies=200
mean17888.131-17849.503=38.628
σ0.443-0.490=-0.047
min17887.875-17849.216=38.659
max17888.792-17850.235=38.557
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2814.000-2769.000=45.000
σ0.000
min2814.000-2769.000=45.000
max2814.000-2769.000=45.000
mean28.028-28.008=0.020
σ0.096-0.113=-0.017
min27.958-27.882=0.075
max28.169-28.156=0.014