Compare commits

Home / Compare 4963496f .. d3dc6a54

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.381=0.013
σ0.046-0.047=-0.001
min70.371-70.352=0.019
max70.522-70.509=0.013
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.159=0.001
σ0.003-0.009=-0.006
min0.156-0.150=0.006
max0.165-0.181=-0.015
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.002=0.001
min21.137-21.141=-0.004
max21.148-21.148=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.001
min0.062-0.062=0.000
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.387=0.007
σ0.362-0.361=0.000
min1751.828-1751.820=0.009
max1752.977-1752.973=0.004
mean1660.550-1651.400=9.150
σ637.810-642.373=-4.564
min625.000-631.000=-6.000
max2814.000-2847.000=-33.000
mean2.791-2.775=0.016
σ0.136-0.145=-0.009
min2.495-2.495=-0.000
max3.083-3.013=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.114=0.124
σ0.009-0.013=-0.003
min270.224-270.096=0.127
max270.246-270.133=0.114
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean0.382-0.375=0.007
σ0.008-0.004=0.004
min0.374-0.371=0.003
max0.396-0.381=0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.707-1930.589=0.118
σ0.006-0.017=-0.011
min1930.698-1930.564=0.134
max1930.714-1930.604=0.111
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean2.519-2.579=-0.060
σ0.077-0.115=-0.038
min2.446-2.430=0.016
max2.613-2.722=-0.109
iters=5
new-facts=6402
prior-facts=1
mean4751.397-4751.127=0.270
σ0.845-0.813=0.032
min4750.919-4750.667=0.252
max4752.898-4752.572=0.326
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean8.436-8.124=0.313
σ0.450-0.510=-0.060
min7.862-7.780=0.082
max8.918-9.016=-0.097
iters=5
new-facts=6402
prior-facts=6402
mean4941.870-4941.524=0.347
σ0.019-0.074=-0.055
min4941.851-4941.459=0.392
max4941.894-4941.604=0.291
mean3029.000-3081.600=-52.600
σ215.841-309.385=-93.543
min2814.000-2847.000=-33.000
max3319.000-3561.000=-242.000
mean8.552-8.382=0.171
σ0.169-0.141=0.028
min8.361-8.254=0.107
max8.805-8.621=0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.073=-0.053
σ0.138-0.108=0.030
min0.931-0.938=-0.007
max1.247-1.240=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.363=0.393
σ575.926-575.919=0.007
min178.786-178.394=0.392
max1330.645-1330.242=0.404
mean86.250-84.000=2.250
σ8.500-8.000=0.500
min82.000-80.000=2.000
max99.000-96.000=3.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean0.438-0.441=-0.003
σ0.302-0.305=-0.003
min0.283-0.286=-0.003
max0.891-0.899=-0.008
policies=20
mean1788.138-1784.276=3.862
σ0.360-0.362=-0.002
min1787.892-1784.030=3.862
max1788.668-1784.810=3.858
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean2.881-2.856=0.024
σ0.108-0.009=0.099
min2.766-2.845=-0.080
max3.026-2.863=0.163
policies=200
mean17888.131-17848.886=39.244
σ0.443-0.372=0.071
min17887.875-17848.605=39.270
max17888.792-17849.433=39.359
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean28.028-28.381=-0.353
σ0.096-0.504=-0.408
min27.958-27.862=0.096
max28.169-28.862=-0.692