Compare commits

Home / Compare 9b6742b6 .. 29e568c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.397-70.393=0.004
σ0.044-0.049=-0.004
min70.373-70.369=0.004
max70.518-70.530=-0.011
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.159-0.158=0.000
σ0.003-0.003=-0.000
min0.155-0.154=0.001
max0.164-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.000
min21.140-21.141=-0.001
max21.147-21.148=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.059=0.005
σ0.002-0.003=-0.001
min0.062-0.057=0.005
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.696-1752.697=-0.001
σ0.360-0.362=-0.003
min1752.128-1752.138=-0.010
max1753.279-1753.291=-0.012
mean1662.850-1645.000=17.850
σ634.302-629.433=4.869
min619.000-633.000=-14.000
max2772.000-2855.000=-83.000
mean2.789-2.767=0.022
σ0.203-0.199=0.004
min2.183-2.365=-0.182
max3.017-3.133=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.610=-0.001
σ0.004-0.006=-0.002
min270.604-270.603=0.001
max270.613-270.617=-0.004
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean0.378-0.381=-0.003
σ0.001-0.004=-0.003
min0.377-0.378=-0.001
max0.378-0.387=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1931.040-1931.040=-0.000
σ0.008-0.002=0.006
min1931.034-1931.038=-0.004
max1931.053-1931.043=0.010
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean2.988-3.080=-0.092
σ0.157-0.115=0.043
min2.739-2.963=-0.224
max3.132-3.238=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4751.795-4751.815=-0.020
σ0.890-0.841=0.050
min4751.250-4751.213=0.037
max4753.376-4753.290=0.086
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean8.527-8.170=0.358
σ0.397-0.726=-0.328
min7.975-7.676=0.299
max9.052-9.307=-0.255
iters=5
new-facts=6402
prior-facts=6402
mean4942.095-4942.238=-0.143
σ0.194-0.015=0.180
min4941.869-4942.221=-0.352
max4942.254-4942.254=0.000
mean3045.600-3046.200=-0.600
σ234.934-267.681=-32.748
min2772.000-2855.000=-83.000
max3373.000-3459.000=-86.000
mean8.557-8.573=-0.016
σ0.164-0.199=-0.035
min8.387-8.303=0.084
max8.806-8.751=0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-0.997=0.106
σ0.266-0.139=0.127
min0.949-0.929=0.020
max1.566-1.245=0.321

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.209-467.201=0.008
σ575.933-575.933=0.000
min179.231-179.232=-0.001
max1331.109-1331.100=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean0.448-0.443=0.006
σ0.308-0.300=0.008
min0.292-0.290=0.001
max0.911-0.893=0.018
policies=20
mean1792.629-1792.652=-0.023
σ0.341-0.373=-0.032
min1792.371-1792.397=-0.026
max1793.121-1793.203=-0.081
mean820.000
σ0.000
min820.000
max820.000
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean2.841-2.868=-0.027
σ0.100-0.006=0.094
min2.785-2.860=-0.075
max2.991-2.873=0.117
policies=200
mean17933.081-17933.124=-0.043
σ0.525-0.519=0.007
min17932.771-17932.704=0.067
max17933.867-17933.877=-0.010
mean8200.000
σ0.000
min8200.000
max8200.000
mean2772.000-2855.000=-83.000
σ0.000
min2772.000-2855.000=-83.000
max2772.000-2855.000=-83.000
mean28.220-28.530=-0.310
σ0.349-0.515=-0.166
min28.033-27.986=0.046
max28.743-29.015=-0.272