Compare commits

Home / Compare 492c5093 .. 39e35790

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.373=0.015
σ0.045-0.058=-0.012
min70.356-70.334=0.021
max70.515-70.534=-0.019
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.159-0.155=0.004
σ0.005-0.005=0.000
min0.151-0.147=0.004
max0.166-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.002=-0.000
min21.141-21.139=0.003
max21.148-21.146=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.062-0.065=-0.002
σ0.004-0.004=0.000
min0.059-0.062=-0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.199=0.196
σ0.359-0.361=-0.002
min1751.825-1751.629=0.197
max1752.972-1752.785=0.186
mean1641.450-1658.900=-17.450
σ618.166-622.327=-4.161
min625.000-644.000=-19.000
max2479.000-2504.000=-25.000
mean2.838-2.784=0.054
σ0.117-0.082=0.035
min2.493-2.503=-0.009
max3.045-2.868=0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-269.933=0.209
σ0.005-0.009=-0.004
min270.134-269.919=0.215
max270.147-269.942=0.205
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean0.383-0.378=0.004
σ0.011-0.009=0.001
min0.376-0.371=0.005
max0.402-0.392=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.613-1930.391=0.222
σ0.009-0.012=-0.003
min1930.601-1930.378=0.223
max1930.622-1930.404=0.218
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean2.502-2.593=-0.091
σ0.060-0.170=-0.110
min2.454-2.441=0.013
max2.592-2.816=-0.224
iters=5
new-facts=6402
prior-facts=1
mean4751.330-4750.943=0.386
σ0.890-0.767=0.124
min4750.820-4750.515=0.305
max4752.913-4752.308=0.605
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean8.403-8.058=0.345
σ0.451-0.336=0.115
min7.685-7.677=0.008
max8.891-8.535=0.357
iters=5
new-facts=6402
prior-facts=6402
mean4941.707-4941.322=0.384
σ0.160-0.078=0.081
min4941.422-4941.249=0.173
max4941.797-4941.421=0.375
mean3023.800-2959.600=64.200
σ262.406-434.573=-172.167
min2631.000-2504.000=127.000
max3331.000-3557.000=-226.000
mean8.673-8.398=0.275
σ0.470-0.152=0.317
min8.379-8.204=0.175
max9.494-8.626=0.868

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.742-1.560=0.182
σ0.152-0.129=0.023
min1.548-1.422=0.125
max1.909-1.717=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-465.911=0.453
σ575.918-575.765=0.153
min178.400-178.021=0.379
max1330.241-1329.558=0.683
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean0.561-0.561=0.000
σ0.560-0.562=-0.002
min0.280-0.278=0.003
max1.401-1.404=-0.003
policies=20
mean1784.296-1780.457=3.839
σ0.355-0.347=0.009
min1784.067-1780.229=3.838
max1784.825-1780.972=3.853
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean2.773-2.762=0.011
σ0.017-0.023=-0.006
min2.758-2.742=0.017
max2.797-2.789=0.008
policies=200
mean17849.760-17811.427=38.333
σ0.404-0.447=-0.043
min17849.433-17811.046=38.387
max17850.335-17812.074=38.261
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2479.000-2504.000=-25.000
σ0.000
min2479.000-2504.000=-25.000
max2479.000-2504.000=-25.000
mean27.866-27.783=0.083
σ0.080-0.136=-0.056
min27.798-27.618=0.179
max27.976-27.948=0.028