Compare commits

Home / Compare 2051c3f9 .. 2b1402fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.373=0.001
σ0.059-0.058=0.002
min70.334-70.333=0.001
max70.540-70.534=0.006
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.158-0.158=-0.001
σ0.006-0.003=0.003
min0.149-0.155=-0.006
max0.168-0.164=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=0.000
min21.140-21.139=0.001
max21.146-21.146=0.000
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.064=-0.000
σ0.003-0.003=0.000
min0.057-0.062=-0.005
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.197-1752.199=-0.002
σ0.362-0.361=0.001
min1751.632-1751.627=0.004
max1752.761-1752.786=-0.025
mean1640.800-1656.200=-15.400
σ613.662-641.990=-28.329
min629.000-623.000=6.000
max2470.000-2774.000=-304.000
mean2.841-2.773=0.068
σ0.122-0.244=-0.122
min2.603-2.172=0.431
max3.032-3.133=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.931=0.002
σ0.006-0.006=0.000
min269.927-269.925=0.002
max269.943-269.939=0.004
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean0.382-0.376=0.006
σ0.011-0.009=0.002
min0.372-0.370=0.002
max0.400-0.392=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.386-1930.395=-0.010
σ0.025-0.017=0.008
min1930.357-1930.369=-0.013
max1930.411-1930.411=-0.000
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean2.566-2.529=0.036
σ0.161-0.104=0.057
min2.406-2.407=-0.001
max2.830-2.641=0.190
iters=5
new-facts=6402
prior-facts=1
mean4750.851-4750.916=-0.066
σ0.810-0.793=0.016
min4750.338-4750.470=-0.132
max4752.278-4752.329=-0.051
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean8.637-8.176=0.461
σ0.224-0.412=-0.188
min8.411-7.681=0.731
max8.925-8.699=0.226
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.258=0.074
σ0.084-0.195=-0.111
min4941.259-4940.939=0.320
max4941.426-4941.417=0.009
mean2961.600-3051.000=-89.400
σ272.859-341.981=-69.122
min2595.000-2774.000=-179.000
max3316.000-3566.000=-250.000
mean8.450-8.443=0.007
σ0.032-0.136=-0.104
min8.411-8.334=0.077
max8.495-8.641=-0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.850-1.053=0.797
σ0.033-0.124=-0.090
min1.813-0.940=0.873
max1.885-1.243=0.642

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.903=-0.001
σ575.758-575.760=-0.002
min178.022-178.019=0.003
max1329.540-1329.543=-0.003
mean81.750
σ7.500
min78.000
max93.000
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean0.550-0.442=0.108
σ0.531-0.306=0.225
min0.269-0.285=-0.017
max1.346-0.901=0.445
policies=20
mean1780.452-1780.496=-0.044
σ0.356-0.373=-0.016
min1780.213-1780.233=-0.020
max1780.981-1781.044=-0.063
mean780.000
σ0.000
min780.000
max780.000
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean2.767-2.844=-0.077
σ0.015-0.105=-0.091
min2.751-2.758=-0.007
max2.784-2.990=-0.206
policies=200
mean17811.215-17811.317=-0.102
σ0.409-0.464=-0.055
min17810.906-17811.049=-0.143
max17811.818-17812.012=-0.194
mean7800.000
σ0.000
min7800.000
max7800.000
mean2470.000-2774.000=-304.000
σ0.000
min2470.000-2774.000=-304.000
max2470.000-2774.000=-304.000
mean27.927-27.913=0.014
σ0.109-0.157=-0.048
min27.833-27.784=0.049
max28.051-28.118=-0.066