Compare commits

Home / Compare 9adf57cb .. 6e3b59ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.377=-0.002
σ0.057-0.058=-0.001
min70.339-70.336=0.002
max70.533-70.538=-0.005
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.160-0.161=-0.001
σ0.004-0.004=-0.000
min0.157-0.155=0.001
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.001
σ0.002-0.003=-0.001
min21.141-21.137=0.003
max21.146-21.149=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.060=0.005
σ0.003-0.003=0.000
min0.063-0.058=0.005
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.197=0.002
σ0.363-0.362=0.001
min1751.631-1751.631=-0.000
max1752.783-1752.768=0.015
mean1652.150-1632.900=19.250
σ641.099-597.743=43.355
min635.000-626.000=9.000
max2847.000-2420.000=427.000
mean2.850-2.795=0.055
σ0.095-0.204=-0.109
min2.620-2.303=0.317
max3.011-3.033=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.926-269.936=-0.009
σ0.007-0.009=-0.002
min269.920-269.924=-0.004
max269.936-269.949=-0.012
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean0.373-0.382=-0.009
σ0.007-0.007=-0.000
min0.369-0.378=-0.009
max0.385-0.394=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.398-1930.391=0.007
σ0.012-0.023=-0.011
min1930.388-1930.355=0.033
max1930.418-1930.409=0.009
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean2.561-2.556=0.006
σ0.126-0.158=-0.031
min2.459-2.444=0.014
max2.716-2.812=-0.095
iters=5
new-facts=6402
prior-facts=1
mean4750.883-4750.838=0.044
σ0.851-0.820=0.031
min4750.271-4750.300=-0.029
max4752.382-4752.281=0.101
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean8.785-8.682=0.103
σ0.627-0.262=0.365
min7.842-8.433=-0.591
max9.603-9.027=0.576
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.262=-0.001
σ0.131-0.203=-0.072
min4941.073-4940.927=0.146
max4941.442-4941.427=0.015
mean3071.000-2969.000=102.000
σ236.079-257.671=-21.592
min2847.000-2645.000=202.000
max3413.000-3316.000=97.000
mean8.557-8.452=0.106
σ0.167-0.048=0.119
min8.400-8.400=-0.001
max8.815-8.511=0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.809=-0.762
σ0.126-0.037=0.089
min0.934-1.771=-0.837
max1.245-1.867=-0.622

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.917-465.901=0.016
σ575.769-575.754=0.015
min178.022-178.021=0.001
max1329.569-1329.531=0.038
mean81.750
σ7.500
min78.000
max93.000
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean0.444-0.558=-0.114
σ0.307-0.557=-0.249
min0.285-0.279=0.006
max0.905-1.393=-0.488
policies=20
mean1780.477-1780.447=0.031
σ0.356-0.352=0.003
min1780.224-1780.205=0.019
max1780.997-1780.969=0.028
mean780.000
σ0.000
min780.000
max780.000
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean2.864-2.759=0.105
σ0.041-0.007=0.034
min2.841-2.752=0.089
max2.925-2.766=0.159
policies=200
mean17811.239-17811.190=0.049
σ0.471-0.578=-0.107
min17810.791-17810.869=-0.077
max17811.895-17812.056=-0.161
mean7800.000
σ0.000
min7800.000
max7800.000
mean2847.000-2420.000=427.000
σ0.000
min2847.000-2420.000=427.000
max2847.000-2420.000=427.000
mean28.351-27.823=0.528
σ0.447-0.196=0.251
min27.774-27.686=0.088
max28.736-28.106=0.630