Compare commits

Home / Compare 5a19cad2 .. 4aba7f51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.047-0.044=0.003
min70.351-70.354=-0.003
max70.513-70.502=0.011
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.158-0.161=-0.002
σ0.006-0.003=0.002
min0.150-0.156=-0.006
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.003=0.000
min21.137-21.139=-0.002
max21.148-21.147=0.001
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.066-0.063=0.003
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.386=0.001
σ0.361-0.362=-0.001
min1751.816-1751.818=-0.002
max1752.969-1752.957=0.011
mean1649.550-1651.500=-1.950
σ626.371-612.897=13.473
min624.000-677.000=-53.000
max2849.000-2586.000=263.000
mean2.830-2.736=0.093
σ0.137-0.204=-0.067
min2.483-2.201=0.282
max3.053-3.042=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.227-270.217=0.011
σ0.005-0.006=-0.001
min270.222-270.207=0.015
max270.235-270.223=0.012
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean0.383-0.372=0.011
σ0.004-0.001=0.003
min0.380-0.371=0.008
max0.389-0.373=0.016
iters=5
new-facts=1
prior-facts=6402
mean1930.676-1930.688=-0.013
σ0.018-0.009=0.009
min1930.649-1930.680=-0.031
max1930.694-1930.702=-0.008
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean2.555-2.532=0.023
σ0.127-0.129=-0.002
min2.428-2.441=-0.013
max2.744-2.754=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4751.186-4751.152=0.034
σ0.880-0.866=0.014
min4750.707-4750.600=0.107
max4752.744-4752.689=0.055
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean8.460-8.714=-0.254
σ0.465-0.679=-0.214
min7.843-7.703=0.140
max9.088-9.394=-0.305
iters=5
new-facts=6402
prior-facts=6402
mean4941.618-4941.621=-0.003
σ0.078-0.086=-0.009
min4941.547-4941.549=-0.002
max4941.704-4941.716=-0.012
mean3081.400-3024.800=56.600
σ308.260-311.880=-3.620
min2849.000-2605.000=244.000
max3560.000-3419.000=141.000
mean8.442-8.672=-0.229
σ0.096-0.174=-0.078
min8.336-8.499=-0.163
max8.584-8.890=-0.306

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-1.435=-0.403
σ0.135-0.332=-0.197
min0.943-1.079=-0.136
max1.252-1.843=-0.590

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.362-466.360=0.002
σ575.920-575.929=-0.009
min178.397-178.393=0.005
max1330.242-1330.253=-0.012
mean84.000
σ8.000
min80.000
max96.000
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean0.446-0.558=-0.111
σ0.308-0.555=-0.246
min0.287-0.278=0.009
max0.909-1.390=-0.481
policies=20
mean1784.245-1784.194=0.052
σ0.369-0.346=0.022
min1783.982-1783.993=-0.011
max1784.787-1784.710=0.077
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean2.861-2.781=0.080
σ0.008-0.020=-0.012
min2.852-2.767=0.085
max2.868-2.810=0.058
policies=200
mean17848.877-17848.824=0.053
σ0.465-0.561=-0.096
min17848.596-17848.470=0.126
max17849.569-17849.650=-0.081
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2586.000=263.000
σ0.000
min2849.000-2586.000=263.000
max2849.000-2586.000=263.000
mean28.412-28.025=0.387
σ0.535-0.147=0.388
min27.936-27.907=0.030
max28.905-28.220=0.686