Compare commits

Home / Compare c858c94e .. 17269ccb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.783=-0.001
σ0.044-0.047=-0.003
min70.754-70.750=0.004
max70.906-70.913=-0.007
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.161-0.160=0.000
σ0.005-0.004=0.001
min0.156-0.157=-0.000
max0.173-0.167=0.006
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=-0.001
min21.488-21.488=0.000
max21.496-21.499=-0.002
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.064-0.062=0.002
σ0.002-0.003=-0.001
min0.060-0.059=0.001
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.096-1754.093=0.003
σ0.361-0.362=-0.001
min1753.530-1753.529=0.000
max1754.680-1754.680=0.000
mean1662.700-1664.000=-1.300
σ630.991-629.466=1.525
min630.000-674.000=-44.000
max2778.000-2616.000=162.000
mean2.856-2.799=0.057
σ0.110-0.154=-0.044
min2.633-2.529=0.104
max3.109-2.992=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.953=0.003
σ0.006-0.004=0.001
min271.951-271.948=0.003
max271.963-271.959=0.003
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean0.385-0.383=0.002
σ0.003-0.002=0.001
min0.383-0.381=0.002
max0.390-0.385=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1932.328=-0.004
σ0.007-0.008=-0.001
min1932.313-1932.320=-0.007
max1932.330-1932.337=-0.007
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean3.079-2.958=0.121
σ0.112-0.091=0.021
min2.936-2.817=0.119
max3.193-3.070=0.122
iters=5
new-facts=6402
prior-facts=1
mean4753.125-4753.090=0.035
σ0.904-0.918=-0.014
min4752.562-4752.545=0.017
max4754.721-4754.710=0.011
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean8.398-8.805=-0.407
σ0.682-0.681=0.001
min7.460-7.963=-0.503
max9.042-9.565=-0.523
iters=5
new-facts=6402
prior-facts=6402
mean4943.561-4943.555=0.007
σ0.015-0.009=0.006
min4943.541-4943.543=-0.002
max4943.582-4943.565=0.017
mean3049.800-2981.000=68.800
σ237.458-278.522=-41.064
min2778.000-2616.000=162.000
max3342.000-3318.000=24.000
mean8.632-8.576=0.056
σ0.116-0.155=-0.040
min8.460-8.417=0.043
max8.784-8.771=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.004-1.331=-0.327
σ0.153-0.244=-0.091
min0.930-0.937=-0.007
max1.278-1.542=-0.265

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.662=0.004
σ574.925-574.934=-0.009
min181.193-181.192=0.002
max1331.054-1331.063=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean0.453-0.570=-0.117
σ0.309-0.546=-0.237
min0.297-0.292=0.006
max0.916-1.389=-0.473
policies=20
mean1812.243-1812.204=0.039
σ0.368-0.389=-0.021
min1811.972-1811.941=0.031
max1812.767-1812.779=-0.012
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean2.910-2.836=0.073
σ0.112-0.020=0.092
min2.839-2.817=0.021
max3.077-2.863=0.214
policies=200
mean18129.045-18129.218=-0.173
σ0.575-0.473=0.102
min18128.561-18128.945=-0.383
max18129.875-18129.926=-0.052
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2616.000=162.000
σ0.000
min2778.000-2616.000=162.000
max2778.000-2616.000=162.000
mean28.734-28.694=0.040
σ0.084-0.015=0.068
min28.623-28.673=-0.051
max28.825-28.705=0.120