Compare commits

Home / Compare 88098af6 .. 96bbdf62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.732=-0.004
σ0.050-0.047=0.002
min70.699-70.700=-0.002
max70.867-70.863=0.005
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.157-0.158=-0.001
σ0.004-0.004=0.000
min0.150-0.151=-0.001
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=0.000
σ0.002-0.003=-0.001
min21.441-21.440=0.001
max21.448-21.451=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.525-1754.527=-0.002
σ0.362-0.361=0.001
min1753.956-1753.956=0.000
max1755.115-1755.106=0.008
mean1658.200-1663.650=-5.450
σ638.241-646.506=-8.266
min624.000-638.000=-14.000
max2856.000-2833.000=23.000
mean2.774-2.822=-0.048
σ0.164-0.181=-0.017
min2.403-2.306=0.096
max2.967-3.157=-0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.612-273.607=0.005
σ0.004-0.008=-0.004
min273.606-273.595=0.012
max273.616-273.613=0.003
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean0.384-0.384=-0.000
σ0.006-0.002=0.004
min0.380-0.381=-0.001
max0.394-0.386=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.998-1934.002=-0.004
σ0.009-0.005=0.003
min1933.986-1933.994=-0.008
max1934.007-1934.008=-0.001
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean3.019-3.067=-0.048
σ0.175-0.122=0.053
min2.777-2.966=-0.188
max3.207-3.205=0.003
iters=5
new-facts=6402
prior-facts=1
mean4754.728-4754.773=-0.045
σ0.850-0.830=0.020
min4754.288-4754.318=-0.030
max4756.246-4756.250=-0.004
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean8.583-8.433=0.150
σ0.458-0.521=-0.062
min7.825-7.574=0.252
max8.956-8.892=0.064
iters=5
new-facts=6402
prior-facts=6402
mean4945.222-4945.225=-0.003
σ0.017-0.018=-0.002
min4945.206-4945.204=0.002
max4945.240-4945.247=-0.006
mean3068.000-3039.200=28.800
σ186.821-209.810=-22.989
min2856.000-2833.000=23.000
max3332.000-3328.000=4.000
mean8.565-8.632=-0.067
σ0.201-0.222=-0.020
min8.366-8.366=-0.000
max8.858-8.927=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.110=-0.050
σ0.139-0.255=-0.116
min0.940-0.935=0.005
max1.283-1.552=-0.269

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.850=-0.009
σ574.924-574.937=-0.012
min185.373-185.374=-0.001
max1335.228-1335.255=-0.027
mean88.250
σ8.500
min84.000
max101.000
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean0.452-0.491=-0.040
σ0.312-0.381=-0.069
min0.292-0.299=-0.007
max0.919-1.062=-0.143
policies=20
mean1854.013-1854.019=-0.006
σ0.382-0.372=0.010
min1853.741-1853.745=-0.004
max1854.572-1854.561=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean2.945-2.960=-0.015
σ0.017-0.011=0.006
min2.925-2.944=-0.019
max2.961-2.968=-0.007
policies=200
mean18546.731-18546.749=-0.018
σ0.459-0.479=-0.019
min18546.358-18546.465=-0.107
max18547.402-18547.465=-0.064
mean8400.000
σ0.000
min8400.000
max8400.000
mean2856.000-2833.000=23.000
σ0.000
min2856.000-2833.000=23.000
max2856.000-2833.000=23.000
mean29.156-29.111=0.044
σ0.417-0.434=-0.017
min28.887-28.868=0.019
max29.777-29.760=0.017