Compare commits

Home / Compare 3807e615 .. a156f45a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.050-0.049=0.001
min33.944-33.953=-0.009
max34.117-34.114=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.080-0.084=-0.004
σ0.005-0.006=-0.000
min0.076-0.078=-0.002
max0.089-0.094=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.000
min23.313-23.313=-0.000
max23.323-23.323=-0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.060=0.001
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.302=0.001
σ0.364-0.363=0.001
min1756.728-1756.728=0.000
max1757.889-1757.891=-0.002
mean1650.050-1664.050=-14.000
σ623.812-623.423=0.389
min640.000-671.000=-31.000
max2827.000-2600.000=227.000
mean2.364-2.416=-0.052
σ0.103-0.186=-0.083
min2.265-2.251=0.014
max2.639-2.931=-0.292

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-326.437=0.016
σ0.037-0.059=-0.022
min326.389-326.332=0.057
max326.483-326.475=0.008
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean0.424-0.423=0.001
σ0.001-0.003=-0.002
min0.423-0.421=0.003
max0.425-0.426=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.604-1988.616=-0.011
σ0.012-0.006=0.006
min1988.588-1988.611=-0.023
max1988.619-1988.625=-0.006
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean2.688-2.680=0.008
σ0.117-0.108=0.009
min2.512-2.582=-0.071
max2.822-2.854=-0.033
iters=5
new-facts=6402
prior-facts=1
mean4813.490-4813.450=0.040
σ7.760-7.727=0.033
min4809.944-4809.941=0.003
max4827.372-4827.273=0.099
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean8.735-8.855=-0.119
σ0.598-0.318=0.280
min7.999-8.437=-0.439
max9.522-9.164=0.358
iters=5
new-facts=6402
prior-facts=6402
mean5001.014-5000.939=0.075
σ0.019-0.156=-0.137
min5000.998-5000.663=0.335
max5001.046-5001.038=0.008
mean3000.000-2993.800=6.200
σ192.124-262.689=-70.566
min2827.000-2609.000=218.000
max3294.000-3310.000=-16.000
mean9.666-9.821=-0.155
σ0.532-0.083=0.449
min8.733-9.722=-0.989
max10.038-9.932=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.157=-0.131
σ0.049-0.385=-0.336
min0.938-0.923=0.015
max1.053-1.818=-0.766

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.434-464.441=-0.007
σ574.775-574.782=-0.007
min177.044-177.041=0.003
max1326.596-1326.614=-0.018
mean88.250
σ8.500
min84.000
max101.000
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean0.429-0.545=-0.116
σ0.305-0.540=-0.235
min0.276-0.271=0.004
max0.887-1.356=-0.469
policies=20
mean1770.794-1770.765=0.030
σ0.364-0.355=0.010
min1770.555-1770.531=0.024
max1771.336-1771.292=0.044
mean840.000
σ0.000
min840.000
max840.000
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean2.782-2.734=0.048
σ0.011-0.027=-0.016
min2.770-2.705=0.065
max2.791-2.760=0.030
policies=200
mean17714.844-17714.840=0.004
σ0.551-0.429=0.123
min17714.363-17714.575=-0.212
max17715.639-17715.473=0.165
mean8400.000
σ0.000
min8400.000
max8400.000
mean2827.000-2600.000=227.000
σ0.000
min2827.000-2600.000=227.000
max2827.000-2600.000=227.000
mean27.962-27.569=0.393
σ0.398-0.155=0.242
min27.583-27.413=0.170
max28.419-27.759=0.660