Compare commits

Home / Compare a4ae737c .. 5a2ffcd3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.564=0.001
σ0.045-0.046=-0.001
min70.535-70.542=-0.006
max70.689-70.695=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.160-0.162=-0.002
σ0.004-0.004=0.001
min0.157-0.158=-0.002
max0.170-0.168=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.001
σ0.003-0.003=-0.000
min21.283-21.284=-0.002
max21.291-21.293=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.059-0.062=-0.003
max0.070-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=-0.000
σ0.360-0.362=-0.002
min1753.000-1752.994=0.006
max1754.146-1754.168=-0.023
mean1648.300-1652.650=-4.350
σ640.211-611.614=28.597
min627.000-691.000=-64.000
max2876.000-2645.000=231.000
mean2.832-2.773=0.059
σ0.107-0.216=-0.108
min2.540-2.223=0.317
max3.022-3.024=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.014=0.003
σ0.004-0.010=-0.006
min272.011-271.999=0.012
max272.021-272.024=-0.003
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean0.388-0.388=0.000
σ0.011-0.011=-0.000
min0.377-0.375=0.002
max0.401-0.397=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.440=-0.007
σ0.012-0.013=-0.001
min1932.414-1932.427=-0.013
max1932.444-1932.460=-0.016
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean3.005-2.963=0.042
σ0.103-0.137=-0.034
min2.923-2.731=0.192
max3.180-3.093=0.087
iters=5
new-facts=6402
prior-facts=1
mean4753.155-4753.156=-0.000
σ0.847-0.842=0.004
min4752.667-4752.700=-0.033
max4754.664-4754.656=0.009
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean8.664-8.404=0.260
σ0.245-0.561=-0.316
min8.428-7.617=0.812
max9.060-8.954=0.106
iters=5
new-facts=6402
prior-facts=6402
mean4943.418-4943.627=-0.209
σ0.201-0.019=0.182
min4943.261-4943.606=-0.345
max4943.668-4943.656=0.012
mean3073.400-3011.200=62.200
σ209.972-285.681=-75.709
min2876.000-2645.000=231.000
max3381.000-3375.000=6.000
mean8.594-8.601=-0.007
σ0.103-0.165=-0.062
min8.482-8.375=0.107
max8.747-8.841=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.148=-0.102
σ0.126-0.256=-0.130
min0.930-0.931=-0.000
max1.239-1.543=-0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.077=0.004
σ575.915-575.937=-0.022
min185.119-185.106=0.013
max1336.954-1336.983=-0.029
mean88.250
σ8.500
min84.000
max101.000
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean0.483-0.562=-0.079
σ0.371-0.550=-0.180
min0.296-0.284=0.011
max1.039-1.387=-0.348
policies=20
mean1851.452-1851.384=0.068
σ0.370-0.374=-0.004
min1851.185-1851.128=0.056
max1851.990-1851.937=0.053
mean840.000
σ0.000
min840.000
max840.000
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean2.958-2.855=0.104
σ0.018-0.013=0.005
min2.946-2.840=0.106
max2.985-2.870=0.115
policies=200
mean18521.067-18520.933=0.134
σ0.423-0.549=-0.126
min18520.708-18520.545=0.163
max18521.663-18521.736=-0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2876.000-2645.000=231.000
σ0.000
min2876.000-2645.000=231.000
max2876.000-2645.000=231.000
mean29.211-28.880=0.331
σ0.404-0.047=0.357
min28.902-28.832=0.070
max29.759-28.939=0.820