Compare commits

Home / Compare ce1c60e4 .. 51623f08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.977-33.978=-0.001
σ0.048-0.049=-0.001
min33.953-33.950=0.004
max34.112-34.113=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.080-0.084=-0.004
σ0.004-0.003=0.001
min0.076-0.081=-0.006
max0.087-0.090=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.004-0.003=0.001
min23.311-23.312=-0.001
max23.323-23.322=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.065=-0.002
σ0.004-0.002=0.002
min0.059-0.064=-0.005
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.426-1757.304=0.122
σ0.364-0.364=0.000
min1756.855-1756.729=0.126
max1758.013-1757.897=0.116
mean1655.650-1664.000=-8.350
σ643.387-623.011=20.376
min620.000-671.000=-51.000
max2739.000-2598.000=141.000
mean2.401-2.368=0.033
σ0.235-0.168=0.067
min2.191-2.217=-0.026
max3.335-2.769=0.565

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.540-326.439=0.100
σ0.051-0.060=-0.008
min326.448-326.333=0.115
max326.570-326.476=0.095
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean0.430-0.425=0.005
σ0.007-0.003=0.004
min0.421-0.422=-0.001
max0.437-0.431=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.734-1988.606=0.128
σ0.007-0.012=-0.005
min1988.726-1988.591=0.135
max1988.745-1988.621=0.123
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean2.768-2.771=-0.003
σ0.146-0.170=-0.024
min2.564-2.624=-0.060
max2.932-3.018=-0.087
iters=5
new-facts=6402
prior-facts=1
mean4813.358-4813.386=-0.027
σ7.847-7.757=0.091
min4809.515-4809.643=-0.128
max4827.386-4827.257=0.129
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean8.475-8.320=0.155
σ0.606-0.556=0.050
min7.727-7.762=-0.035
max9.206-8.985=0.221
iters=5
new-facts=6402
prior-facts=6402
mean5001.063-5001.007=0.056
σ0.165-0.021=0.144
min5000.771-5000.983=-0.212
max5001.160-5001.033=0.126
mean2983.000-2975.000=8.000
σ295.019-410.627=-115.607
min2739.000-2598.000=141.000
max3423.000-3551.000=-128.000
mean9.592-9.531=0.062
σ0.562-0.225=0.337
min8.598-9.239=-0.641
max9.938-9.775=0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.311=-0.305
σ0.142-0.353=-0.210
min0.912-0.910=0.001
max1.239-1.783=-0.544

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.566-464.427=0.139
σ574.768-574.777=-0.008
min177.173-177.033=0.140
max1326.718-1326.592=0.126
mean88.250
σ8.500
min84.000
max101.000
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean0.552-0.573=-0.022
σ0.556-0.601=-0.045
min0.272-0.271=0.001
max1.386-1.475=-0.089
policies=20
mean1772.015-1770.741=1.274
σ0.339-0.362=-0.023
min1771.794-1770.495=1.299
max1772.519-1771.278=1.241
mean840.000
σ0.000
min840.000
max840.000
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean2.712-2.729=-0.017
σ0.014-0.050=-0.036
min2.696-2.687=0.009
max2.731-2.798=-0.067
policies=200
mean17727.531-17714.848=12.683
σ0.520-0.557=-0.037
min17727.220-17714.454=12.766
max17728.303-17715.668=12.635
mean8400.000
σ0.000
min8400.000
max8400.000
mean2739.000-2598.000=141.000
σ0.000
min2739.000-2598.000=141.000
max2739.000-2598.000=141.000
mean27.606-27.392=0.214
σ0.062-0.064=-0.001
min27.515-27.331=0.183
max27.648-27.452=0.196