Compare commits

Home / Compare caba06b0 .. 6d656e67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.729=-0.001
σ0.052-0.053=-0.001
min70.697-70.700=-0.004
max70.872-70.876=-0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.158-0.158=0.000
σ0.005-0.005=0.001
min0.150-0.151=-0.001
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=0.000
σ0.003-0.003=0.001
min21.439-21.442=-0.003
max21.450-21.450=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.063=0.000
σ0.004-0.003=0.000
min0.058-0.060=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1755.287=-0.001
σ0.361-0.360=0.001
min1754.721-1754.720=0.001
max1755.872-1755.868=0.004
mean1649.050-1627.300=21.750
σ631.154-594.994=36.159
min639.000-637.000=2.000
max2844.000-2422.000=422.000
mean2.803-2.830=-0.027
σ0.170-0.169=0.002
min2.336-2.398=-0.062
max3.110-3.080=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.366-274.369=-0.003
σ0.004-0.008=-0.004
min274.362-274.361=0.001
max274.369-274.381=-0.011
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean0.385-0.384=0.001
σ0.005-0.004=0.001
min0.381-0.382=-0.001
max0.393-0.392=0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.749-1934.752=-0.002
σ0.014-0.012=0.002
min1934.726-1934.736=-0.010
max1934.761-1934.768=-0.007
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean2.991-3.032=-0.041
σ0.088-0.057=0.032
min2.861-2.994=-0.133
max3.109-3.131=-0.022
iters=5
new-facts=6402
prior-facts=1
mean4755.373-4755.474=-0.100
σ0.665-0.904=-0.238
min4754.995-4755.000=-0.005
max4756.546-4757.084=-0.538
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean8.682-8.768=-0.085
σ0.539-0.329=0.210
min7.954-8.299=-0.346
max9.117-9.045=0.072
iters=5
new-facts=6402
prior-facts=6402
mean4945.989-4945.912=0.076
σ0.019-0.174=-0.154
min4945.971-4945.604=0.367
max4946.011-4946.012=-0.001
mean3019.400-2955.000=64.400
σ192.557-269.805=-77.248
min2844.000-2588.000=256.000
max3311.000-3303.000=8.000
mean8.549-8.452=0.097
σ0.096-0.041=0.054
min8.437-8.387=0.050
max8.665-8.490=0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.797=-0.798
σ0.139-0.139=0.001
min0.930-1.635=-0.705
max1.248-2.001=-0.753

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-472.835=0.005
σ574.928-574.922=0.005
min185.369-185.369=-0.000
max1335.231-1335.218=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean0.450-0.568=-0.118
σ0.303-0.561=-0.259
min0.295-0.284=0.010
max0.904-1.410=-0.506
policies=20
mean1854.036-1853.983=0.054
σ0.383-0.367=0.015
min1853.761-1853.734=0.027
max1854.595-1854.526=0.069
mean840.000
σ0.000
min840.000
max840.000
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean2.955-2.864=0.090
σ0.016-0.011=0.006
min2.938-2.851=0.087
max2.977-2.877=0.100
policies=200
mean18546.756-18546.587=0.169
σ0.476-0.572=-0.096
min18546.435-18546.248=0.187
max18547.463-18547.440=0.023
mean8400.000
σ0.000
min8400.000
max8400.000
mean2844.000-2422.000=422.000
σ0.000
min2844.000-2422.000=422.000
max2844.000-2422.000=422.000
mean29.285-28.841=0.443
σ0.575-0.059=0.516
min28.714-28.780=-0.066
max29.880-28.922=0.958