Compare commits

Home / Compare 0b2bc89c .. d790fc0d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.045-0.044=0.001
min70.755-70.753=0.001
max70.907-70.903=0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.158-0.160=-0.002
σ0.003-0.003=0.001
min0.156-0.157=-0.001
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.003-0.001=0.002
min21.489-21.491=-0.002
max21.498-21.496=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.001
min0.063-0.059=0.003
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.085=0.006
σ0.359-0.359=-0.001
min1753.525-1753.535=-0.010
max1754.674-1754.655=0.019
mean1646.600-1623.800=22.800
σ628.215-595.663=32.552
min628.000-651.000=-23.000
max2705.000-2420.000=285.000
mean2.822-2.786=0.036
σ0.163-0.175=-0.012
min2.489-2.443=0.046
max3.082-3.150=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.953=0.003
σ0.005-0.006=-0.000
min271.947-271.945=0.002
max271.961-271.958=0.003
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean0.382-0.380=0.003
σ0.008-0.005=0.003
min0.377-0.376=0.001
max0.397-0.388=0.009
iters=5
new-facts=1
prior-facts=6402
mean1932.328-1932.317=0.011
σ0.006-0.012=-0.006
min1932.321-1932.300=0.021
max1932.334-1932.330=0.004
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean2.990-3.071=-0.080
σ0.158-0.125=0.033
min2.753-2.992=-0.239
max3.164-3.292=-0.128
iters=5
new-facts=6402
prior-facts=1
mean4752.987-4752.949=0.038
σ0.976-0.997=-0.021
min4752.142-4752.126=0.015
max4754.666-4754.685=-0.019
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean8.525-8.884=-0.359
σ0.509-0.215=0.294
min7.735-8.540=-0.805
max9.135-9.122=0.013
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.560=-0.002
σ0.015-0.021=-0.006
min4943.537-4943.536=0.001
max4943.575-4943.584=-0.009
mean3010.800-2917.000=93.800
σ253.556-332.647=-79.091
min2705.000-2420.000=285.000
max3332.000-3307.000=25.000
mean8.622-8.462=0.160
σ0.206-0.108=0.098
min8.385-8.352=0.033
max8.945-8.634=0.311

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.814=-0.759
σ0.132-0.120=0.012
min0.931-1.602=-0.671
max1.246-1.887=-0.640

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.662-468.646=0.016
σ574.941-574.921=0.020
min181.186-181.179=0.007
max1331.074-1331.028=0.046
mean88.250
σ8.500
min84.000
max101.000
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean0.573-0.548=0.024
σ0.567-0.529=0.038
min0.282-0.281=0.002
max1.423-1.343=0.081
policies=20
mean1812.182-1812.120=0.062
σ0.391-0.390=0.001
min1811.906-1811.856=0.051
max1812.756-1812.695=0.061
mean840.000
σ0.000
min840.000
max840.000
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean2.855-2.826=0.029
σ0.046-0.010=0.035
min2.817-2.813=0.004
max2.920-2.836=0.083
policies=200
mean18129.145-18128.870=0.276
σ0.568-0.628=-0.060
min18128.685-18128.377=0.308
max18129.963-18129.748=0.215
mean8400.000
σ0.000
min8400.000
max8400.000
mean2705.000-2420.000=285.000
σ0.000
min2705.000-2420.000=285.000
max2705.000-2420.000=285.000
mean28.416-28.527=-0.111
σ0.046-0.051=-0.006
min28.380-28.481=-0.101
max28.482-28.584=-0.102