Compare commits

Home / Compare 453718b6 .. ed38218a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.045-0.044=0.002
min70.755-70.757=-0.002
max70.907-70.901=0.006
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.159-0.157=0.002
σ0.004-0.010=-0.006
min0.153-0.130=0.022
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.001
σ0.002-0.003=-0.000
min21.490-21.489=0.001
max21.498-21.497=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.091=0.003
σ0.360-0.362=-0.002
min1753.533-1753.530=0.003
max1754.682-1754.672=0.010
mean1662.300-1665.700=-3.400
σ633.369-634.022=-0.652
min628.000-666.000=-38.000
max2779.000-2724.000=55.000
mean2.838-2.770=0.068
σ0.119-0.240=-0.120
min2.533-2.161=0.372
max3.103-3.005=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.927=0.026
σ0.006-0.007=-0.000
min271.944-271.918=0.025
max271.961-271.934=0.027
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean0.382-0.384=-0.001
σ0.004-0.008=-0.004
min0.379-0.377=0.002
max0.388-0.396=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.325-1932.330=-0.005
σ0.011-0.010=0.001
min1932.312-1932.318=-0.006
max1932.342-1932.343=-0.002
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean3.038-2.997=0.041
σ0.049-0.071=-0.021
min2.985-2.894=0.091
max3.108-3.094=0.014
iters=5
new-facts=6402
prior-facts=1
mean4752.913-4753.079=-0.166
σ0.725-0.943=-0.219
min4752.301-4752.514=-0.213
max4754.158-4754.752=-0.594
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean8.515-8.688=-0.173
σ0.523-0.493=0.030
min7.944-7.968=-0.024
max9.073-9.242=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean4943.482-4943.557=-0.075
σ0.174-0.022=0.152
min4943.171-4943.524=-0.353
max4943.578-4943.575=0.003
mean2986.800-2996.600=-9.800
σ213.085-230.965=-17.880
min2779.000-2724.000=55.000
max3297.000-3294.000=3.000
mean8.421-8.460=-0.040
σ0.124-0.121=0.003
min8.308-8.321=-0.013
max8.584-8.609=-0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.022=-0.002
σ0.136-0.140=-0.004
min0.928-0.927=0.001
max1.240-1.244=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.659-468.655=0.005
σ574.929-574.925=0.004
min181.189-181.185=0.004
max1331.053-1331.042=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean0.489-0.570=-0.081
σ0.382-0.568=-0.185
min0.296-0.284=0.012
max1.062-1.422=-0.359
policies=20
mean1812.241-1812.177=0.065
σ0.375-0.379=-0.004
min1811.957-1811.924=0.033
max1812.779-1812.738=0.041
mean840.000
σ0.000
min840.000
max840.000
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean2.936-2.836=0.099
σ0.095-0.010=0.084
min2.824-2.822=0.002
max3.053-2.845=0.208
policies=200
mean18129.075-18128.940=0.135
σ0.654-0.554=0.100
min18128.640-18128.353=0.288
max18130.029-18129.654=0.375
mean8400.000
σ0.000
min8400.000
max8400.000
mean2779.000-2724.000=55.000
σ0.000
min2779.000-2724.000=55.000
max2779.000-2724.000=55.000
mean28.579-28.425=0.154
σ0.094-0.076=0.018
min28.504-28.345=0.159
max28.708-28.527=0.181