Compare commits

Home / Compare 35d9271a .. b7747e49

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-70.708=-36.727
σ0.050-0.044=0.006
min33.942-70.679=-36.737
max34.119-70.831=-36.712
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.085-0.161=-0.076
σ0.003-0.003=-0.001
min0.082-0.157=-0.075
max0.090-0.167=-0.077
cache=y
dps=1
iters=10
policies=100
mean23.318-21.412=1.906
σ0.003-0.003=-0.000
min23.313-21.409=1.904
max23.322-21.419=1.904
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.063-0.064=-0.000
σ0.004-0.004=0.001
min0.060-0.059=0.001
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1754.932=2.371
σ0.365-0.359=0.006
min1756.729-1754.360=2.369
max1757.894-1755.501=2.394
mean1654.500-1649.750=4.750
σ633.076-631.873=1.203
min636.000-626.000=10.000
max2850.000-2772.000=78.000
mean2.375-2.839=-0.464
σ0.086-0.141=-0.055
min2.277-2.520=-0.243
max2.575-3.187=-0.612

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-272.790=53.664
σ0.028-0.005=0.023
min326.405-272.782=53.623
max326.470-272.794=53.676
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean0.426-0.377=0.049
σ0.005-0.001=0.004
min0.422-0.376=0.046
max0.433-0.379=0.054
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1933.220=55.396
σ0.009-0.018=-0.009
min1988.606-1933.196=55.410
max1988.627-1933.241=55.386
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean2.723-3.131=-0.408
σ0.117-0.250=-0.132
min2.626-2.970=-0.345
max2.926-3.574=-0.648
iters=5
new-facts=6402
prior-facts=1
mean4813.448-4756.823=56.625
σ7.674-7.649=0.025
min4809.986-4752.927=57.059
max4827.176-4770.497=56.679
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean8.597-8.771=-0.175
σ0.115-0.198=-0.083
min8.429-8.537=-0.107
max8.752-8.971=-0.219
iters=5
new-facts=6402
prior-facts=6402
mean5000.946-4944.450=56.497
σ0.176-0.023=0.153
min5000.634-4944.423=56.211
max5001.065-4944.478=56.587
mean3042.600-3036.800=5.800
σ184.975-319.855=-134.880
min2850.000-2772.000=78.000
max3310.000-3516.000=-206.000
mean9.771-8.396=1.375
σ0.293-0.156=0.137
min9.281-8.237=1.044
max10.065-8.635=1.430

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.070=-0.051
σ0.166-0.217=-0.051
min0.903-0.916=-0.014
max1.297-1.378=-0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-468.327=-3.886
σ574.774-574.227=0.548
min177.046-181.205=-4.159
max1326.604-1329.667=-3.064
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean0.436-0.442=-0.005
σ0.304-0.295=0.009
min0.279-0.292=-0.013
max0.892-0.883=0.008
policies=20
mean1770.796-1812.377=-41.581
σ0.377-0.402=-0.025
min1770.540-1812.097=-41.558
max1771.351-1812.967=-41.617
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean2.813-2.881=-0.068
σ0.025-0.021=0.004
min2.789-2.853=-0.065
max2.837-2.898=-0.061
policies=200
mean17715.005-18129.115=-414.111
σ0.502-0.356=0.146
min17714.612-18128.778=-414.166
max17715.730-18129.599=-413.870
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2772.000=78.000
σ0.000
min2850.000-2772.000=78.000
max2850.000-2772.000=78.000
mean28.106-28.372=-0.266
σ0.382-0.178=0.204
min27.659-28.257=-0.598
max28.586-28.635=-0.049