Compare commits

Home / Compare 6db22835 .. 145f5425

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.701=0.000
σ0.046-0.047=-0.001
min70.673-70.668=0.005
max70.830-70.830=0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.159-0.158=0.002
σ0.002-0.005=-0.003
min0.157-0.152=0.006
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.000
σ0.003-0.003=-0.000
min21.404
max21.413-21.414=-0.001
mean416.500-414.000=2.500
σ0.527-0.000=0.527
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.000
min0.063-0.063=-0.000
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.932=-0.001
σ0.361-0.361=0.001
min1754.364-1754.359=0.005
max1755.530-1755.519=0.012
mean1638.350-1647.950=-9.600
σ618.781-632.780=-13.999
min632.000-624.000=8.000
max2480.000-2774.000=-294.000
mean2.801-2.780=0.021
σ0.152-0.182=-0.030
min2.423-2.428=-0.005
max2.978-3.098=-0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.743=0.014
σ0.004-0.011=-0.007
min272.753-272.732=0.021
max272.765-272.758=0.007
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean0.381-0.384=-0.003
σ0.007-0.010=-0.003
min0.377-0.377=0.000
max0.394-0.402=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1933.158=0.001
σ0.008-0.018=-0.010
min1933.147-1933.137=0.010
max1933.168-1933.177=-0.009
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean3.094-3.066=0.028
σ0.146-0.171=-0.025
min2.927-2.870=0.057
max3.254-3.290=-0.035
iters=5
new-facts=6402
prior-facts=1
mean4757.002-4756.895=0.107
σ7.549-7.624=-0.075
min4753.515-4753.378=0.137
max4770.506-4770.533=-0.027
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean8.139-8.636=-0.498
σ0.326-0.452=-0.126
min7.837-7.927=-0.089
max8.633-9.136=-0.503
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4944.393=0.005
σ0.017-0.021=-0.004
min4944.375-4944.371=0.004
max4944.416-4944.417=-0.001
mean2940.200-3046.800=-106.600
σ385.563-331.547=54.015
min2480.000-2774.000=-294.000
max3461.000-3541.000=-80.000
mean8.534-8.513=0.020
σ0.154-0.108=0.046
min8.404-8.407=-0.002
max8.723-8.688=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.705-1.043=0.662
σ0.152-0.282=-0.130
min1.455-0.914=0.541
max1.835-1.547=0.288

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.320-468.342=-0.022
σ574.255-574.255=0.001
min181.189-181.205=-0.016
max1329.704-1329.724=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean0.564-0.443=0.121
σ0.554-0.297=0.257
min0.286-0.293=-0.008
max1.395-0.888=0.507
policies=20
mean1812.163-1812.357=-0.194
σ0.390-0.380=0.010
min1811.917-1812.105=-0.188
max1812.743-1812.918=-0.175
mean840.000
σ0.000
min840.000
max840.000
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean2.808-2.886=-0.077
σ0.017-0.006=0.012
min2.790-2.879=-0.089
max2.830-2.891=-0.061
policies=200
mean18129.057-18129.000=0.057
σ0.511-0.412=0.099
min18128.785-18128.650=0.135
max18129.822-18129.516=0.306
mean8400.000
σ0.000
min8400.000
max8400.000
mean2480.000-2774.000=-294.000
σ0.000
min2480.000-2774.000=-294.000
max2480.000-2774.000=-294.000
mean28.447-28.491=-0.044
σ0.065-0.203=-0.138
min28.402-28.319=0.083
max28.542-28.783=-0.240