Compare commits

Home / Compare 3a7204f9 .. 26b35b36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.701=0.001
σ0.048-0.045=0.003
min70.668-70.673=-0.005
max70.834-70.826=0.008
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.161=-0.001
σ0.003-0.003=-0.000
min0.158-0.158=-0.000
max0.167-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.002=0.001
min21.404-21.406=-0.002
max21.412-21.412=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.002
min0.058-0.064=-0.006
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.931=0.000
σ0.361-0.361=-0.000
min1754.357-1754.367=-0.010
max1755.515-1755.516=-0.001
mean1652.650-1628.250=24.400
σ643.197-619.757=23.441
min624.000-623.000=1.000
max2779.000-2757.000=22.000
mean2.830-2.814=0.017
σ0.159-0.252=-0.092
min2.293-2.286=0.007
max3.171-3.114=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.790-272.788=0.002
σ0.003-0.006=-0.003
min272.786-272.781=0.006
max272.794-272.794=-0.001
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean0.378-0.382=-0.004
σ0.003-0.008=-0.005
min0.375-0.377=-0.002
max0.381-0.395=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.225-1933.230=-0.005
σ0.011-0.004=0.007
min1933.212-1933.227=-0.015
max1933.242-1933.238=0.004
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean3.057-3.044=0.014
σ0.063-0.348=-0.286
min3.013-2.735=0.277
max3.157-3.593=-0.437
iters=5
new-facts=6402
prior-facts=1
mean4756.609-4756.641=-0.032
σ7.463-7.438=0.025
min4752.862-4752.497=0.364
max4769.950-4769.918=0.031
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean8.808-8.405=0.403
σ0.351-0.362=-0.012
min8.475-7.982=0.493
max9.342-8.919=0.423
iters=5
new-facts=6402
prior-facts=6402
mean4944.451-4944.461=-0.009
σ0.015-0.020=-0.005
min4944.435-4944.433=0.002
max4944.474-4944.477=-0.004
mean2988.800-3041.800=-53.000
σ268.947-272.668=-3.720
min2779.000-2757.000=22.000
max3398.000-3422.000=-24.000
mean8.376-8.483=-0.108
σ0.064-0.112=-0.048
min8.296-8.366=-0.070
max8.440-8.624=-0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.012=0.050
σ0.221-0.136=0.085
min0.908-0.918=-0.009
max1.394-1.232=0.162

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.342-468.337=0.005
σ574.272-574.292=-0.020
min181.201-181.186=0.015
max1329.751-1329.775=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean0.442-0.486=-0.044
σ0.302-0.405=-0.104
min0.289-0.282=0.008
max0.895-1.094=-0.199
policies=20
mean1812.375-1812.183=0.192
σ0.400-0.380=0.020
min1812.101-1811.932=0.169
max1812.964-1812.748=0.216
mean840.000
σ0.000
min840.000
max840.000
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean2.885-2.806=0.079
σ0.017-0.009=0.008
min2.862-2.795=0.066
max2.902-2.816=0.086
policies=200
mean18129.139-18129.029=0.110
σ0.388-0.398=-0.010
min18128.769-18128.761=0.008
max18129.548-18129.619=-0.071
mean8400.000
σ0.000
min8400.000
max8400.000
mean2779.000-2757.000=22.000
σ0.000
min2779.000-2757.000=22.000
max2779.000-2757.000=22.000
mean28.400-28.428=-0.028
σ0.228-0.119=0.109
min28.254-28.322=-0.068
max28.739-28.586=0.153