Compare commits

Home / Compare e5793685 .. a1903496

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.567=0.165
σ0.052-0.045=0.008
min70.702-70.538=0.164
max70.878-70.691=0.187
mean414.000-417.600=-3.600
σ0.000-0.843=-0.843
min414.000-416.000=-2.000
max414.000-418.000=-4.000
mean0.161-0.161=-0.000
σ0.004-0.005=-0.001
min0.157-0.150=0.006
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.287=0.158
σ0.003-0.003=-0.000
min21.442-21.283=0.159
max21.450-21.292=0.158
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.286-1753.373=1.913
σ0.359-0.361=-0.003
min1754.716-1752.811=1.906
max1755.865-1753.974=1.891
mean1626.550-1664.100=-37.550
σ594.181-637.203=-43.022
min638.000-620.000=18.000
max2419.000-2813.000=-394.000
mean2.838-2.796=0.043
σ0.112-0.200=-0.088
min2.642-2.281=0.361
max3.089-3.098=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.121-272.110=1.011
σ0.004-0.004=-0.000
min273.117-272.103=1.014
max273.125-272.114=1.012
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean0.384-0.391=-0.007
σ0.009-0.009=0.000
min0.379-0.380=-0.001
max0.400-0.399=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.510-1932.534=0.976
σ0.003-0.014=-0.011
min1933.507-1932.520=0.987
max1933.515-1932.554=0.961
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean3.076-2.958=0.118
σ0.062-0.176=-0.114
min3.027-2.674=0.353
max3.162-3.141=0.021
iters=5
new-facts=6402
prior-facts=1
mean4754.320-4753.194=1.127
σ0.870-0.993=-0.123
min4753.776-4752.371=1.405
max4755.867-4754.914=0.953
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean8.304-8.393=-0.089
σ0.475-0.420=0.056
min7.914-8.011=-0.096
max9.042-9.057=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean4944.736-4943.737=0.999
σ0.019-0.018=0.001
min4944.712-4943.715=0.997
max4944.761-4943.757=1.004
mean2916.600-3026.600=-110.000
σ413.483-276.905=136.578
min2419.000-2813.000=-394.000
max3446.000-3450.000=-4.000
mean8.454-8.523=-0.069
σ0.114-0.153=-0.040
min8.353-8.378=-0.025
max8.607-8.752=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.655-1.085=0.570
σ0.153-0.207=-0.054
min1.477-0.932=0.545
max1.816-1.437=0.379

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.833-467.863=4.970
σ574.927-575.933=-1.006
min185.368-179.888=5.479
max1335.223-1331.763=3.461
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean0.569-0.480=0.089
σ0.551-0.394=0.157
min0.292-0.280=0.012
max1.395-1.071=0.324
policies=20
mean1853.962-1799.176=54.786
σ0.373-0.365=0.008
min1853.708-1798.888=54.820
max1854.513-1799.711=54.802
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean2.853-2.814=0.039
σ0.004-0.007=-0.002
min2.847-2.804=0.043
max2.857-2.820=0.037
policies=200
mean18546.600-17998.112=548.488
σ0.376-0.800=-0.424
min18546.296-17997.333=548.963
max18547.148-17999.144=548.004
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2419.000-2813.000=-394.000
σ0.000
min2419.000-2813.000=-394.000
max2419.000-2813.000=-394.000
mean28.744-28.262=0.482
σ0.137-0.078=0.060
min28.541-28.187=0.354
max28.836-28.362=0.473