Compare commits

Home / Compare ab5b54a1 .. 66d46459

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.046=-0.000
σ0.048-0.048=0.000
min73.023-73.023=-0.000
max73.182-73.181=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.162-0.161=0.001
σ0.005-0.003=0.001
min0.156-0.158=-0.001
max0.170-0.166=0.004
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=-0.000
σ0.002-0.003=-0.001
min23.737-23.737=0.000
max23.743-23.745=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.066-0.066=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.073-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.788=0.000
σ0.360-0.360=0.001
min1758.215-1758.213=0.002
max1759.380-1759.366=0.014
mean1659.000-1651.650=7.350
σ629.660-620.598=9.062
min629.000-630.000=-1.000
max2522.000-2499.000=23.000
mean2.766-2.833=-0.068
σ0.222-0.163=0.058
min2.243-2.466=-0.222
max3.037-3.292=-0.255

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.016-324.013=0.002
σ0.056-0.061=-0.005
min323.916-323.906=0.010
max324.044-324.051=-0.007
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean0.431-0.431=0.000
σ0.007-0.006=0.001
min0.425-0.425=0.001
max0.439-0.439=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.589=-0.001
σ0.014-0.012=0.002
min1984.569-1984.568=0.000
max1984.604-1984.600=0.004
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean2.648-2.597=0.051
σ0.126-0.054=0.072
min2.517-2.546=-0.029
max2.793-2.685=0.108
iters=5
new-facts=6402
prior-facts=1
mean4808.223-4808.149=0.074
σ7.836-7.879=-0.043
min4804.648-4804.108=0.541
max4822.240-4822.233=0.007
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean8.921-8.937=-0.017
σ0.175-0.336=-0.161
min8.769-8.430=0.339
max9.218-9.310=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean4995.739-4995.811=-0.072
σ0.170-0.027=0.143
min4995.437-4995.776=-0.339
max4995.834-4995.840=-0.006
mean2948.400-3005.000=-56.600
σ377.805-320.232=57.573
min2522.000-2588.000=-66.000
max3425.000-3418.000=7.000
mean8.662-8.774=-0.112
σ0.220-0.339=-0.118
min8.489-8.509=-0.020
max9.020-9.360=-0.341

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.537-1.630=-0.093
σ0.178-0.132=0.046
min1.221-1.484=-0.263
max1.642-1.833=-0.191

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.329-468.324=0.005
σ574.234-574.231=0.003
min181.207-181.206=0.001
max1329.680-1329.671=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean0.535-0.560=-0.026
σ0.502-0.538=-0.036
min0.282-0.290=-0.008
max1.288-1.368=-0.080
policies=20
mean1812.402-1812.400=0.001
σ0.396-0.393=0.003
min1812.129-1812.141=-0.011
max1812.988-1812.982=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean2.811-2.810=0.002
σ0.013-0.007=0.006
min2.798-2.802=-0.003
max2.827-2.816=0.011
policies=200
mean18131.613-18131.553=0.061
σ0.499-0.503=-0.004
min18131.312-18131.149=0.163
max18132.360-18132.281=0.079
mean8400.000
σ0.000
min8400.000
max8400.000
mean2522.000-2499.000=23.000
σ0.000
min2522.000-2499.000=23.000
max2522.000-2499.000=23.000
mean28.396-28.299=0.097
σ0.047-0.063=-0.016
min28.338-28.216=0.122
max28.438-28.368=0.070