Compare commits

Home / Compare 7e1a2424 .. 8097c365

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.053-0.052=0.001
min35.216-35.216=0.000
max35.392-35.391=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.085-0.086=-0.001
σ0.004-0.004=-0.001
min0.082-0.082=-0.000
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.004=-0.001
min23.767-23.765=0.002
max23.774-23.776=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.068-0.067=0.002
σ0.004-0.001=0.003
min0.066-0.065=0.001
max0.076-0.068=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.363=0.000
σ0.363-0.365=-0.002
min1755.789-1755.788=0.001
max1756.937-1756.958=-0.021
mean1645.500-1643.750=1.750
σ632.421-631.702=0.720
min629.000-627.000=2.000
max2842.000-2839.000=3.000
mean2.377-2.332=0.045
σ0.125-0.081=0.045
min2.269-2.242=0.026
max2.791-2.543=0.248

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.591-324.587=0.005
σ0.032-0.034=-0.001
min324.535-324.529=0.006
max324.618-324.616=0.002
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean0.424-0.422=0.001
σ0.001-0.001=-0.001
min0.423-0.421=0.002
max0.424-0.424=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.143-1985.145=-0.002
σ0.009-0.007=0.002
min1985.133-1985.135=-0.002
max1985.156-1985.153=0.004
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean2.588-2.573=0.015
σ0.087-0.043=0.044
min2.467-2.538=-0.071
max2.676-2.644=0.032
iters=5
new-facts=6402
prior-facts=1
mean4808.615-4808.735=-0.119
σ7.741-7.625=0.116
min4804.699-4805.250=-0.552
max4822.455-4822.374=0.082
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean8.784-8.763=0.022
σ0.329-0.264=0.064
min8.226-8.319=-0.092
max9.051-9.025=0.027
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.347=0.000
σ0.017-0.021=-0.004
min4996.326-4996.318=0.008
max4996.364-4996.369=-0.005
mean3040.400-3053.400=-13.000
σ206.897-185.550=21.347
min2842.000-2839.000=3.000
max3336.000-3315.000=21.000
mean8.565-8.789=-0.224
σ0.123-0.276=-0.153
min8.444-8.495=-0.051
max8.750-9.146=-0.396

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.995=-0.015
σ0.139-0.067=0.072
min0.917-0.905=0.012
max1.228-1.048=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.975=-0.005
σ574.256-574.252=0.003
min175.833-175.838=-0.005
max1324.354-1324.354=0.000
mean86.250
σ8.500
min82.000
max99.000
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean0.430-0.431=-0.001
σ0.298-0.304=-0.005
min0.276-0.277=-0.001
max0.877-0.887=-0.010
policies=20
mean1758.689-1758.717=-0.028
σ0.352-0.350=0.003
min1758.454-1758.477=-0.023
max1759.212-1759.235=-0.023
mean820.000
σ0.000
min820.000
max820.000
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean2.776-2.786=-0.010
σ0.011-0.028=-0.017
min2.764-2.748=0.017
max2.791-2.812=-0.021
policies=200
mean17593.224-17593.266=-0.042
σ0.705-0.743=-0.038
min17592.375-17592.244=0.131
max17593.872-17593.840=0.032
mean8200.000
σ0.000
min8200.000
max8200.000
mean2842.000-2839.000=3.000
σ0.000
min2842.000-2839.000=3.000
max2842.000-2839.000=3.000
mean27.880-27.826=0.054
σ0.418-0.335=0.083
min27.414-27.517=-0.103
max28.266-28.183=0.083