Compare commits

Home / Compare edb2c01f .. 1a871386

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.000
σ0.054-0.053=0.001
min35.591-35.595=-0.003
max35.771-35.768=0.003
mean417.000-417.300=-0.300
σ0.000-0.483=-0.483
min417.000
max417.000-418.000=-1.000
mean0.084-0.084=0.000
σ0.003-0.005=-0.001
min0.080-0.077=0.003
max0.091-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.048=-0.000
σ0.003-0.003=0.000
min24.044-24.045=-0.001
max24.053-24.054=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.067-0.069=-0.002
σ0.004-0.003=0.000
min0.061-0.066=-0.005
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.490=0.002
σ0.365-0.366=-0.001
min1755.915-1755.916=-0.000
max1757.077-1757.080=-0.003
mean1654.700-1656.900=-2.200
σ645.186-614.091=31.094
min652.000-633.000=19.000
max2843.000-2482.000=361.000
mean2.322-2.334=-0.012
σ0.092-0.072=0.021
min2.212-2.243=-0.030
max2.608-2.482=0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.758-324.762=-0.004
σ0.060-0.060=0.001
min324.652-324.656=-0.004
max324.800-324.797=0.003
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean0.425-0.435=-0.010
σ0.001-0.014=-0.013
min0.424-0.423=0.001
max0.427-0.450=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.308-1844.998=140.310
σ0.018-313.776=-313.758
min1985.285-1283.698=701.587
max1985.327
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean2.740-2.423=0.317
σ0.122-0.426=-0.303
min2.576-1.680=0.896
max2.897-2.762=0.136
iters=5
new-facts=6402
prior-facts=1
mean4808.935-4808.949=-0.015
σ7.684-7.672=0.011
min4805.428-4805.420=0.008
max4822.680-4822.673=0.006
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean8.881-8.915=-0.035
σ0.155-0.408=-0.253
min8.762-8.357=0.405
max9.142-9.469=-0.326
iters=5
new-facts=6402
prior-facts=6402
mean4996.468-4996.534=-0.066
σ0.156-0.018=0.138
min4996.190-4996.513=-0.322
max4996.561-4996.554=0.006
mean3089.200-2941.800=147.400
σ231.435-325.585=-94.150
min2843.000-2517.000=326.000
max3323.000-3245.000=78.000
mean8.825-8.673=0.152
σ0.437-0.135=0.301
min8.485-8.474=0.011
max9.542-8.842=0.700

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.948-1.571=-0.624
σ0.054-0.236=-0.181
min0.917-1.184=-0.267
max1.044-1.789=-0.745

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.943=0.005
σ574.251-574.252=-0.001
min175.819-175.812=0.007
max1324.325-1324.321=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean0.432-0.537=-0.106
σ0.298-0.526=-0.228
min0.280-0.271=0.009
max0.879-1.326=-0.447
policies=20
mean1758.525-1758.471=0.054
σ0.346-0.345=0.001
min1758.307-1758.237=0.070
max1759.039-1758.981=0.058
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean2.782-2.718=0.063
σ0.014-0.008=0.005
min2.767-2.710=0.057
max2.799-2.726=0.073
policies=200
mean17592.105-17592.044=0.061
σ0.445-0.488=-0.043
min17591.825-17591.755=0.069
max17592.765-17592.774=-0.009
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2482.000=361.000
σ0.000
min2843.000-2482.000=361.000
max2843.000-2482.000=361.000
mean28.016-27.481=0.535
σ0.275-0.111=0.164
min27.772-27.370=0.402
max28.303-27.618=0.685