Compare commits

Home / Compare dd5395c9 .. f7ba09fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.261-35.263=-0.002
σ0.054-0.055=-0.000
min35.232-35.235=-0.003
max35.414-35.417=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.082-0.086=-0.004
σ0.004-0.004=-0.000
min0.076-0.082=-0.006
max0.089-0.094=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.002-0.002=0.000
min23.765-23.766=-0.001
max23.772-23.772=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.069-0.066=0.002
σ0.003-0.003=0.000
min0.066-0.061=0.005
max0.076-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.486=-0.002
σ0.364-0.365=-0.001
min1755.912-1755.910=0.002
max1757.064-1757.075=-0.011
mean1658.650-1647.200=11.450
σ642.295-639.394=2.901
min629.000-625.000=4.000
max2779.000-2823.000=-44.000
mean2.353-2.339=0.015
σ0.101-0.063=0.038
min2.253-2.249=0.004
max2.664-2.472=0.192

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.713=-0.007
σ0.051-0.047=0.005
min324.615-324.631=-0.016
max324.733-324.747=-0.013
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean0.428-0.424=0.003
σ0.006-0.002=0.004
min0.424-0.421=0.003
max0.439-0.426=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.271=-0.009
σ0.012-0.006=0.006
min1985.251-1985.262=-0.011
max1985.275-1985.276=-0.001
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean2.767-2.626=0.141
σ0.289-0.091=0.197
min2.550-2.554=-0.004
max3.257-2.734=0.524
iters=5
new-facts=6402
prior-facts=1
mean4808.837-4808.774=0.063
σ7.706-7.736=-0.030
min4804.837-4804.868=-0.031
max4822.608-4822.604=0.003
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean8.654-8.951=-0.298
σ0.827-0.467=0.359
min7.845-8.383=-0.538
max9.944-9.565=0.379
iters=5
new-facts=6402
prior-facts=6402
mean4996.462-4996.471=-0.009
σ0.016-0.022=-0.006
min4996.443-4996.446=-0.003
max4996.486-4996.495=-0.009
mean2993.800-3088.200=-94.400
σ276.288-259.371=16.917
min2779.000-2823.000=-44.000
max3419.000-3341.000=78.000
mean8.457-8.965=-0.509
σ0.075-0.490=-0.415
min8.328-8.521=-0.192
max8.515-9.754=-1.239

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-0.944=0.007
σ0.057-0.053=0.005
min0.915-0.913=0.003
max1.052-1.038=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.971=0.004
σ574.251-574.247=0.004
min175.836-175.841=-0.005
max1324.352-1324.342=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean0.463-0.431=0.032
σ0.361-0.294=0.067
min0.279-0.281=-0.002
max1.004-0.871=0.133
policies=20
mean1758.714-1758.725=-0.011
σ0.355-0.344=0.010
min1758.456-1758.500=-0.043
max1759.232-1759.236=-0.004
mean820.000
σ0.000
min820.000
max820.000
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean2.849-2.798=0.051
σ0.062-0.022=0.040
min2.765-2.782=-0.017
max2.915-2.831=0.084
policies=200
mean17592.479-17593.156=-0.677
σ0.557-0.840=-0.283
min17592.123-17591.949=0.174
max17593.304-17593.804=-0.499
mean8200.000
σ0.000
min8200.000
max8200.000
mean2779.000-2823.000=-44.000
σ0.000
min2779.000-2823.000=-44.000
max2779.000-2823.000=-44.000
mean27.615-27.903=-0.288
σ0.160-0.361=-0.201
min27.408-27.471=-0.063
max27.793-28.335=-0.542