Compare commits

Home / Compare 8cdf0872 .. fccfc04a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.054-0.055=-0.001
min35.217-35.212=0.005
max35.396-35.398=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.086-0.083=0.003
σ0.005-0.005=-0.001
min0.082-0.078=0.004
max0.096-0.092=0.003
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.002-0.002=0.000
min23.764-23.767=-0.002
max23.772-23.773=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.068-0.067=0.001
σ0.003-0.004=-0.001
min0.064-0.061=0.004
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.486=-0.002
σ0.365-0.365=0.000
min1755.910-1755.910=0.000
max1757.077-1757.079=-0.002
mean1659.600-1650.200=9.400
σ646.857-639.582=7.275
min628.000
max2811.000-2826.000=-15.000
mean2.360-2.357=0.003
σ0.105-0.071=0.034
min2.255-2.265=-0.010
max2.713-2.544=0.169

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.712=-0.004
σ0.039-0.035=0.004
min324.639-324.650=-0.011
max324.732-324.733=-0.001
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean0.422-0.425=-0.003
σ0.001-0.001=0.000
min0.421-0.424=-0.003
max0.423-0.426=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1985.259=0.013
σ0.007-0.011=-0.004
min1985.264-1985.243=0.020
max1985.282-1985.272=0.010
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean2.615-2.662=-0.047
σ0.074-0.094=-0.020
min2.552-2.575=-0.023
max2.702-2.804=-0.102
iters=5
new-facts=6402
prior-facts=1
mean4808.890-4808.857=0.033
σ7.653-7.667=-0.015
min4805.356-4805.383=-0.027
max4822.579-4822.573=0.006
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean8.705-8.770=-0.065
σ0.572-0.124=0.448
min7.712-8.660=-0.948
max9.098-8.950=0.147
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.462=0.005
σ0.016-0.020=-0.004
min4996.450-4996.431=0.019
max4996.485-4996.482=0.003
mean3015.800-3063.400=-47.600
σ207.944-307.771=-99.827
min2811.000-2826.000=-15.000
max3301.000-3534.000=-233.000
mean8.667-8.518=0.149
σ0.104-0.094=0.010
min8.541-8.452=0.088
max8.810-8.675=0.135

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.949-0.999=-0.050
σ0.054-0.069=-0.014
min0.916-0.913=0.003
max1.042-1.054=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.974=-0.008
σ574.249-574.253=-0.004
min175.838-175.836=0.002
max1324.339-1324.353=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean0.424-0.428=-0.004
σ0.291-0.294=-0.002
min0.275-0.278=-0.003
max0.861-0.868=-0.007
policies=20
mean1758.716-1758.708=0.008
σ0.345-0.356=-0.011
min1758.495-1758.459=0.036
max1759.229-1759.235=-0.006
mean820.000
σ0.000
min820.000
max820.000
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean2.784-2.797=-0.013
σ0.005-0.010=-0.005
min2.779-2.791=-0.012
max2.789-2.812=-0.023
policies=200
mean17592.527-17593.163=-0.636
σ0.443-0.813=-0.370
min17592.170-17592.077=0.092
max17593.135-17593.867=-0.732
mean8200.000
σ0.000
min8200.000
max8200.000
mean2811.000-2826.000=-15.000
σ0.000
min2811.000-2826.000=-15.000
max2811.000-2826.000=-15.000
mean27.502-27.910=-0.408
σ0.206-0.435=-0.229
min27.261-27.523=-0.262
max27.764-28.403=-0.639