Compare commits

Home / Compare 96035c35 .. 2479723f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.265=-0.001
σ0.054-0.052=0.001
min35.236-35.240=-0.004
max35.415-35.413=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.086-0.084=0.002
σ0.004-0.004=0.000
min0.083-0.077=0.006
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.771=-0.001
σ0.002-0.002=-0.000
min23.767-23.768=-0.001
max23.773-23.775=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.068-0.068=-0.000
σ0.003-0.004=-0.001
min0.066-0.065=0.001
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.365-0.365=-0.001
min1755.909-1755.910=-0.001
max1757.075-1757.075=0.000
mean1653.050-1659.700=-6.650
σ643.010-642.195=0.815
min625.000-629.000=-4.000
max2838.000-2780.000=58.000
mean2.331-2.343=-0.012
σ0.068-0.082=-0.014
min2.248-2.250=-0.003
max2.481-2.548=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.708=0.000
σ0.066-0.054=0.012
min324.592-324.612=-0.020
max324.745-324.734=0.011
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean0.441-0.428=0.013
σ0.010-0.006=0.004
min0.424-0.423=0.001
max0.450-0.438=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1985.269=0.002
σ0.005-0.013=-0.007
min1985.264-1985.249=0.015
max1985.277-1985.282=-0.005
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean2.605-2.646=-0.041
σ0.055-0.111=-0.056
min2.558-2.554=0.004
max2.674-2.812=-0.138
iters=5
new-facts=6402
prior-facts=1
mean4808.860-4808.777=0.083
σ7.683-7.726=-0.042
min4805.367-4804.844=0.523
max4822.604-4822.587=0.017
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean8.841-8.721=0.120
σ0.176-0.387=-0.211
min8.597-8.082=0.515
max9.028-9.097=-0.069
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.458=0.009
σ0.025-0.023=0.002
min4996.435-4996.431=0.004
max4996.493-4996.476=0.017
mean3043.200-3046.200=-3.000
σ187.374-328.116=-140.742
min2838.000-2780.000=58.000
max3314.000-3543.000=-229.000
mean8.676-8.551=0.125
σ0.200-0.118=0.081
min8.521-8.481=0.040
max8.992-8.761=0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.964=0.017
σ0.065-0.074=-0.009
min0.928-0.891=0.037
max1.056-1.047=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.975=-0.003
σ574.257-574.253=0.004
min175.834-175.840=-0.005
max1324.358-1324.355=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean0.436-0.434=0.001
σ0.308-0.304=0.004
min0.278-0.280=-0.002
max0.898-0.890=0.008
policies=20
mean1758.681-1758.725=-0.044
σ0.352-0.367=-0.015
min1758.446-1758.465=-0.019
max1759.204-1759.267=-0.063
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean2.793-2.796=-0.003
σ0.010-0.006=0.004
min2.783-2.787=-0.004
max2.806-2.800=0.006
policies=200
mean17593.271-17592.468=0.803
σ0.524-0.412=0.112
min17592.563-17592.228=0.335
max17593.719-17593.085=0.634
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2780.000=58.000
σ0.000
min2838.000-2780.000=58.000
max2838.000-2780.000=58.000
mean27.911-27.433=0.478
σ0.371-0.120=0.251
min27.501-27.257=0.244
max28.276-27.522=0.754