Compare commits

Home / Compare 571e2b52 .. 50e62de2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=-0.000
σ0.054-0.054=-0.000
min35.235-35.237=-0.002
max35.415-35.416=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.083-0.085=-0.002
σ0.001-0.003=-0.003
min0.083-0.082=0.000
max0.085-0.092=-0.007
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.004-0.004=0.000
min23.764-23.767=-0.003
max23.778-23.778=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.068-0.067=0.001
σ0.003-0.006=-0.003
min0.066-0.062=0.005
max0.074-0.077=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.483=0.000
σ0.365-0.365=-0.001
min1755.908-1755.907=0.002
max1757.069-1757.067=0.002
mean1657.300-1644.550=12.750
σ637.183-646.026=-8.842
min678.000-620.000=58.000
max2845.000-2728.000=117.000
mean2.362-2.374=-0.012
σ0.088-0.131=-0.044
min2.274-2.136=0.138
max2.602-2.632=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.716=-0.010
σ0.054-0.024=0.030
min324.609-324.672=-0.063
max324.737-324.732=0.006
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean0.427-0.423=0.004
σ0.004-0.001=0.003
min0.424-0.421=0.003
max0.434-0.425=0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.273-1985.262=0.011
σ0.002-0.026=-0.023
min1985.270-1985.220=0.050
max1985.275-1985.281=-0.006
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean2.623-2.616=0.007
σ0.079-0.074=0.006
min2.566-2.575=-0.009
max2.752-2.747=0.005
iters=5
new-facts=6402
prior-facts=1
mean4808.669-4808.871=-0.202
σ7.824-7.734=0.090
min4804.274-4805.377=-1.103
max4822.632-4822.705=-0.073
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean8.717-9.070=-0.354
σ0.465-0.237=0.228
min8.165-8.857=-0.692
max9.151-9.463=-0.312
iters=5
new-facts=6402
prior-facts=6402
mean4996.464-4996.469=-0.005
σ0.011-0.009=0.001
min4996.445-4996.456=-0.011
max4996.472-4996.478=-0.007
mean3064.000-3026.600=37.400
σ291.515-352.038=-60.523
min2845.000-2728.000=117.000
max3513.000-3544.000=-31.000
mean8.498-8.588=-0.090
σ0.122-0.117=0.005
min8.418-8.469=-0.051
max8.714-8.725=-0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.954-0.977=-0.023
σ0.054-0.069=-0.015
min0.916-0.915=0.002
max1.048-1.054=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.967=-0.001
σ574.249-574.277=-0.028
min175.834-175.818=0.015
max1324.340-1324.382=-0.043
mean86.250
σ8.500
min82.000
max99.000
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean0.428-0.483=-0.055
σ0.296-0.412=-0.117
min0.277-0.269=0.008
max0.872-1.101=-0.230
policies=20
mean1758.719-1758.524=0.195
σ0.351-0.340=0.011
min1758.495-1758.284=0.211
max1759.239-1759.026=0.213
mean820.000
σ0.000
min820.000
max820.000
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean2.810-2.722=0.088
σ0.027-0.020=0.007
min2.782-2.699=0.082
max2.844-2.742=0.102
policies=200
mean17593.417-17592.388=1.029
σ0.579-0.456=0.123
min17592.674-17591.977=0.697
max17593.912-17593.040=0.872
mean8200.000
σ0.000
min8200.000
max8200.000
mean2845.000-2728.000=117.000
σ0.000
min2845.000-2728.000=117.000
max2845.000-2728.000=117.000
mean27.905-27.428=0.477
σ0.366-0.109=0.257
min27.540-27.305=0.235
max28.309-27.550=0.759