Compare commits

Home / Compare 8aba3c0e .. b5f9701c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.265-35.262=0.003
σ0.052-0.053=-0.000
min35.241-35.231=0.010
max35.413-35.409=0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.084-0.082=0.002
σ0.004-0.004=0.000
min0.077-0.076=0.002
max0.093-0.089=0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=0.000
min23.766-23.764=0.002
max23.774-23.773=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.066-0.067=-0.000
σ0.004-0.005=-0.001
min0.062-0.061=0.001
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.470-1756.486=-0.016
σ0.365-0.367=-0.002
min1755.894-1755.909=-0.015
max1757.060-1757.077=-0.017
mean1660.000-1647.300=12.700
σ646.956-639.265=7.691
min629.000-626.000=3.000
max2810.000-2824.000=-14.000
mean2.350-2.314=0.036
σ0.116-0.103=0.013
min2.234-2.100=0.134
max2.716-2.552=0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.697-324.709=-0.012
σ0.037-0.048=-0.011
min324.631-324.624=0.008
max324.717-324.739=-0.022
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean0.427-0.423=0.003
σ0.007-0.001=0.006
min0.422-0.423=-0.000
max0.439-0.424=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.249-1985.262=-0.013
σ0.015-0.015=-0.000
min1985.230-1985.238=-0.008
max1985.263-1985.278=-0.015
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean2.639-2.677=-0.039
σ0.163-0.113=0.050
min2.392-2.550=-0.159
max2.824-2.792=0.033
iters=5
new-facts=6402
prior-facts=1
mean4808.888-4808.861=0.027
σ7.639-7.669=-0.030
min4805.391-4805.404=-0.013
max4822.551-4822.580=-0.029
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean8.796-8.799=-0.004
σ0.485-0.141=0.344
min8.045-8.614=-0.569
max9.393-8.931=0.462
iters=5
new-facts=6402
prior-facts=6402
mean4996.384-4996.466=-0.082
σ0.150-0.021=0.129
min4996.117-4996.431=-0.315
max4996.468-4996.482=-0.015
mean3016.400-3059.000=-42.600
σ272.625-306.841=-34.216
min2810.000-2824.000=-14.000
max3443.000-3533.000=-90.000
mean8.493-8.561=-0.068
σ0.018-0.296=-0.278
min8.475-8.406=0.070
max8.518-9.089=-0.571

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.047=-0.012
σ0.127-0.159=-0.032
min0.921-0.895=0.026
max1.231-1.305=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.978=-0.031
σ574.251-574.250=0.000
min175.812-175.842=-0.030
max1324.323-1324.353=-0.030
mean86.250
σ8.500
min82.000
max99.000
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean0.427-0.430=-0.003
σ0.290-0.296=-0.005
min0.278-0.278=-0.000
max0.862-0.874=-0.011
policies=20
mean1758.477-1758.716=-0.239
σ0.355-0.349=0.005
min1758.230-1758.478=-0.248
max1759.002-1759.233=-0.232
mean820.000
σ0.000
min820.000
max820.000
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean2.787-2.783=0.004
σ0.015-0.008=0.007
min2.769-2.773=-0.004
max2.804-2.792=0.012
policies=200
mean17590.159-17593.349=-3.190
σ0.446-0.741=-0.295
min17589.759-17592.336=-2.576
max17590.643-17593.928=-3.285
mean8200.000
σ0.000
min8200.000
max8200.000
mean2810.000-2824.000=-14.000
σ0.000
min2810.000-2824.000=-14.000
max2810.000-2824.000=-14.000
mean27.496-27.828=-0.332
σ0.216-0.413=-0.197
min27.267-27.433=-0.165
max27.786-28.294=-0.507