Compare commits

Home / Compare d9817c2a .. 5f0ccf98

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.001
σ0.054-0.052=0.002
min35.214-35.220=-0.005
max35.396-35.391=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.081-0.084=-0.003
σ0.006-0.005=0.002
min0.076-0.077=-0.001
max0.094-0.092=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.004=-0.001
min23.764-23.762=0.001
max23.774-23.775=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.076-0.071=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.486=-0.002
σ0.365-0.366=-0.001
min1755.911-1755.910=0.001
max1757.070-1757.079=-0.009
mean1649.800-1648.850=0.950
σ643.595-642.152=1.443
min624.000
max2835.000-2837.000=-2.000
mean2.341-2.351=-0.010
σ0.069-0.103=-0.034
min2.264-2.195=0.069
max2.476-2.600=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.702=-0.000
σ0.056-0.055=0.001
min324.602-324.604=-0.002
max324.732-324.733=-0.000
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean0.423-0.430=-0.007
σ0.002-0.008=-0.006
min0.420-0.422=-0.001
max0.425-0.442=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.263=-0.001
σ0.014-0.014=0.001
min1985.240-1985.239=0.001
max1985.279-1985.275=0.004
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean2.663-2.613=0.050
σ0.126-0.114=0.012
min2.537-2.468=0.069
max2.846-2.746=0.100
iters=5
new-facts=6402
prior-facts=1
mean4808.880-4808.918=-0.038
σ7.658-7.650=0.008
min4805.406-4805.393=0.013
max4822.579-4822.601=-0.022
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean8.651-8.531=0.120
σ0.320-0.525=-0.205
min8.086-7.844=0.242
max8.832-8.937=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4996.458=0.008
σ0.019-0.019=-0.000
min4996.442-4996.431=0.011
max4996.489-4996.478=0.011
mean3042.000-3060.000=-18.000
σ243.873-295.058=-51.186
min2835.000-2837.000=-2.000
max3419.000-3514.000=-95.000
mean8.515-8.560=-0.045
σ0.114-0.157=-0.043
min8.409-8.468=-0.059
max8.702-8.833=-0.131

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.979=-0.006
σ0.066-0.067=-0.000
min0.911-0.919=-0.008
max1.050-1.051=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.951-462.953=-0.002
σ574.251-574.256=-0.005
min175.819-175.819=-0.000
max1324.328-1324.338=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean0.393-0.428=-0.035
σ0.271-0.291=-0.020
min0.220-0.279=-0.060
max0.797-0.864=-0.067
policies=20
mean1758.572-1758.514=0.058
σ0.352-0.267=0.085
min1758.344-1758.317=0.027
max1759.096-1758.906=0.190
mean820.000
σ0.000
min820.000
max820.000
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean2.793-2.790=0.003
σ0.013-0.005=0.007
min2.777-2.785=-0.008
max2.808-2.795=0.013
policies=200
mean17592.370-17592.442=-0.072
σ0.539-0.577=-0.037
min17591.881-17591.966=-0.085
max17593.111-17593.270=-0.159
mean8200.000
σ0.000
min8200.000
max8200.000
mean2835.000-2837.000=-2.000
σ0.000
min2835.000-2837.000=-2.000
max2835.000-2837.000=-2.000
mean27.876-27.908=-0.032
σ0.300-0.331=-0.030
min27.562-27.606=-0.044
max28.222-28.284=-0.062