Compare commits

Home / Compare 77be63c4 .. 9a22a51e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.052-0.054=-0.001
min35.583-35.584=-0.001
max35.764-35.768=-0.004
mean412.300-415.000=-2.700
σ0.483-0.000=0.483
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.086-0.085=0.002
σ0.005-0.003=0.001
min0.083-0.082=0.001
max0.095-0.091=0.004
cache=y
dps=1
iters=10
policies=100
mean24.046-24.046=0.001
σ0.002-0.003=-0.000
min24.044-24.042=0.002
max24.050-24.051=-0.001
mean413.000-415.600=-2.600
σ0.000-0.516=-0.516
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.069-0.064=0.005
σ0.003-0.005=-0.002
min0.067-0.061=0.006
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.003
σ0.364-0.365=-0.001
min1755.915-1755.915=0.000
max1757.074-1757.080=-0.007
mean1651.550-1653.350=-1.800
σ645.559-645.419=0.140
min631.000-633.000=-2.000
max2842.000-2845.000=-3.000
mean2.344-2.330=0.015
σ0.083-0.060=0.024
min2.255-2.234=0.022
max2.526-2.434=0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.774-324.760=0.014
σ0.040-0.062=-0.022
min324.705-324.650=0.055
max324.807-324.798=0.009
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean0.428-0.431=-0.003
σ0.007-0.012=-0.005
min0.421-0.421=0.000
max0.439-0.446=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.306-1985.319=-0.013
σ0.024-0.026=-0.002
min1985.275-1985.273=0.001
max1985.330-1985.339=-0.009
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean2.667-2.586=0.081
σ0.094-0.084=0.011
min2.561-2.465=0.096
max2.759-2.682=0.077
iters=5
new-facts=6402
prior-facts=1
mean4809.076-4809.105=-0.029
σ7.723-7.779=-0.056
min4805.565-4805.591=-0.027
max4822.890-4823.020=-0.130
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean8.812-9.049=-0.237
σ0.178-0.319=-0.141
min8.556-8.791=-0.235
max9.054-9.575=-0.521
iters=5
new-facts=6402
prior-facts=6402
mean4996.560-4996.481=0.079
σ0.146-0.201=-0.055
min4996.300-4996.247=0.053
max4996.652-4996.641=0.011
mean3049.400-3060.400=-11.000
σ285.262-230.370=54.892
min2842.000-2845.000=-3.000
max3501.000-3400.000=101.000
mean8.518-8.670=-0.152
σ0.127-0.160=-0.033
min8.411-8.454=-0.042
max8.691-8.898=-0.207

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-0.990=-0.037
σ0.056-0.072=-0.017
min0.921-0.928=-0.008
max1.050-1.074=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.216=-0.012
σ574.767-574.773=-0.005
min175.815-175.819=-0.003
max1325.355-1325.375=-0.020
mean86.250
σ8.500
min82.000
max99.000
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean0.434-0.435=-0.001
σ0.305-0.304=0.001
min0.278-0.281=-0.003
max0.891-0.891=-0.001
policies=20
mean1758.518-1758.520=-0.002
σ0.358-0.342=0.016
min1758.282-1758.293=-0.011
max1759.048-1759.028=0.020
mean820.000
σ0.000
min820.000
max820.000
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean2.798-2.786=0.012
σ0.033-0.007=0.026
min2.772-2.778=-0.006
max2.846-2.794=0.052
policies=200
mean17592.202-17592.199=0.003
σ0.477-0.475=0.002
min17591.811-17591.848=-0.038
max17592.891-17592.900=-0.010
mean8200.000
σ0.000
min8200.000
max8200.000
mean2842.000-2845.000=-3.000
σ0.000
min2842.000-2845.000=-3.000
max2842.000-2845.000=-3.000
mean27.882-27.954=-0.072
σ0.383-0.341=0.043
min27.470-27.563=-0.094
max28.334-28.360=-0.026