Compare commits

Home / Compare 866d35dc .. 52315305

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.055=-0.001
min35.239-35.231=0.007
max35.415-35.416=-0.002
mean411.000-414.600=-3.600
σ0.000-0.516=-0.516
min411.000-414.000=-3.000
max411.000-415.000=-4.000
mean0.085-0.085=0.001
σ0.003-0.004=-0.000
min0.082-0.081=0.001
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.001
min23.768-23.764=0.004
max23.774-23.774=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.068-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.074-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=-0.000
σ0.366-0.365=0.001
min1755.912-1755.910=0.001
max1757.075-1757.085=-0.010
mean1644.850-1649.750=-4.900
σ642.027-644.632=-2.605
min667.000-643.000=24.000
max2724.000-2840.000=-116.000
mean2.375-2.329=0.047
σ0.119-0.098=0.021
min2.192-2.151=0.041
max2.581-2.597=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.713=-0.014
σ0.056-0.038=0.017
min324.600-324.646=-0.045
max324.737-324.737=-0.001
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean0.424-0.424=0.001
σ0.002-0.001=0.000
min0.422-0.422=-0.000
max0.426-0.426=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.273=-0.008
σ0.014-0.007=0.006
min1985.242-1985.267=-0.026
max1985.274-1985.285=-0.011
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean2.610-2.617=-0.008
σ0.084-0.084=-0.000
min2.533-2.553=-0.020
max2.727-2.728=-0.001
iters=5
new-facts=6402
prior-facts=1
mean4808.797-4808.863=-0.067
σ7.735-7.653=0.082
min4804.797-4805.387=-0.590
max4822.622-4822.554=0.068
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean8.810-8.926=-0.116
σ0.612-0.201=0.411
min7.743-8.636=-0.893
max9.263-9.136=0.127
iters=5
new-facts=6402
prior-facts=6402
mean4996.393-4996.465=-0.072
σ0.153-0.019=0.134
min4996.121-4996.445=-0.324
max4996.482-4996.490=-0.008
mean3017.600-3041.400=-23.800
σ345.238-211.079=134.159
min2724.000-2840.000=-116.000
max3528.000-3345.000=183.000
mean8.504-8.641=-0.138
σ0.119-0.183=-0.063
min8.431-8.493=-0.062
max8.714-8.935=-0.222

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-1.006=-0.061
σ0.053-0.064=-0.011
min0.911-0.920=-0.009
max1.038-1.059=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.963-462.968=-0.005
σ574.281-574.252=0.029
min175.818-175.836=-0.018
max1324.384-1324.346=0.038
mean86.250
σ8.500
min82.000
max99.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean0.541-0.464=0.077
σ0.537-0.368=0.169
min0.270-0.278=-0.007
max1.347-1.016=0.331
policies=20
mean1758.530-1758.714=-0.183
σ0.343-0.357=-0.014
min1758.298-1758.464=-0.167
max1759.037-1759.242=-0.204
mean820.000
σ0.000
min820.000
max820.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean2.712-2.782=-0.069
σ0.017-0.019=-0.001
min2.694-2.754=-0.060
max2.736-2.794=-0.058
policies=200
mean17592.502-17593.365=-0.863
σ0.460-0.631=-0.171
min17592.243-17592.632=-0.389
max17593.191-17593.900=-0.709
mean8200.000
σ0.000
min8200.000
max8200.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean27.403-27.936=-0.534
σ0.115-0.367=-0.252
min27.278-27.583=-0.305
max27.526-28.410=-0.884