Compare commits

Home / Compare 56e61771 .. e6a8b413

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.784=-0.002
σ0.045-0.047=-0.002
min70.751-70.748=0.002
max70.907-70.914=-0.008
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.158-0.158=0.001
σ0.004-0.005=-0.001
min0.155-0.150=0.004
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.004-0.002=0.001
min21.488-21.490=-0.002
max21.498-21.496=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.000
min0.063-0.064=-0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.896-1754.895=0.000
σ0.361-0.360=0.001
min1754.330-1754.322=0.009
max1755.482-1755.486=-0.003
mean1656.900-1665.700=-8.800
σ618.528-642.651=-24.123
min685.000-678.000=7.000
max2771.000-2704.000=67.000
mean2.799-2.798=0.000
σ0.177-0.254=-0.077
min2.193-2.150=0.043
max3.017-3.503=-0.485

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.759=-0.002
σ0.005-0.006=-0.001
min272.754-272.754=-0.001
max272.766-272.767=-0.001
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean0.385-0.383=0.002
σ0.007-0.004=0.003
min0.381-0.379=0.002
max0.397-0.390=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.122-1933.130=-0.008
σ0.017-0.011=0.006
min1933.100-1933.121=-0.020
max1933.141-1933.146=-0.004
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean3.118-3.103=0.015
σ0.095-0.094=0.001
min3.006-2.990=0.016
max3.232-3.189=0.043
iters=5
new-facts=6402
prior-facts=1
mean4753.881-4753.838=0.044
σ0.905-0.938=-0.032
min4753.399-4753.128=0.271
max4755.495-4755.479=0.016
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean8.511-8.480=0.031
σ0.423-0.498=-0.075
min7.894-7.962=-0.068
max8.895-9.063=-0.168
iters=5
new-facts=6402
prior-facts=6402
mean4944.222-4944.357=-0.135
σ0.310-0.018=0.292
min4943.668-4944.332=-0.664
max4944.381-4944.375=0.006
mean3016.000-2996.000=20.000
σ304.687-328.917=-24.230
min2771.000-2704.000=67.000
max3467.000-3465.000=2.000
mean8.483-8.433=0.050
σ0.126-0.095=0.031
min8.382-8.327=0.054
max8.650-8.564=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.104=-0.045
σ0.134-0.142=-0.008
min0.937-0.930=0.007
max1.267-1.257=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-468.644=0.012
σ574.892-574.894=-0.002
min181.205-181.186=0.018
max1330.993-1330.985=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean0.447-0.583=-0.136
σ0.306-0.594=-0.288
min0.291-0.284=0.006
max0.907-1.475=-0.568
policies=20
mean1812.310-1812.172=0.139
σ0.345-0.379=-0.034
min1812.119-1811.926=0.193
max1812.826-1812.733=0.093
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean2.912-2.833=0.079
σ0.094-0.022=0.072
min2.841-2.804=0.037
max3.047-2.856=0.191
policies=200
mean18129.202-18129.190=0.012
σ0.483-0.528=-0.045
min18128.903-18128.806=0.097
max18129.914-18129.970=-0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2704.000=67.000
σ0.000
min2771.000-2704.000=67.000
max2771.000-2704.000=67.000
mean28.588-28.500=0.088
σ0.048-0.071=-0.023
min28.553-28.413=0.140
max28.657-28.563=0.094