Compare commits

Home / Compare 919715a7 .. 88bca08f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.019
σ0.054-0.054=-0.000
min35.233-35.213=0.020
max35.415-35.398=0.018
mean414.800-414.000=0.800
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.085-0.085=-0.000
σ0.004-0.005=-0.002
min0.082-0.077=0.005
max0.093-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.002=0.000
min23.767-23.765=0.002
max23.774-23.771=0.003
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.069-0.067=0.002
σ0.004-0.002=0.001
min0.066-0.066=0.000
max0.075-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.487=-0.002
σ0.364-0.366=-0.002
min1755.910-1755.908=0.002
max1757.071-1757.071=0.000
mean1652.350-1654.200=-1.850
σ639.953-644.519=-4.566
min627.000-626.000=1.000
max2829.000-2843.000=-14.000
mean2.380-2.326=0.054
σ0.145-0.071=0.074
min2.252-2.213=0.038
max2.904-2.519=0.385

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.718-324.701=0.017
σ0.030-0.057=-0.027
min324.666-324.601=0.065
max324.742-324.736=0.006
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean0.424-0.432=-0.007
σ0.003-0.011=-0.008
min0.422-0.425=-0.003
max0.429-0.450=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.269=-0.016
σ0.016-0.006=0.010
min1985.231-1985.263=-0.031
max1985.271-1985.279=-0.008
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean2.641-2.610=0.031
σ0.119-0.089=0.029
min2.555-2.515=0.040
max2.830-2.721=0.109
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.761=0.096
σ7.671-7.797=-0.125
min4805.385-4804.826=0.559
max4822.580-4822.700=-0.120
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean8.828-9.014=-0.185
σ0.122-0.185=-0.062
min8.650-8.897=-0.247
max8.988-9.340=-0.352
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.460=-0.001
σ0.025-0.025=-0.000
min4996.421-4996.433=-0.012
max4996.482-4996.487=-0.005
mean3063.400-3061.200=2.200
σ306.458-233.615=72.843
min2829.000-2843.000=-14.000
max3537.000-3406.000=131.000
mean8.495-8.689=-0.193
σ0.126-0.183=-0.057
min8.334-8.504=-0.170
max8.682-8.943=-0.261

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.027=-0.024
σ0.137-0.046=0.091
min0.913-0.946=-0.032
max1.227-1.054=0.173

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.971=0.006
σ574.251-574.251=0.000
min175.841-175.840=0.001
max1324.353-1324.346=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean0.431-0.432=-0.001
σ0.297-0.300=-0.003
min0.281-0.278=0.002
max0.877-0.882=-0.005
policies=20
mean1758.718-1758.705=0.013
σ0.348-0.342=0.006
min1758.481-1758.477=0.004
max1759.232-1759.213=0.019
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean2.789-2.778=0.010
σ0.014-0.002=0.012
min2.776-2.776=0.000
max2.809-2.780=0.029
policies=200
mean17593.218-17593.396=-0.178
σ0.708-0.590=0.119
min17592.186-17592.617=-0.431
max17593.692-17593.871=-0.179
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2843.000=-14.000
σ0.000
min2829.000-2843.000=-14.000
max2829.000-2843.000=-14.000
mean27.846-27.881=-0.035
σ0.396-0.271=0.125
min27.499-27.605=-0.106
max28.281-28.144=0.137