Compare commits

Home / Compare 5db247ad .. ce7952e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.019
σ0.054-0.054=0.000
min35.233-35.218=0.015
max35.415-35.396=0.019
mean414.800-412.000=2.800
σ0.422-0.000=0.422
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.085-0.086=-0.001
σ0.004-0.005=-0.002
min0.082-0.083=-0.000
max0.093-0.097=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.001
min23.767-23.764=0.003
max23.774-23.775=-0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.069-0.066=0.003
σ0.004-0.004=-0.000
min0.066-0.062=0.004
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.365=0.120
σ0.364-0.366=-0.002
min1755.910-1755.788=0.122
max1757.071-1756.951=0.120
mean1652.350-1647.900=4.450
σ639.953-628.513=11.440
min627.000-618.000=9.000
max2829.000-2748.000=81.000
mean2.380-2.346=0.034
σ0.145-0.108=0.037
min2.252-2.132=0.119
max2.904-2.606=0.299

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.718-324.581=0.137
σ0.030-0.057=-0.027
min324.666-324.479=0.186
max324.742-324.612=0.130
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean0.424-0.433=-0.009
σ0.003-0.009=-0.006
min0.422-0.427=-0.005
max0.429-0.444=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.142=0.112
σ0.016-0.011=0.005
min1985.231-1985.124=0.107
max1985.271-1985.150=0.121
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean2.641-2.652=-0.011
σ0.119-0.123=-0.004
min2.555-2.557=-0.002
max2.830-2.830=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.637=0.221
σ7.671-7.473=0.198
min4805.385-4805.270=0.115
max4822.580-4822.005=0.576
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean8.828-9.060=-0.232
σ0.122-0.224=-0.101
min8.650-8.816=-0.166
max8.988-9.391=-0.403
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.337=0.122
σ0.025-0.019=0.005
min4996.421-4996.310=0.111
max4996.482-4996.358=0.124
mean3063.400-3002.600=60.800
σ306.458-299.870=6.589
min2829.000-2748.000=81.000
max3537.000-3449.000=88.000
mean8.495-8.496=-0.000
σ0.126-0.091=0.035
min8.334-8.440=-0.106
max8.682-8.656=0.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-0.950=0.053
σ0.137-0.060=0.076
min0.913-0.916=-0.002
max1.227-1.057=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.968=0.009
σ574.251-574.254=-0.003
min175.841-175.838=0.004
max1324.353-1324.349=0.004
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean0.431-0.432=-0.001
σ0.297-0.301=-0.003
min0.281-0.278=0.003
max0.877-0.883=-0.006
policies=20
mean1758.718-1758.692=0.026
σ0.348-0.297=0.051
min1758.481-1758.485=-0.004
max1759.232-1759.132=0.101
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean2.789-2.826=-0.037
σ0.014-0.083=-0.069
min2.776-2.770=0.007
max2.809-2.949=-0.140
policies=200
mean17593.218-17592.332=0.886
σ0.708-0.627=0.082
min17592.186-17591.904=0.282
max17593.692-17593.255=0.436
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2748.000=81.000
σ0.000
min2829.000-2748.000=81.000
max2829.000-2748.000=81.000
mean27.846-27.423=0.424
σ0.396-0.033=0.363
min27.499-27.379=0.120
max28.281-27.456=0.825