Compare commits

Home / Compare 8c06f7a7 .. ee360a57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.000
σ0.054-0.055=-0.001
min35.233-35.239=-0.006
max35.415-35.418=-0.003
mean414.800-411.000=3.800
σ0.422-0.000=0.422
min414.000-411.000=3.000
max415.000-411.000=4.000
mean0.085-0.083=0.002
σ0.004-0.004=-0.001
min0.082-0.076=0.006
max0.093-0.089=0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.002-0.002=-0.000
min23.767-23.766=0.001
max23.774-23.773=0.001
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.066-0.065=0.000
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.364-0.366=-0.002
min1755.910-1755.909=0.001
max1757.071-1757.073=-0.002
mean1652.350-1644.050=8.300
σ639.953-611.578=28.375
min627.000-648.000=-21.000
max2829.000-2467.000=362.000
mean2.380-2.334=0.046
σ0.145-0.076=0.069
min2.252-2.197=0.054
max2.904-2.502=0.403

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.718-324.707=0.010
σ0.030-0.050=-0.020
min324.666-324.620=0.046
max324.742-324.739=0.003
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean0.424-0.427=-0.003
σ0.003-0.007=-0.004
min0.422-0.422=0.000
max0.429-0.440=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.252=0.002
σ0.016-0.023=-0.007
min1985.231-1985.225=0.006
max1985.271-1985.278=-0.007
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean2.641-2.605=0.037
σ0.119-0.119=0.000
min2.555-2.445=0.110
max2.830-2.741=0.088
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.882=-0.024
σ7.671-7.676=-0.005
min4805.385-4805.419=-0.035
max4822.580-4822.612=-0.032
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean8.828-8.987=-0.159
σ0.122-0.132=-0.009
min8.650-8.803=-0.153
max8.988-9.126=-0.138
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.395=0.064
σ0.025-0.158=-0.133
min4996.421-4996.114=0.307
max4996.482-4996.484=-0.001
mean3063.400-2903.200=160.200
σ306.458-398.718=-92.260
min2829.000-2467.000=362.000
max3537.000-3441.000=96.000
mean8.495-8.463=0.033
σ0.126-0.064=0.062
min8.334-8.364=-0.031
max8.682-8.529=0.153

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.580=-0.578
σ0.137-0.187=-0.050
min0.913-1.288=-0.375
max1.227-1.730=-0.502

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.947=0.029
σ574.251-574.249=0.002
min175.841-175.817=0.024
max1324.353-1324.320=0.033
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean0.431-0.584=-0.153
σ0.297-0.615=-0.317
min0.281-0.273=0.008
max0.877-1.506=-0.628
policies=20
mean1758.718-1758.506=0.212
σ0.348-0.345=0.003
min1758.481-1758.267=0.214
max1759.232-1759.016=0.216
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean2.789-2.718=0.071
σ0.014-0.033=-0.019
min2.776-2.688=0.089
max2.809-2.760=0.049
policies=200
mean17593.218-17592.508=0.711
σ0.708-0.512=0.196
min17592.186-17592.201=-0.015
max17593.692-17593.274=0.417
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2467.000=362.000
σ0.000
min2829.000-2467.000=362.000
max2829.000-2467.000=362.000
mean27.846-27.450=0.397
σ0.396-0.119=0.277
min27.499-27.356=0.143
max28.281-27.614=0.667