Compare commits

Home / Compare d41ac5f3 .. 433bd3bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.000
σ0.045-0.045=-0.001
min70.674-70.675=-0.002
max70.827-70.828=-0.002
mean417.200-418.000=-0.800
σ0.422-0.000=0.422
min417.000-418.000=-1.000
max418.000
mean0.160-0.161=-0.001
σ0.004-0.004=0.000
min0.152-0.154=-0.001
max0.166-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.410=-0.001
σ0.003-0.003=0.000
min21.404-21.404=0.000
max21.413-21.414=-0.002
mean418.000
σ0.000
min418.000
max418.000
mean0.065-0.064=0.002
σ0.003-0.004=-0.001
min0.064-0.059=0.005
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.928-1754.932=-0.004
σ0.360-0.363=-0.002
min1754.355-1754.363=-0.008
max1755.516-1755.530=-0.014
mean1642.350-1662.800=-20.450
σ615.711-618.569=-2.858
min627.000
max2480.000-2509.000=-29.000
mean2.775-2.772=0.003
σ0.189-0.194=-0.005
min2.268-2.230=0.038
max2.985-2.973=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.759=-0.001
σ0.002-0.006=-0.004
min272.755-272.752=0.003
max272.760-272.766=-0.005
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean0.381-0.381=-0.000
σ0.007-0.006=0.002
min0.377-0.378=-0.000
max0.394-0.391=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.160-1933.166=-0.006
σ0.009-0.011=-0.002
min1933.151-1933.150=0.000
max1933.172-1933.175=-0.003
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean2.930-2.978=-0.048
σ0.126-0.213=-0.087
min2.724-2.743=-0.019
max3.034-3.215=-0.181
iters=5
new-facts=6402
prior-facts=1
mean4756.736-4756.751=-0.014
σ7.380-7.797=-0.417
min4753.116-4753.043=0.073
max4769.934-4770.695=-0.760
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean8.586-8.692=-0.107
σ0.311-0.533=-0.222
min8.246-8.013=0.233
max8.971-9.424=-0.454
iters=5
new-facts=6402
prior-facts=6402
mean4944.251-4944.397=-0.145
σ0.322-0.019=0.303
min4943.675-4944.372=-0.697
max4944.403-4944.416=-0.013
mean2921.200-2942.000=-20.800
σ385.873-385.931=-0.059
min2480.000-2509.000=-29.000
max3461.000-3433.000=28.000
mean8.432-8.500=-0.068
σ0.056-0.095=-0.039
min8.382-8.435=-0.053
max8.514-8.666=-0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.673-1.666=0.007
σ0.136-0.182=-0.046
min1.478-1.358=0.119
max1.804-1.804=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.319=0.002
σ574.256-574.257=-0.001
min181.186-181.188=-0.002
max1329.705-1329.705=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean0.565-0.550=0.015
σ0.562-0.535=0.027
min0.282-0.282=0.001
max1.408-1.352=0.055
policies=20
mean1812.171-1812.175=-0.004
σ0.378-0.386=-0.008
min1811.923-1811.923=0.000
max1812.731-1812.747=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean2.823-2.816=0.007
σ0.012-0.009=0.004
min2.811-2.808=0.003
max2.840-2.827=0.013
policies=200
mean18129.078-18128.907=0.171
σ0.461-0.506=-0.045
min18128.793-18128.532=0.262
max18129.763-18129.638=0.125
mean8400.000
σ0.000
min8400.000
max8400.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean28.369-28.403=-0.035
σ0.101-0.090=0.011
min28.263-28.278=-0.015
max28.470-28.480=-0.010