Compare commits

Home / Compare d6e28b07 .. 10c75030

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.781=-0.000
σ0.048-0.050=-0.002
min70.754-70.746=0.008
max70.915-70.921=-0.006
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.153-0.159=-0.005
σ0.003-0.005=-0.002
min0.150-0.152=-0.002
max0.159-0.165=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.493-21.495=-0.001
σ0.003-0.003=0.000
min21.489-21.491=-0.003
max21.498-21.500=-0.002
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.065-0.066=-0.001
σ0.002-0.002=0.000
min0.064-0.064=-0.000
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1751.881=2.212
σ0.359-0.360=-0.001
min1753.531-1751.313=2.219
max1754.674-1752.464=2.210
mean1656.450-1640.200=16.250
σ630.543-627.978=2.565
min627.000-621.000=6.000
max2773.000-2775.000=-2.000
mean2.816-2.884=-0.068
σ0.143-0.198=-0.055
min2.383-2.320=0.063
max3.125-3.138=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.600-269.378=2.222
σ0.003-0.006=-0.003
min271.596-269.373=2.223
max271.604-269.387=2.217
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean0.385-0.377=0.008
σ0.004-0.005=-0.001
min0.382-0.374=0.008
max0.390-0.387=0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.983-1929.741=2.242
σ0.025-0.018=0.007
min1931.950-1929.723=2.226
max1932.011-1929.764=2.248
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean2.523-2.996=-0.473
σ0.105-0.105=0.000
min2.376-2.835=-0.459
max2.646-3.127=-0.482
iters=5
new-facts=6402
prior-facts=1
mean4752.593-4750.503=2.090
σ0.688-0.845=-0.156
min4752.242-4750.046=2.196
max4753.822-4752.009=1.813
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean8.786-8.451=0.335
σ0.253-0.439=-0.185
min8.486-7.834=0.651
max9.029-8.898=0.131
iters=5
new-facts=6402
prior-facts=6402
mean4943.135-4940.853=2.282
σ0.152-0.181=-0.030
min4942.864-4940.633=2.231
max4943.216-4940.997=2.219
mean3025.800-2968.000=57.800
σ231.467-256.031=-24.564
min2773.000-2775.000=-2.000
max3329.000-3375.000=-46.000
mean8.544-8.395=0.148
σ0.141-0.045=0.096
min8.406-8.347=0.059
max8.762-8.463=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.027=-0.012
σ0.138-0.139=-0.001
min0.921-0.933=-0.012
max1.247-1.254=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.639-462.719=5.920
σ574.923-574.967=-0.045
min181.168-175.225=5.943
max1331.023-1325.170=5.853
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean0.449-0.585=-0.136
σ0.305-0.623=-0.318
min0.296-0.272=0.025
max0.906-1.520=-0.613
policies=20
mean1811.981-1752.497=59.484
σ0.367-0.360=0.007
min1811.714-1752.283=59.431
max1812.516-1753.035=59.480
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean2.919-2.737=0.182
σ0.133-0.026=0.107
min2.829-2.710=0.119
max3.113-2.772=0.340
policies=200
mean18126.481-17532.348=594.133
σ0.556-0.503=0.053
min18126.053-17532.088=593.965
max18127.281-17533.102=594.179
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2773.000-2775.000=-2.000
σ0.000
min2773.000-2775.000=-2.000
max2773.000-2775.000=-2.000
mean28.683-27.641=1.041
σ0.198-0.136=0.061
min28.547-27.541=1.006
max28.971-27.835=1.136