Compare commits

Home / Compare b4ed22f1 .. 0213b8f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.706=0.001
σ0.045-0.047=-0.001
min70.677-70.672=0.005
max70.834-70.836=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.161-0.158=0.003
σ0.003-0.006=-0.003
min0.158-0.150=0.008
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.412-21.412=0.000
σ0.003-0.003=-0.000
min21.407
max21.416-21.417=-0.001
mean414.000-417.900=-3.900
σ0.000-0.316=-0.316
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.929=0.001
σ0.360-0.358=0.002
min1754.355-1754.364=-0.009
max1755.514-1755.502=0.012
mean1661.800-1649.250=12.550
σ621.237-631.656=-10.419
min624.000-628.000=-4.000
max2513.000-2773.000=-260.000
mean2.815-2.804=0.011
σ0.128-0.194=-0.066
min2.485-2.371=0.114
max2.940-3.191=-0.252

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.788-272.794=-0.006
σ0.009-0.006=0.003
min272.784-272.783=0.001
max272.804-272.797=0.007
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean0.382-0.381=0.001
σ0.009-0.009=0.001
min0.377-0.373=0.003
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.218-1933.229=-0.012
σ0.018-0.009=0.009
min1933.193-1933.218=-0.025
max1933.238-1933.241=-0.003
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean3.071-2.883=0.188
σ0.090-0.276=-0.186
min3.008-2.416=0.591
max3.229-3.067=0.162
iters=5
new-facts=6402
prior-facts=1
mean4756.886-4757.008=-0.122
σ7.296-7.569=-0.273
min4753.589-4753.543=0.045
max4769.937-4770.547=-0.610
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean8.278-8.159=0.118
σ0.373-0.477=-0.105
min7.737-7.674=0.063
max8.612-8.772=-0.160
iters=5
new-facts=6402
prior-facts=6402
mean4944.449-4944.451=-0.001
σ0.021-0.022=-0.001
min4944.422-4944.428=-0.006
max4944.473-4944.484=-0.011
mean2920.800-3017.600=-96.800
σ366.784-285.499=81.285
min2513.000-2773.000=-260.000
max3429.000-3428.000=1.000
mean8.408-8.497=-0.089
σ0.102-0.109=-0.007
min8.253-8.357=-0.104
max8.535-8.652=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.534-1.035=0.500
σ0.187-0.124=0.062
min1.227-0.915=0.312
max1.731-1.221=0.510

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.305-468.324=-0.019
σ574.232-574.227=0.005
min181.186-181.200=-0.014
max1329.653-1329.664=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean0.564-0.443=0.120
σ0.561-0.304=0.257
min0.281-0.288=-0.007
max1.406-0.899=0.506
policies=20
mean1812.159-1812.338=-0.180
σ0.375-0.390=-0.015
min1811.919-1812.058=-0.140
max1812.716-1812.909=-0.193
mean840.000
σ0.000
min840.000
max840.000
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean2.800-2.884=-0.084
σ0.017-0.026=-0.008
min2.778-2.865=-0.087
max2.821-2.922=-0.101
policies=200
mean18128.972-18128.991=-0.019
σ0.502-0.483=0.019
min18128.694-18128.681=0.013
max18129.725-18129.710=0.014
mean8400.000
σ0.000
min8400.000
max8400.000
mean2513.000-2773.000=-260.000
σ0.000
min2513.000-2773.000=-260.000
max2513.000-2773.000=-260.000
mean28.312-28.322=-0.010
σ0.054-0.171=-0.117
min28.243-28.223=0.020
max28.370-28.578=-0.208