Compare commits

Home / Compare d417a627 .. d2915aff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.685=0.096
σ0.047-0.044=0.002
min70.747-70.659=0.089
max70.911-70.810=0.101
mean415.000-415.900=-0.900
σ0.000-0.316=-0.316
min415.000
max415.000-416.000=-1.000
mean0.160-0.158=0.002
σ0.004-0.004=0.001
min0.157-0.150=0.007
max0.169-0.163=0.006
cache=y
dps=1
iters=10
policies=100
mean21.493-21.421=0.072
σ0.002-0.002=-0.001
min21.491-21.417=0.074
max21.496-21.424=0.071
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.059=0.004
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.458=-0.363
σ0.361-0.359=0.002
min1753.529-1753.891=-0.363
max1754.676-1755.016=-0.340
mean1643.400-1670.950=-27.550
σ604.721-652.623=-47.902
min655.000-641.000=14.000
max2458.000-2870.000=-412.000
mean2.848-2.806=0.042
σ0.169-0.202=-0.034
min2.277-2.288=-0.011
max3.190-3.137=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.951-273.502=-1.551
σ0.006-0.004=0.002
min271.944-273.498=-1.554
max271.958-273.507=-1.550
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean0.380-0.378=0.002
σ0.002-0.006=-0.004
min0.378-0.375=0.003
max0.383-0.388=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.329-1933.899=-1.571
σ0.010-0.019=-0.009
min1932.319-1933.873=-1.554
max1932.342-1933.927=-1.585
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean2.966-2.973=-0.008
σ0.138-0.300=-0.162
min2.727-2.463=0.264
max3.084-3.245=-0.161
iters=5
new-facts=6402
prior-facts=1
mean4752.948-4754.696=-1.748
σ0.995-0.890=0.105
min4752.153-4754.162=-2.009
max4754.685-4756.274=-1.589
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean8.644-8.372=0.272
σ0.556-0.523=0.032
min7.772-7.843=-0.071
max9.240-9.080=0.159
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4945.117=-1.628
σ0.152-0.017=0.135
min4943.218-4945.095=-1.877
max4943.577-4945.142=-1.566
mean2979.000-3064.000=-85.000
σ256.990-249.848=7.142
min2638.000-2870.000=-232.000
max3300.000-3436.000=-136.000
mean8.458-8.491=-0.033
σ0.096-0.110=-0.014
min8.311-8.410=-0.099
max8.552-8.679=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.831-1.022=0.809
σ0.099-0.142=-0.043
min1.740-0.920=0.820
max1.986-1.256=0.730

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.627-472.567=-3.940
σ574.923-574.931=-0.008
min181.164-185.097=-3.933
max1331.011-1334.963=-3.952
mean88.250
σ8.500
min84.000
max101.000
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean0.579-0.452=0.126
σ0.571-0.308=0.263
min0.288-0.296=-0.007
max1.435-0.914=0.520
policies=20
mean1811.914-1851.297=-39.383
σ0.372-0.365=0.007
min1811.689-1851.036=-39.347
max1812.465-1851.829=-39.364
mean840.000
σ0.000
min840.000
max840.000
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean2.820-2.966=-0.146
σ0.036-0.013=0.023
min2.773-2.949=-0.177
max2.860-2.979=-0.119
policies=200
mean18126.656-18519.469=-392.813
σ0.535-0.434=0.101
min18126.243-18519.134=-392.891
max18127.418-18520.087=-392.669
mean8400.000
σ0.000
min8400.000
max8400.000
mean2458.000-2870.000=-412.000
σ0.000
min2458.000-2870.000=-412.000
max2458.000-2870.000=-412.000
mean28.602-29.255=-0.653
σ0.085-0.456=-0.372
min28.509-28.938=-0.429
max28.688-29.931=-1.242