Compare commits

Home / Compare 6430f6b7 .. 050ac175

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.564=0.003
σ0.047-0.047=-0.000
min70.542-70.541=0.001
max70.695-70.697=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.163=-0.003
σ0.003-0.004=-0.001
min0.156-0.158=-0.002
max0.165-0.170=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.002=0.001
min21.283-21.286=-0.003
max21.292-21.293=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.063-0.059=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.374=-0.001
σ0.359-0.359=0.000
min1752.810-1752.804=0.005
max1753.955-1753.965=-0.010
mean1653.400-1660.650=-7.250
σ649.684-637.131=12.553
min633.000-618.000=15.000
max2908.000-2803.000=105.000
mean2.812-2.746=0.065
σ0.096-0.243=-0.148
min2.639-2.158=0.481
max2.956-2.989=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.754=0.004
σ0.004-0.007=-0.003
min271.753-271.747=0.007
max271.763-271.763=0.000
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean0.383-0.383=0.000
σ0.008-0.006=0.003
min0.376-0.379=-0.003
max0.397-0.393=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.181-1932.185=-0.004
σ0.009-0.014=-0.004
min1932.170-1932.172=-0.002
max1932.193-1932.208=-0.015
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean2.954-2.945=0.009
σ0.194-0.306=-0.113
min2.647-2.434=0.213
max3.138-3.221=-0.083
iters=5
new-facts=6402
prior-facts=1
mean4752.921-4752.723=0.199
σ0.853-0.675=0.177
min4752.444-4752.132=0.312
max4754.438-4753.876=0.562
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean8.450-8.356=0.094
σ0.513-0.528=-0.015
min7.619-7.668=-0.050
max8.893-9.045=-0.152
iters=5
new-facts=6402
prior-facts=6402
mean4943.234-4943.377=-0.142
σ0.196-0.020=0.177
min4943.016-4943.356=-0.340
max4943.390-4943.400=-0.010
mean3100.600-3044.200=56.400
σ214.974-250.165=-35.191
min2908.000-2803.000=105.000
max3431.000-3402.000=29.000
mean8.610-8.546=0.064
σ0.248-0.100=0.147
min8.248-8.427=-0.179
max8.898-8.655=0.243

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.036-1.108=-0.073
σ0.108-0.247=-0.139
min0.933-0.934=-0.002
max1.194-1.533=-0.339

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.856-467.856=4.999
σ575.914-575.934=-0.020
min184.893-179.881=5.012
max1336.726-1331.757=4.969
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean0.448-0.482=-0.034
σ0.301-0.398=-0.097
min0.292-0.282=0.010
max0.899-1.079=-0.180
policies=20
mean1849.226-1799.150=50.075
σ0.376-0.366=0.009
min1848.940-1798.938=50.003
max1849.769-1799.697=50.072
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean2.943-2.807=0.136
σ0.001-0.012=-0.011
min2.941-2.790=0.152
max2.944-2.815=0.129
policies=200
mean18498.801-17998.514=500.287
σ0.445-0.519=-0.074
min18498.535-17998.223=500.313
max18499.464-17999.291=500.173
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2908.000-2803.000=105.000
σ0.000
min2908.000-2803.000=105.000
max2908.000-2803.000=105.000
mean29.192-28.331=0.861
σ0.459-0.089=0.370
min28.770-28.244=0.526
max29.638-28.418=1.220