Compare commits

Home / Compare 1984fc59 .. 1d87f729

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.046-0.050=-0.004
min70.748-70.747=0.001
max70.908-70.920=-0.012
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.158-0.158=-0.001
σ0.005-0.005=-0.000
min0.148-0.149=-0.001
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.004=-0.000
min21.487-21.487=0.000
max21.498-21.499=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.065-0.065=-0.001
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1751.880=2.215
σ0.360-0.358=0.002
min1753.533-1751.309=2.224
max1754.680-1752.465=2.214
mean1663.550-1648.900=14.650
σ635.766-609.384=26.382
min628.000-643.000=-15.000
max2780.000-2467.000=313.000
mean2.822-2.834=-0.012
σ0.216-0.147=0.069
min2.198-2.462=-0.263
max3.071-3.115=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-269.383=2.216
σ0.006-0.009=-0.003
min271.592-269.372=2.220
max271.605-269.395=2.210
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean0.384-0.381=0.003
σ0.005-0.009=-0.004
min0.381-0.374=0.007
max0.393-0.394=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.992-1929.745=2.247
σ0.017-0.007=0.010
min1931.964-1929.738=2.227
max1932.007-1929.754=2.252
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean2.596-2.859=-0.264
σ0.262-0.206=0.056
min2.434-2.538=-0.105
max3.061-3.031=0.030
iters=5
new-facts=6402
prior-facts=1
mean4752.627-4750.512=2.115
σ0.988-0.836=0.153
min4751.891-4750.074=1.817
max4754.353-4752.005=2.348
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean8.806-8.417=0.388
σ0.489-0.377=0.112
min8.238-7.891=0.347
max9.547-8.898=0.649
iters=5
new-facts=6402
prior-facts=6402
mean4943.140-4940.989=2.150
σ0.163-0.013=0.150
min4942.848-4940.975=1.873
max4943.221-4941.004=2.217
mean3007.200-2952.600=54.600
σ214.130-328.552=-114.422
min2780.000-2467.000=313.000
max3293.000-3349.000=-56.000
mean8.470-8.457=0.013
σ0.077-0.138=-0.061
min8.377-8.300=0.076
max8.573-8.678=-0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.777=-0.650
σ0.229-0.114=0.115
min0.936-1.630=-0.693
max1.526-1.907=-0.381

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.636-462.684=5.952
σ574.942-574.922=0.019
min181.163-175.217=5.946
max1331.048-1325.068=5.981
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean0.448-0.541=-0.093
σ0.299-0.518=-0.219
min0.297-0.277=0.020
max0.896-1.318=-0.422
policies=20
mean1811.990-1752.486=59.504
σ0.395-0.361=0.034
min1811.706-1752.255=59.451
max1812.564-1753.024=59.540
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean2.951-2.722=0.229
σ0.047-0.016=0.031
min2.921-2.705=0.215
max3.021-2.740=0.281
policies=200
mean18126.545-17532.206=594.339
σ0.377-0.450=-0.073
min18126.261-17531.824=594.436
max18127.101-17532.857=594.244
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2780.000-2467.000=313.000
σ0.000
min2780.000-2467.000=313.000
max2780.000-2467.000=313.000
mean28.683-27.594=1.090
σ0.026-0.091=-0.065
min28.654-27.525=1.129
max28.715-27.726=0.990