Compare commits

Home / Compare ac39e71d .. b4f486f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.567=0.000
σ0.045-0.044=0.001
min70.541-70.540=0.002
max70.693-70.688=0.006
mean414.900-415.000=-0.100
σ0.316-0.000=0.316
min414.000-415.000=-1.000
max415.000
mean0.160-0.159=0.001
σ0.003-0.003=0.000
min0.156-0.153=0.004
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.000
σ0.003-0.003=0.001
min21.283-21.283=-0.000
max21.293-21.291=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.062-0.062=0.001
σ0.004-0.004=-0.000
min0.058-0.058=0.001
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.363-0.361=0.002
min1752.803-1752.805=-0.002
max1753.975-1753.960=0.015
mean1651.300-1645.550=5.750
σ635.486-642.022=-6.536
min634.000
max2851.000-2881.000=-30.000
mean2.748-2.817=-0.070
σ0.199-0.184=0.015
min2.250-2.248=0.003
max2.956-3.113=-0.157

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-271.742=0.017
σ0.006-0.015=-0.009
min271.751-271.729=0.023
max271.767-271.765=0.002
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean0.383-0.382=0.001
σ0.005-0.007=-0.002
min0.380-0.372=0.008
max0.392-0.390=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.186-1932.175=0.012
σ0.013-0.005=0.007
min1932.172-1932.168=0.004
max1932.207-1932.181=0.026
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean3.056-3.050=0.006
σ0.157-0.142=0.015
min2.905-2.958=-0.053
max3.287-3.297=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4752.650-4752.960=-0.310
σ0.729-0.761=-0.032
min4751.916-4752.512=-0.596
max4753.876-4754.317=-0.441
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean8.657-8.011=0.646
σ0.371-0.344=0.027
min8.048-7.693=0.355
max8.934-8.545=0.388
iters=5
new-facts=6402
prior-facts=6402
mean4943.370-4943.304=0.066
σ0.016-0.167=-0.152
min4943.353-4943.006=0.347
max4943.389-4943.395=-0.006
mean2980.400-3083.000=-102.600
σ162.124-277.996=-115.871
min2851.000-2881.000=-30.000
max3248.000-3518.000=-270.000
mean8.471-8.408=0.063
σ0.048-0.100=-0.052
min8.420-8.326=0.094
max8.543-8.579=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.038-1.065=-0.027
σ0.219-0.104=0.116
min0.935-0.931=0.004
max1.430-1.222=0.208

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.858-467.859=4.999
σ575.922-575.924=-0.002
min184.885-179.885=5.000
max1336.741-1331.745=4.996
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean0.454-0.445=0.009
σ0.301-0.299=0.002
min0.300-0.294=0.006
max0.906-0.894=0.012
policies=20
mean1849.231-1799.163=50.068
σ0.376-0.378=-0.001
min1848.937-1798.884=50.053
max1849.775-1799.719=50.056
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean2.964-2.878=0.086
σ0.009-0.004=0.004
min2.955-2.873=0.082
max2.973-2.883=0.090
policies=200
mean18498.752-17998.536=500.216
σ0.433-0.509=-0.076
min18498.438-17998.278=500.160
max18499.387-17999.299=500.088
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2851.000-2881.000=-30.000
σ0.000
min2851.000-2881.000=-30.000
max2851.000-2881.000=-30.000
mean29.322-28.545=0.778
σ0.409-0.393=0.016
min28.917-28.130=0.787
max29.758-29.013=0.745