Compare commits

Home / Compare 89edd71a .. 3d3db82d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.917=-0.270
σ0.366-0.368=-0.002
min53.512-53.785=-0.273
max54.688-54.965=-0.277
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.139-0.146=-0.007
σ0.004-0.008=-0.004
min0.134-0.138=-0.003
max0.145-0.158=-0.013
cache=y
dps=1
iters=10
policies=100
mean42.941-43.141=-0.199
σ0.007-0.007=0.000
min42.929-43.131=-0.202
max42.953-43.151=-0.198
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.121=0.000
σ0.004-0.004=0.000
min0.117-0.113=0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.820=-0.017
σ1.259-1.239=0.020
min991.220-991.230=-0.010
max997.101-997.020=0.081
mean1063.750-1067.900=-4.150
σ322.097-312.912=9.185
min569.000-614.000=-45.000
max1639.000-1645.000=-6.000
mean1.541-1.540=0.001
σ0.092-0.068=0.024
min1.461-1.422=0.038
max1.733-1.719=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.410=-0.017
σ0.007-0.014=-0.007
min285.382-285.393=-0.010
max285.399-285.432=-0.033
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.381-0.375=0.006
σ0.008-0.009=-0.001
min0.374-0.368=0.006
max0.393-0.388=0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.355-1285.365=-0.011
σ0.132-0.114=0.018
min1285.291-1285.308=-0.016
max1285.590-1285.569=0.021
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean1.981-1.916=0.065
σ0.131-0.178=-0.047
min1.832-1.753=0.079
max2.140-2.216=-0.076
iters=5
new-facts=6402
prior-facts=1
mean1807.723-1807.686=0.038
σ6.995-7.019=-0.025
min1804.340-1804.333=0.007
max1820.218-1820.226=-0.008
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.287-4.096=0.192
σ0.263-0.205=0.059
min4.024-3.902=0.121
max4.684-4.397=0.287
iters=5
new-facts=6402
prior-facts=6402
mean2070.180-2070.199=-0.020
σ0.009-0.013=-0.004
min2070.167-2070.186=-0.019
max2070.192-2070.219=-0.027
mean1833.000-1839.200=-6.200
σ193.826-169.259=24.567
min1639.000-1645.000=-6.000
max2080.000-2076.000=4.000
mean4.449-4.496=-0.047
σ0.055-0.029=0.026
min4.367-4.462=-0.095
max4.505-4.536=-0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.095-1.228=-0.133
σ0.197-0.346=-0.149
min0.910-0.908=0.003
max1.362-1.784=-0.422

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.783-436.784=-0.001
σ572.354-572.360=-0.006
min150.596-150.595=0.000
max1295.314-1295.324=-0.010
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.535-0.522=0.013
σ0.574-0.545=0.029
min0.246-0.247=-0.001
max1.396-1.340=0.057
policies=20
mean1506.185-1506.248=-0.063
σ0.224-0.233=-0.009
min1506.042-1506.092=-0.050
max1506.520-1506.595=-0.075
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.510-2.513=-0.003
σ0.015-0.009=0.006
min2.496-2.503=-0.007
max2.523-2.524=-0.001
policies=200
mean15069.434-15070.316=-0.882
σ0.110-0.121=-0.011
min15069.316-15070.198=-0.882
max15069.581-15070.442=-0.861
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean25.450-25.457=-0.007
σ0.091-0.076=0.015
min25.368-25.364=0.004
max25.552-25.526=0.026