Compare commits

Home / Compare 0a7f3e36 .. eee7bd61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.566=0.215
σ0.047-0.049=-0.001
min70.751-70.541=0.210
max70.912-70.702=0.211
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.159-0.159=0.000
σ0.005-0.004=0.001
min0.149-0.153=-0.004
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.289=0.204
σ0.002-0.003=-0.001
min21.489-21.282=0.207
max21.496-21.293=0.203
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.064=0.001
σ0.003-0.002=0.000
min0.063-0.058=0.005
max0.073-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1753.376=0.719
σ0.359-0.359=-0.000
min1753.532-1752.802=0.730
max1754.675-1753.959=0.715
mean1659.700-1649.650=10.050
σ631.856-642.904=-11.048
min629.000-634.000=-5.000
max2710.000-2881.000=-171.000
mean2.858-2.805=0.053
σ0.114-0.149=-0.035
min2.559-2.340=0.219
max3.068-2.999=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.956-271.757=0.199
σ0.005-0.007=-0.002
min271.952-271.747=0.205
max271.963-271.766=0.197
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean0.379-0.381=-0.003
σ0.002-0.003=-0.001
min0.377-0.379=-0.002
max0.382-0.386=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.326-1932.176=0.150
σ0.006-0.006=-0.000
min1932.317-1932.171=0.146
max1932.331-1932.184=0.148
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean2.918-2.941=-0.024
σ0.132-0.113=0.018
min2.706-2.751=-0.045
max3.015-3.051=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4753.036-4752.898=0.138
σ0.577-0.916=-0.340
min4752.700-4752.392=0.308
max4754.059-4754.534=-0.476
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean8.162-8.696=-0.534
σ0.340-0.238=0.101
min7.748-8.507=-0.759
max8.533-9.070=-0.537
iters=5
new-facts=6402
prior-facts=6402
mean4943.551-4943.297=0.253
σ0.023-0.161=-0.138
min4943.516-4943.012=0.504
max4943.572-4943.391=0.180
mean2962.400-3030.400=-68.000
σ301.568-176.130=125.438
min2710.000-2881.000=-171.000
max3411.000-3312.000=99.000
mean8.484-8.502=-0.018
σ0.170-0.131=0.039
min8.337-8.373=-0.036
max8.755-8.644=0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.018=0.053
σ0.186-0.139=0.048
min0.925-0.918=0.007
max1.382-1.244=0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.660-467.862=0.798
σ574.936-575.925=-0.989
min181.186-179.896=1.290
max1331.064-1331.750=-0.686
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean0.569-0.444=0.125
σ0.560-0.299=0.261
min0.285-0.291=-0.006
max1.408-0.891=0.517
policies=20
mean1812.171-1799.221=12.950
σ0.388-0.375=0.012
min1811.904-1798.959=12.945
max1812.745-1799.772=12.973
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean2.830-2.932=-0.102
σ0.011-0.030=-0.019
min2.818-2.889=-0.071
max2.841-2.956=-0.115
policies=200
mean18129.146-17998.550=130.596
σ0.517-0.417=0.100
min18128.724-17998.239=130.485
max18129.894-17999.165=130.729
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2710.000-2881.000=-171.000
σ0.000
min2710.000-2881.000=-171.000
max2710.000-2881.000=-171.000
mean28.570-28.550=0.019
σ0.059-0.400=-0.341
min28.492-28.121=0.371
max28.635-29.033=-0.397