Compare commits

Home / Compare 11e9f653 .. 7e6cf956

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.908-53.914=-0.005
σ0.367-0.367=-0.000
min53.782-53.783=-0.001
max54.953-54.959=-0.006
mean415.000-416.400=-1.400
σ0.000-1.265=-1.265
min415.000-414.000=1.000
max415.000-417.000=-2.000
mean0.141-0.139=0.003
σ0.004-0.004=0.000
min0.138-0.134=0.004
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.005-0.005=-0.000
min43.130-43.136=-0.005
max43.146-43.152=-0.006
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.119-0.121=-0.002
σ0.004-0.003=0.000
min0.115-0.117=-0.002
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.806-991.807=-0.001
σ1.237-1.268=-0.031
min991.231-991.229=0.002
max997.011-997.148=-0.137
mean1069.000
σ312.588-320.946=-8.358
min615.000-574.000=41.000
max1644.000-1632.000=12.000
mean1.522-1.551=-0.029
σ0.068-0.086=-0.017
min1.459-1.469=-0.010
max1.729-1.793=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.410=0.001
σ0.013-0.016=-0.002
min285.389-285.386=0.003
max285.425-285.426=-0.001
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.376-0.377=-0.001
σ0.007-0.007=-0.001
min0.372-0.373=-0.001
max0.388-0.390=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.368-1285.348=0.020
σ0.125-0.070=0.055
min1285.309-1285.308=0.001
max1285.592-1285.473=0.119
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean2.025-1.926=0.099
σ0.219-0.142=0.078
min1.815-1.816=-0.000
max2.364-2.172=0.192
iters=5
new-facts=6402
prior-facts=1
mean1807.714-1807.784=-0.070
σ6.985-6.972=0.013
min1804.359-1804.433=-0.074
max1820.192-1820.243=-0.051
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean4.186-4.474=-0.289
σ0.167-0.256=-0.090
min3.972-4.183=-0.211
max4.402-4.883=-0.481
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.199=-0.004
σ0.010-0.008=0.001
min2070.184-2070.187=-0.003
max2070.210-2070.209=0.001
mean1843.000-1848.000=-5.000
σ170.419-189.178=-18.760
min1644.000-1632.000=12.000
max2081.000-2085.000=-4.000
mean4.473-4.544=-0.071
σ0.030-0.044=-0.014
min4.424-4.490=-0.066
max4.500-4.582=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.272=-0.220
σ0.190-0.295=-0.104
min0.896-1.032=-0.136
max1.363-1.754=-0.390

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.792-436.785=0.007
σ572.352-572.359=-0.006
min150.607-150.595=0.013
max1295.321-1295.323=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.511-0.518=-0.007
σ0.527-0.536=-0.009
min0.246-0.249=-0.003
max1.302-1.323=-0.021
policies=20
mean1506.272-1506.236=0.036
σ0.234-0.236=-0.001
min1506.121-1506.080=0.041
max1506.621-1506.587=0.034
mean860.000
σ0.000
min860.000
max860.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean2.514-2.509=0.005
σ0.020-0.017=0.002
min2.492-2.484=0.008
max2.540-2.521=0.019
policies=200
mean15070.012-15070.166=-0.154
σ0.406-0.027=0.379
min15069.584-15070.135=-0.550
max15070.418-15070.190=0.228
mean8600.000
σ0.000
min8600.000
max8600.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean25.416-25.416=0.000
σ0.130-0.078=0.052
min25.297-25.326=-0.029
max25.571-25.497=0.074