Compare commits

Home / Compare 39291478 .. 9f214db2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.650-53.646=0.004
σ0.369-0.368=0.002
min53.519-53.516=0.003
max54.700-54.692=0.008
mean414.000-412.500=1.500
σ0.000-0.527=-0.527
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.139-0.138=0.001
σ0.006-0.004=0.002
min0.130-0.134=-0.004
max0.147-0.143=0.005
cache=y
dps=1
iters=10
policies=100
mean42.945-42.942=0.003
σ0.010-0.006=0.004
min42.936-42.931=0.005
max42.970-42.956=0.015
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.118-0.119=-0.001
σ0.005-0.005=0.000
min0.113-0.114=-0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.865-991.805=0.060
σ1.215-1.249=-0.035
min991.330-991.248=0.083
max996.961-997.060=-0.100
mean1060.000-1063.750=-3.750
σ319.533-323.631=-4.099
min588.000-565.000=23.000
max1552.000-1637.000=-85.000
mean1.524-1.540=-0.016
σ0.081-0.124=-0.043
min1.396-1.376=0.020
max1.647-1.931=-0.284

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.439-285.395=0.044
σ0.010-0.013=-0.003
min285.424-285.374=0.050
max285.448-285.410=0.039
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean0.382-0.384=-0.002
σ0.008-0.009=-0.001
min0.374-0.374=0.000
max0.390-0.392=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.518-1285.354=0.164
σ0.091-0.130=-0.039
min1285.355-1285.289=0.066
max1285.569-1285.587=-0.018
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean2.006-2.011=-0.005
σ0.271-0.153=0.118
min1.737-1.852=-0.115
max2.448-2.181=0.267
iters=5
new-facts=6402
prior-facts=1
mean1705.834-1807.717=-101.884
σ6.835-6.993=-0.158
min1702.664-1804.314=-101.650
max1718.057-1820.209=-102.152
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean2.921-4.277=-1.355
σ0.179-0.307=-0.128
min2.744-3.978=-1.234
max3.115-4.773=-1.658
iters=5
new-facts=6402
prior-facts=6402
mean1968.427-2070.176=-101.749
σ0.041-0.009=0.032
min1968.363-2070.165=-101.801
max1968.478-2070.190=-101.712
mean1791.400-1831.800=-40.400
σ210.461-169.188=41.273
min1552.000-1637.000=-85.000
max2084.000-2067.000=17.000
mean3.297-4.485=-1.187
σ0.432-0.057=0.375
min2.970-4.417=-1.447
max4.036-4.562=-0.526

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.460-1.279=0.181
σ0.204-0.297=-0.093
min1.232-0.889=0.343
max1.691-1.683=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.770-436.774=-0.005
σ572.356-572.360=-0.004
min150.590-150.592=-0.002
max1295.304-1295.314=-0.010
mean90.250
σ8.500
min86.000
max103.000
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean0.520-0.512=0.008
σ0.534-0.518=0.015
min0.249-0.250=-0.001
max1.321-1.289=0.032
policies=20
mean1506.181-1506.195=-0.015
σ0.244-0.281=-0.037
min1506.023-1506.010=0.013
max1506.544-1506.613=-0.070
mean860.000
σ0.000
min860.000
max860.000
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean2.532-2.573=-0.041
σ0.014-0.065=-0.051
min2.512-2.509=0.003
max2.542-2.636=-0.094
policies=200
mean15069.539-15069.428=0.111
σ0.061-0.013=0.048
min15069.455-15069.419=0.036
max15069.590-15069.446=0.144
mean8600.000
σ0.000
min8600.000
max8600.000
mean1552.000-1637.000=-85.000
σ0.000
min1552.000-1637.000=-85.000
max1552.000-1637.000=-85.000
mean25.544-25.471=0.073
σ0.201-0.147=0.054
min25.385-25.294=0.091
max25.809-25.620=0.189