Compare commits

Home / Compare 37f9449e .. eb179a08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.000
σ0.368-0.366=0.002
min53.521-53.519=0.001
max54.693-54.688=0.005
mean416.400-415.000=1.400
σ1.265-0.000=1.265
min414.000-415.000=-1.000
max417.000-415.000=2.000
mean0.137-0.139=-0.002
σ0.004-0.004=0.000
min0.131-0.135=-0.004
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.000
σ0.006-0.006=0.000
min42.933-42.932=0.002
max42.952-42.950=0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.000
min0.118-0.117=0.001
max0.128-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.866-991.868=-0.002
σ1.192-1.221=-0.029
min991.333-991.268=0.065
max996.861-996.970=-0.109
mean1066.450-1070.350=-3.900
σ325.307-327.126=-1.819
min591.000-580.000=11.000
max1573.000-1650.000=-77.000
mean1.539-1.554=-0.015
σ0.064-0.147=-0.083
min1.470-1.404=0.066
max1.685-2.094=-0.409

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.442-285.442=0.000
σ0.011-0.011=-0.001
min285.423-285.421=0.002
max285.453-285.449=0.004
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean0.385-0.382=0.003
σ0.013-0.005=0.008
min0.376-0.378=-0.002
max0.406-0.391=0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.514-1285.507=0.007
σ0.093-0.091=0.003
min1285.350-1285.357=-0.007
max1285.581-1285.575=0.007
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean1.965-2.001=-0.036
σ0.108-0.267=-0.159
min1.846-1.798=0.048
max2.140-2.444=-0.303
iters=5
new-facts=6402
prior-facts=1
mean1705.826-1705.830=-0.004
σ6.865-6.858=0.007
min1702.630-1702.648=-0.018
max1718.103-1718.096=0.007
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean3.096-2.988=0.107
σ0.180-0.206=-0.026
min2.924-2.810=0.115
max3.310-3.270=0.040
iters=5
new-facts=6402
prior-facts=6402
mean1968.419-1968.421=-0.002
σ0.035-0.033=0.002
min1968.360-1968.362=-0.003
max1968.454-1968.443=0.011
mean1759.200-1781.000=-21.800
σ159.719-142.468=17.252
min1573.000-1650.000=-77.000
max1959.000-1977.000=-18.000
mean3.102-3.047=0.055
σ0.093-0.193=-0.100
min2.947-2.864=0.084
max3.197-3.342=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.501-1.214=0.287
σ0.290-0.353=-0.063
min1.209-0.910=0.298
max1.850-1.724=0.125

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.772-436.783=-0.011
σ572.356-572.360=-0.005
min150.593-150.599=-0.006
max1295.305-1295.323=-0.018
mean90.250
σ8.500
min86.000
max103.000
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean0.529-0.530=-0.000
σ0.553-0.543=0.010
min0.246-0.255=-0.009
max1.359-1.344=0.015
policies=20
mean1506.223-1506.223=0.000
σ0.257-0.254=0.002
min1506.047-1506.064=-0.017
max1506.605-1506.603=0.002
mean860.000
σ0.000
min860.000
max860.000
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean2.536-2.544=-0.008
σ0.013-0.003=0.010
min2.524-2.539=-0.015
max2.548-2.547=0.001
policies=200
mean15069.885-15069.830=0.055
σ0.085-0.063=0.021
min15069.763-15069.763=0.000
max15069.945-15069.910=0.035
mean8600.000
σ0.000
min8600.000
max8600.000
mean1573.000-1650.000=-77.000
σ0.000
min1573.000-1650.000=-77.000
max1573.000-1650.000=-77.000
mean25.525-25.701=-0.176
σ0.144-0.187=-0.042
min25.351-25.422=-0.071
max25.654-25.811=-0.157