Compare commits

Home / Compare 4e0288a5 .. 00e974bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.797=0.002
σ0.107-0.107=0.000
min35.751-35.747=0.004
max36.103-36.100=0.003
mean416.000-415.900=0.100
σ0.000-0.316=-0.316
min416.000-415.000=1.000
max416.000
mean0.077-0.072=0.006
σ0.004-0.003=0.001
min0.073-0.069=0.004
max0.083-0.077=0.006
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=-0.000
σ0.004-0.004=0.000
min26.059-26.059=0.000
max26.071-26.072=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.060-0.061=-0.001
σ0.003-0.002=0.001
min0.057-0.059=-0.002
max0.067-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.923=-0.001
σ0.368-0.367=0.001
min1755.351-1755.349=0.002
max1756.518-1756.533=-0.015
mean1666.050-1655.550=10.500
σ627.297-618.805=8.492
min675.000-658.000=17.000
max2655.000-2503.000=152.000
mean2.818-2.754=0.064
σ0.110-0.202=-0.093
min2.525-2.279=0.246
max2.979-3.060=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.193=0.002
σ0.005-0.005=-0.000
min277.189-277.188=0.002
max277.200-277.199=0.001
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean0.397-0.397=-0.000
σ0.010-0.010=-0.000
min0.391-0.391=0.000
max0.414-0.415=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2174.443-2174.437=0.006
σ0.016-0.024=-0.008
min2174.425-2174.405=0.020
max2174.468-2174.472=-0.004
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean3.012-2.856=0.156
σ0.125-0.172=-0.047
min2.805-2.677=0.128
max3.123-3.132=-0.009
iters=5
new-facts=6402
prior-facts=1
mean5052.599-5052.584=0.015
σ0.992-0.966=0.026
min5052.031-5052.069=-0.038
max5054.363-5054.306=0.058
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean9.021-8.951=0.070
σ0.577-0.549=0.028
min8.176-8.069=0.107
max9.649-9.391=0.258
iters=5
new-facts=6402
prior-facts=6402
mean5188.422-5188.414=0.008
σ0.087-0.087=0.000
min5188.358-5188.331=0.027
max5188.524-5188.517=0.008
mean3228.000-3271.200=-43.200
σ389.078-499.005=-109.927
min2690.000-2625.000=65.000
max3717.000-3867.000=-150.000
mean8.865-8.813=0.053
σ0.217-0.147=0.071
min8.695-8.649=0.046
max9.221-8.946=0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.624=-0.402
σ0.325-0.093=0.231
min0.950-1.518=-0.568
max1.771-1.720=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-464.848=0.008
σ572.659-572.649=0.010
min178.521-178.521=-0.000
max1323.845-1323.822=0.023
mean79.500
σ7.000
min76.000
max90.000
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean0.541-0.529=0.012
σ0.505-0.489=0.016
min0.281-0.280=0.001
max1.298-1.262=0.036
policies=20
mean1785.471-1785.484=-0.013
σ0.335-0.349=-0.014
min1785.262-1785.248=0.014
max1785.970-1786.001=-0.030
mean760.000
σ0.000
min760.000
max760.000
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean2.773-2.795=-0.022
σ0.049-0.016=0.033
min2.710-2.774=-0.065
max2.827-2.812=0.014
policies=200
mean17861.405-17861.357=0.048
σ0.448-0.424=0.024
min17861.031-17861.049=-0.018
max17862.055-17861.973=0.082
mean7600.000
σ0.000
min7600.000
max7600.000
mean2655.000-2503.000=152.000
σ0.000
min2655.000-2503.000=152.000
max2655.000-2503.000=152.000
mean28.189-28.213=-0.024
σ0.149-0.124=0.025
min28.016-28.060=-0.044
max28.328-28.316=0.012