Compare commits

Home / Compare 0a1309fc .. ccc76bbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.973=-0.000
σ0.106-0.107=-0.002
min35.923-35.921=0.002
max36.273-36.278=-0.005
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.076-0.075=0.001
σ0.003-0.005=-0.002
min0.074-0.069=0.004
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.001
σ0.005-0.004=0.001
min26.202-26.201=0.001
max26.214-26.214=0.000
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.061-0.059=0.001
σ0.002-0.004=-0.002
min0.059-0.056=0.004
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.367=-0.004
σ0.372-0.370=0.002
min1757.784-1757.791=-0.007
max1758.953-1758.963=-0.010
mean1633.950-1655.150=-21.200
σ624.089-620.489=3.600
min674.000-686.000=-12.000
max2837.000-2746.000=91.000
mean2.365-2.352=0.013
σ0.105-0.111=-0.007
min2.252-2.138=0.114
max2.698-2.567=0.131

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.517-279.511=0.006
σ0.009-0.009=0.000
min279.504-279.500=0.005
max279.529-279.520=0.008
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean0.417-0.411=0.006
σ0.010-0.007=0.004
min0.405-0.404=0.000
max0.430-0.419=0.012
iters=5
new-facts=1
prior-facts=6402
mean2178.449-2178.441=0.009
σ0.007-0.014=-0.007
min2178.443-2178.419=0.024
max2178.457-2178.453=0.005
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean3.471-3.141=0.330
σ0.135-0.552=-0.417
min3.296-2.671=0.625
max3.662-4.041=-0.379
iters=5
new-facts=6402
prior-facts=1
mean5056.394-5056.403=-0.009
σ0.998-0.979=0.018
min5055.762-5055.873=-0.111
max5058.140-5058.138=0.002
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean9.116-9.171=-0.055
σ0.765-0.750=0.015
min8.078-8.162=-0.085
max10.055-10.125=-0.070
iters=5
new-facts=6402
prior-facts=6402
mean5193.758-5193.607=0.151
σ0.081-0.255=-0.173
min5193.688-5193.337=0.351
max5193.856-5193.856=0.001
mean3248.000-3193.000=55.000
σ306.670-443.104=-136.434
min2837.000-2746.000=91.000
max3667.000-3814.000=-147.000
mean8.987-8.651=0.336
σ0.388-0.126=0.262
min8.675-8.535=0.140
max9.600-8.864=0.736

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.945=0.035
σ0.064-0.010=0.055
min0.942-0.938=0.005
max1.094-0.962=0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.492-465.481=0.011
σ572.656-572.660=-0.004
min179.155-179.143=0.013
max1324.475-1324.470=0.005
mean79.500
σ7.000
min76.000
max90.000
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean0.445-0.473=-0.028
σ0.305-0.387=-0.082
min0.291-0.279=0.012
max0.902-1.053=-0.151
policies=20
mean1791.850-1791.703=0.147
σ0.351-0.327=0.023
min1791.606-1791.515=0.092
max1792.365-1792.192=0.173
mean760.000
σ0.000
min760.000
max760.000
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean2.873-2.803=0.070
σ0.006-0.013=-0.006
min2.865-2.788=0.077
max2.880-2.818=0.062
policies=200
mean17923.811-17923.411=0.400
σ0.654-0.443=0.212
min17923.232-17923.059=0.173
max17924.499-17924.058=0.441
mean7600.000
σ0.000
min7600.000
max7600.000
mean2837.000-2746.000=91.000
σ0.000
min2837.000-2746.000=91.000
max2837.000-2746.000=91.000
mean28.373-28.137=0.237
σ0.359-0.048=0.311
min28.051-28.094=-0.043
max28.872-28.188=0.684