Compare commits

Home / Compare c7118cf2 .. f138159b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.798=0.000
σ0.108-0.107=0.000
min35.751-35.751=-0.000
max36.104-36.102=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.076-0.076=0.001
σ0.004-0.004=0.000
min0.073-0.073=0.000
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.000
σ0.004-0.004=0.000
min26.058-26.059=-0.002
max26.072-26.069=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.061-0.060=0.000
σ0.002-0.003=-0.001
min0.058-0.056=0.002
max0.065-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.926-1755.923=0.003
σ0.365-0.370=-0.005
min1755.350-1755.350=-0.000
max1756.516-1756.517=-0.002
mean1652.050-1658.450=-6.400
σ647.181-627.128=20.053
min612.000-679.000=-67.000
max2737.000-2664.000=73.000
mean2.902-2.897=0.005
σ0.122-0.087=0.034
min2.613-2.720=-0.108
max3.079-3.090=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.198=-0.004
σ0.004-0.004=0.000
min277.189-277.194=-0.005
max277.198-277.202=-0.004
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean0.394-0.403=-0.009
σ0.002-0.003=-0.001
min0.390-0.399=-0.008
max0.396-0.408=-0.012
iters=5
new-facts=1
prior-facts=6402
mean2174.428-2174.436=-0.009
σ0.036-0.006=0.030
min2174.373-2174.427=-0.055
max2174.469-2174.446=0.023
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean2.795-2.966=-0.171
σ0.077-0.166=-0.088
min2.709-2.785=-0.077
max2.875-3.171=-0.297
iters=5
new-facts=6402
prior-facts=1
mean5052.394-5052.595=-0.201
σ1.206-1.015=0.191
min5051.080-5051.992=-0.911
max5054.373-5054.398=-0.025
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean9.145-9.143=0.002
σ0.442-0.604=-0.163
min8.503-8.123=0.380
max9.690-9.718=-0.028
iters=5
new-facts=6402
prior-facts=6402
mean5188.402-5188.410=-0.008
σ0.117-0.100=0.018
min5188.249-5188.302=-0.053
max5188.526-5188.519=0.007
mean3241.600-3225.800=15.800
σ455.165-387.883=67.282
min2737.000-2690.000=47.000
max3866.000-3712.000=154.000
mean8.753-8.980=-0.226
σ0.115-0.421=-0.306
min8.614-8.664=-0.051
max8.932-9.706=-0.774

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.241=-0.131
σ0.256-0.279=-0.023
min0.953-0.954=-0.001
max1.545-1.694=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.852-464.856=-0.004
σ572.660-572.659=0.002
min178.517-178.524=-0.007
max1323.842-1323.844=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean0.579-0.551=0.028
σ0.588-0.542=0.046
min0.283-0.277=0.006
max1.461-1.364=0.098
policies=20
mean1785.463-1785.477=-0.013
σ0.346-0.362=-0.016
min1785.237-1785.230=0.007
max1785.976-1786.013=-0.037
mean760.000
σ0.000
min760.000
max760.000
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean2.800-2.784=0.015
σ0.005-0.004=0.000
min2.792-2.781=0.011
max2.803-2.790=0.013
policies=200
mean17861.467-17861.541=-0.074
σ0.542-0.476=0.067
min17861.037-17861.233=-0.196
max17862.262-17862.249=0.013
mean7600.000
σ0.000
min7600.000
max7600.000
mean2737.000-2664.000=73.000
σ0.000
min2737.000-2664.000=73.000
max2737.000-2664.000=73.000
mean28.266-28.149=0.117
σ0.165-0.126=0.039
min28.058-28.029=0.029
max28.453-28.317=0.136