Compare commits

Home / Compare d0aee9a6 .. e33dfac4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.956=0.000
σ0.102-0.102=-0.000
min35.908-35.913=-0.004
max36.245-36.245=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.072-0.076=-0.003
σ0.004-0.005=-0.001
min0.069-0.071=-0.001
max0.080-0.083=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.203-26.204=-0.001
σ0.005-0.004=0.001
min26.196-26.196=-0.000
max26.212-26.210=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.061=-0.000
σ0.003-0.002=0.000
min0.057-0.060=-0.003
max0.068-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.304=-0.000
σ0.368-0.368=0.001
min1755.729-1755.729=0.000
max1756.896-1756.898=-0.001
mean1657.350-1657.500=-0.150
σ627.549-636.038=-8.489
min613.000-611.000=2.000
max2706.000-2686.000=20.000
mean2.359-2.399=-0.040
σ0.113-0.185=-0.072
min2.181-2.279=-0.098
max2.649-3.102=-0.454

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.824-278.822=0.002
σ0.006-0.006=0.001
min278.816-278.813=0.004
max278.831-278.828=0.003
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean0.411-0.414=-0.002
σ0.004-0.004=0.001
min0.408-0.410=-0.002
max0.419-0.419=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2102.918-2268.884=-165.966
σ371.127-0.018=371.109
min1439.025-2268.854=-829.829
max2268.904-2268.898=0.007
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean2.839-2.933=-0.095
σ0.490-0.095=0.395
min2.002-2.859=-0.857
max3.215-3.099=0.115
iters=5
new-facts=6402
prior-facts=1
mean4954.182-4954.269=-0.086
σ0.680-0.945=-0.265
min4953.683-4953.689=-0.006
max4955.375-4955.946=-0.571
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean7.984-8.079=-0.096
σ0.373-0.409=-0.035
min7.726-7.705=0.021
max8.643-8.649=-0.006
iters=5
new-facts=6402
prior-facts=6402
mean5168.817-5168.828=-0.011
σ0.090-0.096=-0.006
min5168.719-5168.718=0.000
max5168.886-5168.904=-0.018
mean3300.800-3459.000=-158.200
σ464.223-472.083=-7.860
min2706.000-2799.000=-93.000
max3748.000-4014.000=-266.000
mean9.053-9.457=-0.404
σ0.144-0.279=-0.135
min8.880-9.216=-0.336
max9.258-9.815=-0.557

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.123=-0.093
σ0.137-0.247=-0.111
min0.939-0.942=-0.003
max1.253-1.550=-0.297

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.346-460.353=-0.007
σ572.646-572.651=-0.005
min174.016-174.021=-0.005
max1319.314-1319.330=-0.015
mean79.500
σ7.000
min76.000
max90.000
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean0.535-0.562=-0.027
σ0.520-0.574=-0.054
min0.269-0.273=-0.004
max1.315-1.423=-0.107
policies=20
mean1740.435-1740.432=0.004
σ0.315-0.318=-0.003
min1740.243-1740.232=0.010
max1740.906-1740.906=-0.000
mean760.000
σ0.000
min760.000
max760.000
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean2.683-2.673=0.010
σ0.014-0.014=-0.000
min2.666-2.660=0.007
max2.694-2.692=0.003
policies=200
mean17411.296-17411.210=0.086
σ0.471-0.561=-0.090
min17411.054-17410.911=0.143
max17412.003-17412.051=-0.048
mean7600.000
σ0.000
min7600.000
max7600.000
mean2706.000-2686.000=20.000
σ0.000
min2706.000-2686.000=20.000
max2706.000-2686.000=20.000
mean27.016-26.991=0.025
σ0.086-0.063=0.023
min26.922-26.933=-0.012
max27.131-27.081=0.050