Compare commits

Home / Compare 2d57afb4 .. 36ca5d1a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.001
σ0.049-0.049=0.000
min30.999-31.006=-0.007
max31.177-31.178=-0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.078-0.079=-0.001
σ0.005-0.004=0.001
min0.072-0.077=-0.005
max0.087-0.087=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.003=0.000
min21.139-21.141=-0.002
max21.147-21.150=-0.003
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.058-0.063=-0.005
max0.066-0.072=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=-0.001
σ0.362-0.360=0.002
min1750.843-1750.838=0.005
max1751.995-1751.998=-0.004
mean1641.250-1655.600=-14.350
σ618.522-645.273=-26.752
min627.000-633.000=-6.000
max2480.000-2852.000=-372.000
mean2.808-2.841=-0.033
σ0.139-0.129=0.011
min2.550-2.498=0.053
max3.029-3.024=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.778-266.781=-0.003
σ0.007-0.010=-0.003
min266.766-266.773=-0.006
max266.784-266.797=-0.012
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean0.364-0.367=-0.003
σ0.001-0.006=-0.005
min0.363-0.363=0.000
max0.366-0.379=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1927.223-1927.207=0.015
σ0.019-0.003=0.016
min1927.205-1927.204=0.001
max1927.250-1927.211=0.039
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean2.938-3.068=-0.130
σ0.154-0.123=0.031
min2.702-2.972=-0.270
max3.101-3.260=-0.158
iters=5
new-facts=6402
prior-facts=1
mean4747.616-4747.699=-0.083
σ0.961-0.848=0.113
min4746.747-4747.190=-0.443
max4749.255-4749.207=0.047
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean8.455-8.484=-0.029
σ0.537-0.609=-0.072
min7.849-7.677=0.173
max9.141-9.198=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean4938.178-4938.166=0.011
σ0.081-0.087=-0.006
min4938.099-4938.090=0.010
max4938.267-4938.269=-0.003
mean2940.000-3058.200=-118.200
σ383.782-187.182=196.600
min2480.000-2852.000=-372.000
max3457.000-3322.000=135.000
mean8.464-8.593=-0.130
σ0.163-0.281=-0.118
min8.316-8.369=-0.052
max8.674-8.925=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.769-1.081=0.688
σ0.134-0.111=0.023
min1.637-0.946=0.691
max1.969-1.256=0.713

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.113-465.121=-0.008
σ575.751-575.766=-0.015
min177.235-177.229=0.006
max1328.740-1328.770=-0.030
mean79.750
σ7.500
min76.000
max91.000
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean0.562-0.439=0.123
σ0.558-0.305=0.253
min0.277-0.283=-0.006
max1.399-0.896=0.503
policies=20
mean1772.572-1772.617=-0.045
σ0.332-0.337=-0.005
min1772.360-1772.367=-0.007
max1773.066-1773.111=-0.045
mean760.000
σ0.000
min760.000
max760.000
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean2.738-2.826=-0.088
σ0.013-0.006=0.007
min2.721-2.819=-0.098
max2.750-2.833=-0.084
policies=200
mean17732.511-17732.544=-0.033
σ0.506-0.383=0.123
min17732.229-17732.278=-0.049
max17733.269-17733.111=0.157
mean7600.000
σ0.000
min7600.000
max7600.000
mean2480.000-2852.000=-372.000
σ0.000
min2480.000-2852.000=-372.000
max2480.000-2852.000=-372.000
mean27.599-28.108=-0.509
σ0.155-0.473=-0.317
min27.440-27.575=-0.135
max27.802-28.563=-0.761