Compare commits

Home / Compare 3846edc8 .. 3c672cf6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.000
σ0.047-0.044=0.004
min70.539-70.542=-0.004
max70.696-70.688=0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.156-0.160=-0.004
σ0.005-0.003=0.003
min0.147-0.157=-0.010
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.000
σ0.003-0.003=-0.001
min21.283-21.283=-0.000
max21.290-21.292=-0.002
mean414.000-415.500=-1.500
σ0.000-0.527=-0.527
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.063-0.063=0.000
σ0.003-0.004=-0.001
min0.059-0.060=-0.000
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.655=0.000
σ0.362-0.361=0.001
min1753.080-1753.086=-0.006
max1754.233-1754.245=-0.012
mean1642.650-1650.400=-7.750
σ628.755-632.549=-3.793
min631.000-633.000=-2.000
max2765.000-2761.000=4.000
mean2.832-2.834=-0.002
σ0.146-0.104=0.042
min2.301-2.535=-0.234
max2.992-2.988=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.097-272.100=-0.003
σ0.008-0.008=-0.000
min272.084-272.092=-0.008
max272.105-272.112=-0.007
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean0.386-0.391=-0.006
σ0.008-0.010=-0.002
min0.379-0.378=0.001
max0.399-0.400=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.522-1932.520=0.003
σ0.010-0.012=-0.002
min1932.515-1932.506=0.009
max1932.539-1932.535=0.003
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean3.071-3.006=0.065
σ0.213-0.177=0.036
min2.879-2.745=0.134
max3.437-3.193=0.244
iters=5
new-facts=6402
prior-facts=1
mean4753.183-4753.251=-0.067
σ0.960-0.850=0.110
min4752.152-4752.794=-0.642
max4754.764-4754.763=0.001
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean8.203-8.559=-0.357
σ0.737-0.446=0.291
min7.655-7.828=-0.174
max9.354-8.951=0.404
iters=5
new-facts=6402
prior-facts=6402
mean4943.706-4943.715=-0.009
σ0.019-0.013=0.006
min4943.690-4943.701=-0.012
max4943.736-4943.732=0.004
mean3015.000-3073.600=-58.600
σ287.266-270.436=16.829
min2765.000-2761.000=4.000
max3422.000-3345.000=77.000
mean8.394-8.705=-0.312
σ0.077-0.224=-0.147
min8.322-8.394=-0.072
max8.512-8.979=-0.467

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.060=-0.037
σ0.134-0.129=0.005
min0.932-0.937=-0.005
max1.240-1.258=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.287-472.303=-0.017
σ575.915-575.926=-0.011
min184.323-184.337=-0.014
max1336.160-1336.193=-0.033
mean88.250
σ8.500
min84.000
max101.000
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean0.498-0.470=0.028
σ0.395-0.343=0.052
min0.300-0.296=0.003
max1.090-0.984=0.105
policies=20
mean1843.538-1843.629=-0.091
σ0.339-0.321=0.018
min1843.333-1843.391=-0.058
max1844.042-1844.096=-0.054
mean840.000
σ0.000
min840.000
max840.000
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean2.899-2.934=-0.035
σ0.052-0.118=-0.066
min2.855-2.839=0.016
max2.971-3.098=-0.127
policies=200
mean18442.091-18442.199=-0.108
σ0.583-0.489=0.094
min18441.708-18441.904=-0.196
max18442.948-18442.927=0.021
mean8400.000
σ0.000
min8400.000
max8400.000
mean2765.000-2761.000=4.000
σ0.000
min2765.000-2761.000=4.000
max2765.000-2761.000=4.000
mean28.962-29.017=-0.055
σ0.055-0.181=-0.126
min28.899-28.876=0.023
max29.015-29.257=-0.242