Compare commits

Home / Compare 7dded2b3 .. f833f630

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.045-0.048=-0.003
min70.539-70.541=-0.002
max70.688-70.699=-0.011
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.158-0.159=-0.002
σ0.005-0.003=0.002
min0.149-0.155=-0.006
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.292-21.290=0.001
σ0.012-0.012=-0.001
min21.284-21.281=0.004
max21.324-21.324=-0.000
mean415.000-414.600=0.400
σ0.000-0.516=-0.516
min415.000-414.000=1.000
max415.000
mean0.064-0.060=0.005
σ0.002-0.003=-0.001
min0.063-0.058=0.004
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.568=-0.000
σ0.359-0.358=0.001
min1753.005-1752.999=0.006
max1754.150-1754.148=0.003
mean1654.000-1644.450=9.550
σ629.319-635.111=-5.792
min621.000-627.000=-6.000
max2710.000-2858.000=-148.000
mean2.813-2.779=0.034
σ0.168-0.195=-0.027
min2.437-2.188=0.249
max3.072-2.955=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.018-272.019=-0.001
σ0.006-0.007=-0.001
min272.008-272.012=-0.004
max272.026-272.030=-0.004
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean0.400-0.390=0.010
σ0.002-0.010=-0.008
min0.398-0.379=0.019
max0.402-0.402=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.440=-0.007
σ0.012-0.013=-0.000
min1932.419-1932.428=-0.010
max1932.447-1932.461=-0.014
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean3.024-3.051=-0.027
σ0.080-0.127=-0.046
min2.957-2.956=0.001
max3.163-3.260=-0.097
iters=5
new-facts=6402
prior-facts=1
mean4753.120-4753.207=-0.086
σ0.897-0.875=0.021
min4752.389-4752.709=-0.320
max4754.684-4754.765=-0.080
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean8.057-8.306=-0.249
σ0.379-0.479=-0.099
min7.763-7.778=-0.014
max8.547-8.946=-0.399
iters=5
new-facts=6402
prior-facts=6402
mean4943.625-4943.616=0.009
σ0.013-0.015=-0.002
min4943.609-4943.595=0.015
max4943.646-4943.630=0.016
mean3012.200-3082.000=-69.800
σ349.587-300.677=48.910
min2710.000-2858.000=-148.000
max3523.000-3550.000=-27.000
mean8.548-8.421=0.127
σ0.257-0.143=0.114
min8.332-8.350=-0.018
max8.953-8.676=0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.099-1.059=0.040
σ0.163-0.271=-0.108
min0.938-0.933=0.005
max1.273-1.544=-0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.108-473.109=-0.001
σ575.921-575.924=-0.003
min185.138-185.136=0.002
max1336.990-1336.995=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean0.545-0.489=0.056
σ0.513-0.378=0.135
min0.287-0.297=-0.010
max1.314-1.055=0.259
policies=20
mean1851.677-1851.685=-0.007
σ0.375-0.373=0.002
min1851.416-1851.402=0.014
max1852.231-1852.227=0.004
mean840.000
σ0.000
min840.000
max840.000
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean2.864-2.938=-0.074
σ0.009-0.016=-0.007
min2.856-2.916=-0.059
max2.876-2.952=-0.077
policies=200
mean18523.587-18523.557=0.030
σ0.500-0.476=0.024
min18523.296-18523.266=0.030
max18524.335-18524.263=0.073
mean8400.000
σ0.000
min8400.000
max8400.000
mean2710.000-2858.000=-148.000
σ0.000
min2710.000-2858.000=-148.000
max2710.000-2858.000=-148.000
mean28.899-29.131=-0.232
σ0.089-0.375=-0.286
min28.773-28.814=-0.042
max28.975-29.666=-0.691