Compare commits

Home / Compare 05c30bc2 .. 7dded2b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.003
σ0.048-0.049=-0.002
min70.541-70.538=0.002
max70.699-70.701=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.159-0.162=-0.003
σ0.003-0.012=-0.009
min0.155-0.149=0.006
max0.165-0.186=-0.021
cache=y
dps=1
iters=10
policies=100
mean21.290-21.287=0.004
σ0.012-0.002=0.010
min21.281-21.284=-0.003
max21.324-21.290=0.034
mean414.600-412.000=2.600
σ0.516-0.000=0.516
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.060-0.062=-0.003
σ0.003-0.003=-0.000
min0.058-0.059=-0.000
max0.068-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.568=-0.000
σ0.358-0.362=-0.004
min1752.999-1752.994=0.005
max1754.148-1754.158=-0.010
mean1644.450-1647.650=-3.200
σ635.111-639.627=-4.516
min627.000-626.000=1.000
max2858.000-2876.000=-18.000
mean2.779-2.822=-0.043
σ0.195-0.142=0.053
min2.188-2.415=-0.226
max2.955-3.035=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.019=-0.000
σ0.007-0.007=0.000
min272.012-272.009=0.004
max272.030-272.027=0.003
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean0.390-0.397=-0.008
σ0.010-0.016=-0.006
min0.379-0.382=-0.003
max0.402-0.419=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1932.440-1932.434=0.006
σ0.013-0.011=0.002
min1932.428-1932.421=0.007
max1932.461-1932.443=0.018
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean3.051-2.941=0.109
σ0.127-0.136=-0.009
min2.956-2.747=0.209
max3.260-3.120=0.140
iters=5
new-facts=6402
prior-facts=1
mean4753.207-4753.174=0.032
σ0.875-0.900=-0.024
min4752.709-4752.713=-0.004
max4754.765-4754.777=-0.013
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean8.306-8.468=-0.162
σ0.479-0.554=-0.075
min7.778-7.579=0.198
max8.946-8.914=0.032
iters=5
new-facts=6402
prior-facts=6402
mean4943.616-4943.625=-0.008
σ0.015-0.028=-0.012
min4943.595-4943.591=0.003
max4943.630-4943.659=-0.029
mean3082.000-3033.200=48.800
σ300.677-180.951=119.726
min2858.000-2876.000=-18.000
max3550.000-3318.000=232.000
mean8.421-8.529=-0.108
σ0.143-0.080=0.063
min8.350-8.391=-0.041
max8.676-8.586=0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.034=0.025
σ0.271-0.140=0.131
min0.933-0.938=-0.006
max1.544-1.264=0.280

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.109-473.105=0.003
σ575.924-575.917=0.007
min185.136-185.139=-0.004
max1336.995-1336.980=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean0.489-0.447=0.041
σ0.378-0.308=0.069
min0.297-0.281=0.016
max1.055-0.909=0.146
policies=20
mean1851.685-1851.681=0.004
σ0.373-0.298=0.075
min1851.402-1851.449=-0.047
max1852.227-1852.109=0.118
mean840.000
σ0.000
min840.000
max840.000
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean2.938-2.962=-0.024
σ0.016-0.018=-0.002
min2.916-2.936=-0.020
max2.952-2.973=-0.021
policies=200
mean18523.557-18523.477=0.079
σ0.476-0.626=-0.150
min18523.266-18522.848=0.417
max18524.263-18524.344=-0.082
mean8400.000
σ0.000
min8400.000
max8400.000
mean2858.000-2876.000=-18.000
σ0.000
min2858.000-2876.000=-18.000
max2858.000-2876.000=-18.000
mean29.131-29.336=-0.205
σ0.375-0.490=-0.115
min28.814-28.932=-0.118
max29.666-29.995=-0.329