Compare commits

Home / Compare 624cf6cf .. 3846edc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.567=-0.000
σ0.044-0.047=-0.003
min70.542-70.540=0.002
max70.688-70.698=-0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.161=-0.001
σ0.003-0.007=-0.004
min0.157-0.157=0.001
max0.165-0.179=-0.014
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.001
σ0.003-0.002=0.001
min21.283-21.285=-0.002
max21.292-21.292=-0.000
mean415.500-414.000=1.500
σ0.527-0.000=0.527
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.060-0.064=-0.004
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.569=0.086
σ0.361-0.362=-0.001
min1753.086-1752.994=0.092
max1754.245-1754.154=0.091
mean1650.400-1667.250=-16.850
σ632.549-628.853=3.695
min633.000-688.000=-55.000
max2761.000-2695.000=66.000
mean2.834-2.816=0.019
σ0.104-0.185=-0.081
min2.535-2.297=0.238
max2.988-2.984=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.100-272.014=0.086
σ0.008-0.006=0.002
min272.092-272.007=0.085
max272.112-272.022=0.090
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean0.391-0.387=0.005
σ0.010-0.010=-0.000
min0.378-0.377=0.002
max0.400-0.401=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.520-1932.441=0.079
σ0.012-0.015=-0.003
min1932.506-1932.416=0.090
max1932.535-1932.456=0.080
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean3.006-2.904=0.102
σ0.177-0.146=0.032
min2.745-2.710=0.035
max3.193-3.068=0.125
iters=5
new-facts=6402
prior-facts=1
mean4753.251-4753.053=0.198
σ0.850-0.579=0.271
min4752.794-4752.672=0.122
max4754.763-4754.079=0.684
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean8.559-8.587=-0.028
σ0.446-0.287=0.159
min7.828-8.346=-0.518
max8.951-9.043=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean4943.715-4943.633=0.082
σ0.013-0.020=-0.007
min4943.701-4943.610=0.091
max4943.732-4943.656=0.076
mean3073.600-3010.200=63.400
σ270.436-265.587=4.850
min2761.000-2695.000=66.000
max3345.000-3352.000=-7.000
mean8.705-8.529=0.177
σ0.224-0.163=0.061
min8.394-8.338=0.056
max8.979-8.754=0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.123=-0.063
σ0.129-0.150=-0.021
min0.937-0.937=-0.000
max1.258-1.303=-0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.303-473.082=-0.779
σ575.926-575.932=-0.006
min184.337-185.112=-0.775
max1336.193-1336.980=-0.788
mean88.250
σ8.500
min84.000
max101.000
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean0.470-0.557=-0.088
σ0.343-0.541=-0.198
min0.296-0.286=0.011
max0.984-1.370=-0.385
policies=20
mean1843.629-1851.432=-7.803
σ0.321-0.375=-0.054
min1843.391-1851.183=-7.792
max1844.096-1851.987=-7.890
mean840.000
σ0.000
min840.000
max840.000
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean2.934-2.851=0.082
σ0.118-0.011=0.107
min2.839-2.835=0.004
max3.098-2.859=0.239
policies=200
mean18442.199-18521.023=-78.824
σ0.489-0.575=-0.086
min18441.904-18520.669=-78.765
max18442.927-18521.881=-78.954
mean8400.000
σ0.000
min8400.000
max8400.000
mean2761.000-2695.000=66.000
σ0.000
min2761.000-2695.000=66.000
max2761.000-2695.000=66.000
mean29.017-28.894=0.124
σ0.181-0.099=0.082
min28.876-28.806=0.069
max29.257-28.996=0.261