Compare commits

Home / Compare 8db8f6d6 .. 6931280f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.566=-0.003
σ0.044-0.044=0.001
min70.540-70.542=-0.002
max70.687-70.687=0.000
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.158-0.157=0.001
σ0.006-0.005=0.001
min0.150-0.150=-0.000
max0.168-0.163=0.005
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.011-0.003=0.008
min21.284-21.282=0.002
max21.320-21.293=0.028
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.173=0.001
σ0.360-0.365=-0.005
min1752.603-1752.601=0.002
max1753.757-1753.758=-0.001
mean1652.750-1670.050=-17.300
σ639.477-635.925=3.552
min628.000-687.000=-59.000
max2792.000-2820.000=-28.000
mean2.863-2.827=0.036
σ0.117-0.133=-0.016
min2.582-2.462=0.120
max3.077-3.066=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.620-271.603=0.017
σ0.007-0.013=-0.006
min271.608-271.587=0.022
max271.625-271.616=0.009
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean0.381-0.383=-0.003
σ0.006-0.008=-0.001
min0.377-0.377=-0.000
max0.392-0.397=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.044-1932.050=-0.006
σ0.014-0.017=-0.003
min1932.027-1932.032=-0.005
max1932.066-1932.072=-0.006
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean2.999-2.921=0.078
σ0.067-0.157=-0.090
min2.901-2.659=0.242
max3.086-3.054=0.033
iters=5
new-facts=6402
prior-facts=1
mean4752.852-4752.757=0.094
σ0.787-0.907=-0.120
min4752.451-4752.280=0.171
max4754.259-4754.376=-0.117
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean7.875-8.711=-0.836
σ0.299-0.276=0.023
min7.687-8.427=-0.740
max8.396-9.101=-0.704
iters=5
new-facts=6402
prior-facts=6402
mean4943.163-4943.163=-0.000
σ0.168-0.169=-0.001
min4942.864-4942.863=0.001
max4943.261-4943.256=0.005
mean3025.000-3002.800=22.200
σ279.305-251.530=27.776
min2792.000-2820.000=-28.000
max3435.000-3396.000=39.000
mean8.401-8.369=0.032
σ0.188-0.086=0.101
min8.225-8.221=0.003
max8.684-8.437=0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.095=-0.074
σ0.140-0.231=-0.091
min0.929-0.928=0.001
max1.247-1.425=-0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.291-472.293=-0.002
σ575.915-575.924=-0.009
min184.324-184.321=0.003
max1336.163-1336.178=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean0.449-0.454=-0.005
σ0.303-0.300=0.004
min0.294-0.300=-0.006
max0.904-0.904=0.000
policies=20
mean1843.558-1843.578=-0.020
σ0.372-0.367=0.006
min1843.290-1843.285=0.005
max1844.101-1844.092=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean2.939-2.976=-0.037
σ0.006-0.126=-0.120
min2.934-2.862=0.072
max2.948-3.116=-0.168
policies=200
mean18442.194-18442.055=0.139
σ0.531-0.440=0.091
min18441.876-18441.762=0.114
max18442.987-18442.700=0.287
mean8400.000
σ0.000
min8400.000
max8400.000
mean2792.000-2820.000=-28.000
σ0.000
min2792.000-2820.000=-28.000
max2792.000-2820.000=-28.000
mean28.918-28.914=0.004
σ0.077-0.193=-0.116
min28.855-28.715=0.140
max29.024-29.152=-0.128