Compare commits

Home / Compare 0691bf23 .. e7d4cfa3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.565=0.001
σ0.044-0.045=-0.000
min70.540-70.541=-0.001
max70.690-70.689=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.158-0.157=0.001
σ0.004-0.004=-0.000
min0.150-0.150=-0.000
max0.165-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.001
σ0.004-0.002=0.002
min21.282-21.284=-0.003
max21.292-21.291=0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.062-0.062=0.001
σ0.004-0.004=0.000
min0.059-0.059=-0.001
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.656=-0.000
σ0.361-0.359=0.002
min1753.084-1753.085=-0.001
max1754.239-1754.232=0.006
mean1654.150-1670.600=-16.450
σ633.447-650.388=-16.941
min635.000-672.000=-37.000
max2767.000-2825.000=-58.000
mean2.837-2.846=-0.009
σ0.130-0.125=0.005
min2.550-2.640=-0.090
max2.990-3.189=-0.199

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.096-272.097=-0.002
σ0.004-0.008=-0.004
min272.092-272.089=0.003
max272.101-272.107=-0.005
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean0.392-0.392=0.000
σ0.009-0.010=-0.001
min0.382-0.380=0.002
max0.399-0.402=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.525-1932.526=-0.001
σ0.008-0.009=-0.001
min1932.519-1932.514=0.004
max1932.538-1932.536=0.002
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean2.832-2.969=-0.137
σ0.238-0.169=0.068
min2.474-2.727=-0.253
max3.082-3.149=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4753.299-4753.310=-0.011
σ0.867-0.808=0.058
min4752.780-4752.907=-0.126
max4754.840-4754.756=0.085
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean8.292-8.061=0.231
σ0.520-0.300=0.220
min7.600-7.752=-0.152
max8.948-8.459=0.488
iters=5
new-facts=6402
prior-facts=6402
mean4943.648-4943.712=-0.064
σ0.163-0.019=0.144
min4943.358-4943.690=-0.332
max4943.740-4943.740=0.001
mean3053.600-3052.200=1.400
σ231.970-272.776=-40.805
min2767.000-2825.000=-58.000
max3375.000-3451.000=-76.000
mean8.596-8.498=0.098
σ0.155-0.152=0.004
min8.434-8.343=0.091
max8.842-8.742=0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.060=-0.003
σ0.124-0.125=-0.001
min0.944-0.945=-0.001
max1.247-1.248=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-472.291=0.002
σ575.917-575.914=0.003
min184.331-184.326=0.005
max1336.168-1336.162=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean0.491-0.448=0.042
σ0.382-0.306=0.076
min0.297-0.292=0.005
max1.063-0.908=0.156
policies=20
mean1843.597-1843.560=0.037
σ0.358-0.379=-0.021
min1843.334-1843.295=0.039
max1844.108-1844.118=-0.010
mean840.000
σ0.000
min840.000
max840.000
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean2.958-2.935=0.024
σ0.116-0.090=0.026
min2.872-2.854=0.019
max3.120-3.057=0.063
policies=200
mean18442.185-18441.962=0.223
σ0.527-0.517=0.010
min18441.895-18441.676=0.219
max18442.975-18442.737=0.238
mean8400.000
σ0.000
min8400.000
max8400.000
mean2767.000-2825.000=-58.000
σ0.000
min2767.000-2825.000=-58.000
max2767.000-2825.000=-58.000
mean29.006-29.070=-0.064
σ0.084-0.089=-0.005
min28.889-28.985=-0.097
max29.074-29.167=-0.093