Compare commits

Home / Compare c4d96b97 .. f233f771

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.567=-0.005
σ0.046-0.047=-0.001
min70.534-70.535=-0.001
max70.690-70.696=-0.007
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.155-0.160=-0.005
σ0.005-0.004=0.001
min0.149-0.155=-0.006
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.001
σ0.003-0.002=0.000
min21.285-21.284=0.001
max21.293-21.293=0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=-0.001
σ0.361-0.359=0.002
min1752.993-1752.999=-0.006
max1754.152-1754.141=0.011
mean1664.300-1653.300=11.000
σ628.357-642.857=-14.500
min684.000-628.000=56.000
max2775.000-2885.000=-110.000
mean2.831-2.840=-0.009
σ0.110-0.113=-0.003
min2.584-2.594=-0.011
max3.048-3.024=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-271.991=0.025
σ0.008-0.003=0.005
min272.003-271.989=0.014
max272.024-271.995=0.028
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean0.389-0.395=-0.005
σ0.006-0.004=0.002
min0.379-0.391=-0.011
max0.393-0.401=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.427=0.008
σ0.009-0.007=0.002
min1932.422-1932.418=0.004
max1932.443-1932.435=0.008
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean2.989-2.982=0.007
σ0.141-0.080=0.060
min2.752-2.904=-0.152
max3.131-3.099=0.032
iters=5
new-facts=6402
prior-facts=1
mean4753.021-4753.046=-0.025
σ0.647-0.619=0.027
min4752.618-4752.680=-0.062
max4754.170-4754.143=0.027
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean8.757-8.494=0.263
σ0.266-0.449=-0.183
min8.463-7.908=0.555
max9.107-9.036=0.071
iters=5
new-facts=6402
prior-facts=6402
mean4943.489-4943.632=-0.143
σ0.171-0.022=0.149
min4943.297-4943.611=-0.315
max4943.625-4943.660=-0.035
mean2993.600-3040.200=-46.600
σ225.975-183.072=42.904
min2775.000-2885.000=-110.000
max3326.000-3333.000=-7.000
mean8.486-8.510=-0.024
σ0.092-0.096=-0.004
min8.401-8.374=0.027
max8.635-8.643=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.992-1.026=-0.034
σ0.141-0.141=-0.000
min0.926-0.933=-0.007
max1.243-1.256=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.083-473.081=0.002
σ575.914-575.913=0.001
min185.119-185.115=0.004
max1336.954-1336.951=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean0.485-0.486=-0.001
σ0.371-0.376=-0.005
min0.299-0.295=0.003
max1.041-1.049=-0.009
policies=20
mean1851.443-1851.471=-0.028
σ0.333-0.364=-0.031
min1851.193-1851.205=-0.012
max1851.933-1852.002=-0.069
mean840.000
σ0.000
min840.000
max840.000
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean2.888-2.946=-0.057
σ0.084-0.010=0.074
min2.845-2.933=-0.087
max3.014-2.955=0.059
policies=200
mean18521.153-18521.196=-0.044
σ0.482-0.479=0.003
min18520.867-18520.896=-0.029
max18521.873-18521.911=-0.037
mean8400.000
σ0.000
min8400.000
max8400.000
mean2775.000-2885.000=-110.000
σ0.000
min2775.000-2885.000=-110.000
max2775.000-2885.000=-110.000
mean28.747-29.226=-0.480
σ0.036-0.480=-0.444
min28.703-28.811=-0.109
max28.777-29.724=-0.947