Compare commits

Home / Compare 94b4cae0 .. 0ae600ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.390=-0.000
σ0.046-0.047=-0.002
min70.361-70.361=0.000
max70.518-70.523=-0.005
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.157=0.002
σ0.004-0.003=0.001
min0.156-0.154=0.001
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.146-21.145=0.000
σ0.002-0.004=-0.001
min21.142-21.139=0.003
max21.149-21.150=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.062=0.001
max0.073-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean20814.796-20814.796=-0.001
σ0.353-0.355=-0.002
min20814.281-20814.278=0.003
max20815.374-20815.383=-0.009
mean2586.150-2632.050=-45.900
σ676.625-768.343=-91.718
min1519.000-1521.000=-2.000
max3744.000-3893.000=-149.000
mean17.001-17.078=-0.077
σ0.939-1.142=-0.203
min16.014-15.216=0.798
max19.029-19.065=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean295.146-295.146=-0.001
σ0.011-0.005=0.006
min295.134-295.141=-0.007
max295.164-295.154=0.010
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean0.416-0.415=0.001
σ0.011-0.006=0.005
min0.404-0.407=-0.003
max0.430-0.421=0.008
iters=5
new-facts=1
prior-facts=6402
mean2981.963-2981.968=-0.006
σ0.010-0.015=-0.005
min2981.954-2981.954=-0.001
max2981.977-2981.988=-0.010
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean3.870-3.936=-0.066
σ0.122-0.088=0.034
min3.742-3.837=-0.094
max4.027-4.042=-0.015
iters=5
new-facts=6402
prior-facts=1
mean5802.644-5802.744=-0.100
σ0.799-1.040=-0.241
min5802.174-5802.171=0.004
max5804.068-5804.600=-0.532
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean9.571-9.486=0.085
σ0.496-0.476=0.020
min8.913-8.712=0.201
max10.291-9.984=0.307
iters=5
new-facts=6402
prior-facts=6402
mean6011.217-6011.247=-0.030
σ0.172-0.065=0.107
min6010.919-6011.156=-0.237
max6011.349-6011.306=0.043
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean9.675-9.212=0.463
σ0.608-0.181=0.427
min8.996-9.030=-0.034
max10.608-9.421=1.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.434-1.429=0.005
σ0.242-0.366=-0.124
min1.058-0.964=0.094
max1.681-1.843=-0.162

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean532.762-532.765=-0.003
σ575.921-575.925=-0.004
min244.797-244.800=-0.003
max1396.644-1396.653=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean0.673-0.665=0.008
σ0.580-0.561=0.018
min0.367-0.368=-0.001
max1.542-1.507=0.036
policies=20
mean2448.347-2448.329=0.018
σ0.425-0.408=0.017
min2447.953-2447.952=0.001
max2448.815-2448.786=0.029
mean800.000
σ0.000
min800.000
max800.000
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean3.706-3.659=0.047
σ0.035-0.017=0.018
min3.678-3.648=0.030
max3.755-3.684=0.071
policies=200
mean24488.513-24488.521=-0.008
σ0.558-0.379=0.179
min24488.137-24488.272=-0.135
max24489.343-24489.085=0.258
mean8000.000
σ0.000
min8000.000
max8000.000
mean3744.000-3893.000=-149.000
σ0.000
min3744.000-3893.000=-149.000
max3744.000-3893.000=-149.000
mean36.867-36.845=0.023
σ0.125-0.183=-0.058
min36.697-36.605=0.092
max36.994-37.050=-0.056