Compare commits

Home / Compare 1bca5ad8 .. 531e7782

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.050=-0.003
min33.955-33.943=0.012
max34.111-34.118=-0.007
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.082-0.082=-0.000
σ0.005-0.004=0.001
min0.077-0.077=0.000
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.001
σ0.002-0.004=-0.001
min23.314-23.312=0.001
max23.321-23.322=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.064=0.002
σ0.003-0.003=-0.001
min0.064-0.059=0.004
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.302=0.126
σ0.364-0.366=-0.002
min1756.854-1756.737=0.117
max1758.016-1757.895=0.122
mean1648.300-1653.450=-5.150
σ612.222-638.013=-25.791
min677.000-628.000=49.000
max2630.000-2757.000=-127.000
mean2.367-2.417=-0.050
σ0.093-0.190=-0.096
min2.255-2.287=-0.032
max2.595-3.099=-0.503

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.445=0.130
σ0.043-0.053=-0.010
min326.503-326.352=0.151
max326.616-326.484=0.132
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean0.424-0.424=0.000
σ0.007-0.002=0.005
min0.420-0.422=-0.002
max0.436-0.426=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.616=0.111
σ0.018-0.007=0.011
min1988.707-1988.606=0.101
max1988.749-1988.623=0.126
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean2.803-2.683=0.120
σ0.283-0.052=0.232
min2.632-2.626=0.006
max3.305-2.761=0.544
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4813.496=-0.038
σ7.778-7.714=0.065
min4809.613-4809.914=-0.301
max4827.367-4827.294=0.073
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean8.985-8.282=0.703
σ0.192-0.605=-0.413
min8.674-7.703=0.971
max9.173-9.197=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5001.021=0.125
σ0.034-0.034=-0.000
min5001.112-5000.982=0.130
max5001.200-5001.067=0.133
mean2989.800-3014.400=-24.600
σ275.427-320.136=-44.708
min2630.000-2757.000=-127.000
max3317.000-3503.000=-186.000
mean9.752-9.634=0.119
σ0.388-0.594=-0.206
min9.113-8.595=0.517
max10.125-10.111=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-0.950=0.168
σ0.304-0.058=0.246
min0.913-0.908=0.005
max1.652-1.050=0.602

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.433=0.138
σ574.780-574.776=0.004
min177.172-177.041=0.131
max1326.741-1326.596=0.145
mean88.250
σ8.500
min84.000
max101.000
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean0.556-0.430=0.126
σ0.568-0.305=0.264
min0.270-0.277=-0.008
max1.409-0.887=0.521
policies=20
mean1772.012-1770.846=1.166
σ0.353-0.346=0.007
min1771.785-1770.565=1.220
max1772.538-1771.326=1.212
mean840.000
σ0.000
min840.000
max840.000
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean2.728-2.837=-0.109
σ0.018-0.125=-0.107
min2.704-2.695=0.009
max2.747-3.000=-0.253
policies=200
mean17727.390-17714.796=12.594
σ0.544-0.557=-0.013
min17727.085-17714.487=12.598
max17728.205-17715.631=12.574
mean8400.000
σ0.000
min8400.000
max8400.000
mean2630.000-2757.000=-127.000
σ0.000
min2630.000-2757.000=-127.000
max2630.000-2757.000=-127.000
mean27.481-27.500=-0.019
σ0.093-0.149=-0.056
min27.390-27.370=0.020
max27.577-27.650=-0.074