Compare commits

Home / Compare 9abd6427 .. d903f554

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.565=-0.003
σ0.045-0.045=0.001
min70.541-70.534=0.006
max70.689-70.689=0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.158-0.156=0.002
σ0.004-0.005=-0.001
min0.152-0.149=0.003
max0.164-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.011-0.003=0.008
min21.284-21.284=-0.001
max21.321-21.294=0.027
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.063-0.065=-0.001
σ0.004-0.003=0.001
min0.059-0.063=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.570=-0.001
σ0.361-0.359=0.002
min1753.000-1753.000=-0.000
max1754.153-1754.150=0.003
mean1656.400-1645.650=10.750
σ626.535-635.635=-9.099
min689.000-625.000=64.000
max2730.000-2859.000=-129.000
mean2.813-2.836=-0.023
σ0.193-0.113=0.080
min2.278-2.562=-0.284
max3.139-3.012=0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-272.017=-0.002
σ0.007-0.007=0.000
min272.003-272.007=-0.004
max272.021-272.026=-0.005
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean0.381-0.379=0.002
σ0.005-0.004=0.001
min0.377-0.376=0.001
max0.391-0.387=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.434-1932.433=0.001
σ0.005-0.008=-0.003
min1932.426-1932.422=0.004
max1932.440-1932.443=-0.002
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean3.054-3.016=0.038
σ0.119-0.106=0.012
min2.929-2.910=0.020
max3.209-3.194=0.015
iters=5
new-facts=6402
prior-facts=1
mean4753.175-4753.046=0.129
σ0.818-0.585=0.233
min4752.719-4752.718=0.001
max4754.634-4754.089=0.545
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean8.343-8.603=-0.259
σ0.442-0.149=0.293
min7.798-8.489=-0.691
max8.939-8.854=0.085
iters=5
new-facts=6402
prior-facts=6402
mean4943.565-4943.630=-0.065
σ0.148-0.019=0.129
min4943.303-4943.614=-0.311
max4943.662-4943.651=0.011
mean3041.000-3070.000=-29.000
σ250.960-222.332=28.628
min2730.000-2859.000=-129.000
max3354.000-3392.000=-38.000
mean8.891-8.584=0.307
σ0.563-0.231=0.332
min8.425-8.396=0.029
max9.869-8.972=0.896

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.023=0.061
σ0.109-0.136=-0.027
min0.938-0.932=0.006
max1.244-1.246=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.083=-0.002
σ575.922-575.913=0.008
min185.110-185.115=-0.005
max1336.964-1336.953=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean0.564-0.453=0.111
σ0.549-0.302=0.247
min0.286-0.300=-0.014
max1.388-0.906=0.482
policies=20
mean1851.411-1851.476=-0.064
σ0.379-0.374=0.004
min1851.151-1851.201=-0.050
max1851.970-1852.021=-0.050
mean840.000
σ0.000
min840.000
max840.000
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean2.862-2.954=-0.092
σ0.007-0.014=-0.006
min2.857-2.941=-0.085
max2.873-2.973=-0.100
policies=200
mean18521.174-18521.057=0.117
σ0.501-0.378=0.123
min18520.922-18520.761=0.161
max18521.926-18521.612=0.314
mean8400.000
σ0.000
min8400.000
max8400.000
mean2730.000-2859.000=-129.000
σ0.000
min2730.000-2859.000=-129.000
max2730.000-2859.000=-129.000
mean28.822-29.149=-0.327
σ0.049-0.535=-0.486
min28.761-28.659=0.102
max28.867-29.723=-0.856