Compare commits

Home / Compare 35e9a088 .. ea0429f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.702=-0.002
σ0.047-0.045=0.002
min70.673-70.675=-0.002
max70.832-70.827=0.004
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.152-0.162=-0.010
σ0.011-0.005=0.006
min0.126-0.156=-0.031
max0.165-0.174=-0.009
cache=y
dps=1
iters=10
policies=100
mean21.407-21.409=-0.002
σ0.001-0.003=-0.002
min21.405-21.403=0.003
max21.409-21.414=-0.005
mean415.800-410.800=5.000
σ0.422
min415.000-410.000=5.000
max416.000-411.000=5.000
mean0.053-0.065=-0.012
σ0.004-0.002=0.001
min0.050-0.064=-0.013
max0.061-0.072=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.897=0.034
σ0.363-0.360=0.003
min1754.367-1754.331=0.036
max1755.529-1755.479=0.050
mean1667.500-1627.050=40.450
σ620.926-607.818=13.108
min625.000-627.000=-2.000
max2504.000-2442.000=62.000
mean2.795-2.757=0.037
σ0.186-0.155=0.031
min2.178-2.347=-0.170
max3.034-2.945=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.731=0.025
σ0.008-0.005=0.003
min272.744-272.723=0.020
max272.766-272.736=0.030
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean0.383-0.384=-0.001
σ0.010-0.001=0.009
min0.371-0.384=-0.013
max0.397-0.386=0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1933.131=0.026
σ0.017-0.019=-0.002
min1933.130-1933.108=0.022
max1933.177-1933.158=0.018
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean3.070-2.884=0.186
σ0.214-0.273=-0.059
min2.771-2.487=0.284
max3.373-3.127=0.246
iters=5
new-facts=6402
prior-facts=1
mean4756.813-4753.682=3.131
σ7.653-0.714=6.939
min4753.000-4753.093=-0.093
max4770.497-4754.909=15.588
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean8.513-8.460=0.053
σ0.427-0.577=-0.150
min7.843-7.756=0.087
max9.034-9.083=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4944.364=0.034
σ0.025-0.017=0.008
min4944.363-4944.341=0.022
max4944.423-4944.380=0.043
mean2961.400-2915.000=46.400
σ402.498-316.704=85.793
min2504.000-2442.000=62.000
max3479.000-3282.000=197.000
mean8.495-8.485=0.010
σ0.086-0.083=0.004
min8.408-8.355=0.053
max8.616-8.551=0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.620-1.660=-0.040
σ0.274-0.137=0.137
min1.223-1.489=-0.266
max1.842-1.803=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.999=-0.679
σ574.258-575.616=-1.358
min181.187-181.184=0.003
max1329.706-1332.423=-2.717
mean88.250
σ8.500
min84.000
max101.000
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean0.560-0.576=-0.016
σ0.548-0.576=-0.028
min0.285-0.285=-0.001
max1.382-1.440=-0.058
policies=20
mean1812.181-1812.181=-0.000
σ0.386-0.391=-0.005
min1811.932-1811.918=0.014
max1812.753-1812.757=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean2.825-2.870=-0.045
σ0.010-0.032=-0.022
min2.812-2.841=-0.029
max2.836-2.916=-0.080
policies=200
mean18128.905-18129.089=-0.184
σ0.629-0.405=0.224
min18128.495-18128.786=-0.291
max18129.842-18129.684=0.159
mean8400.000
σ0.000
min8400.000
max8400.000
mean2504.000-2442.000=62.000
σ0.000
min2504.000-2442.000=62.000
max2504.000-2442.000=62.000
mean28.423-28.710=-0.287
σ0.009-0.044=-0.035
min28.415-28.647=-0.232
max28.435-28.749=-0.314