Compare commits

Home / Compare f1f95afc .. 154656a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.700=0.003
σ0.049-0.047=0.002
min70.667-70.673=-0.006
max70.838-70.832=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.161-0.152=0.010
σ0.003-0.011=-0.007
min0.159-0.126=0.033
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.408-21.407=0.001
σ0.003-0.001=0.002
min21.401-21.405=-0.004
max21.411-21.409=0.002
mean414.500-415.800=-1.300
σ0.527-0.422=0.105
min414.000-415.000=-1.000
max415.000-416.000=-1.000
mean0.063-0.053=0.009
σ0.004-0.004=0.000
min0.059-0.050=0.009
max0.069-0.061=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.932=-0.002
σ0.362-0.363=-0.001
min1754.357-1754.367=-0.010
max1755.512-1755.529=-0.017
mean1660.650-1667.500=-6.850
σ646.005-620.926=25.080
min623.000-625.000=-2.000
max2779.000-2504.000=275.000
mean2.782-2.795=-0.012
σ0.179-0.186=-0.007
min2.248-2.178=0.070
max2.978-3.034=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.756=0.001
σ0.006-0.008=-0.002
min272.750-272.744=0.006
max272.764-272.766=-0.002
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean0.383-0.383=-0.000
σ0.008-0.010=-0.002
min0.378-0.371=0.007
max0.397-0.397=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.168-1933.158=0.010
σ0.015-0.017=-0.002
min1933.145-1933.130=0.015
max1933.181-1933.177=0.005
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean3.057-3.070=-0.013
σ0.054-0.214=-0.160
min3.019-2.771=0.247
max3.152-3.373=-0.221
iters=5
new-facts=6402
prior-facts=1
mean4756.923-4756.813=0.109
σ7.561-7.653=-0.092
min4753.485-4753.000=0.485
max4770.449-4770.497=-0.049
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean8.436-8.513=-0.077
σ0.400-0.427=-0.027
min7.837-7.843=-0.007
max8.909-9.034=-0.125
iters=5
new-facts=6402
prior-facts=6402
mean4944.325-4944.398=-0.073
σ0.146-0.025=0.121
min4944.065-4944.363=-0.299
max4944.406-4944.423=-0.018
mean3038.200-2961.400=76.800
σ315.303-402.498=-87.195
min2779.000-2504.000=275.000
max3512.000-3479.000=33.000
mean8.496-8.495=0.001
σ0.114-0.086=0.028
min8.414-8.408=0.006
max8.690-8.616=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.620=-0.617
σ0.134-0.274=-0.140
min0.914-1.223=-0.308
max1.220-1.842=-0.622

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.319=0.019
σ574.257-574.258=-0.001
min181.203-181.187=0.016
max1329.724-1329.706=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean0.446-0.560=-0.115
σ0.301-0.548=-0.247
min0.291-0.285=0.007
max0.896-1.382=-0.485
policies=20
mean1812.370-1812.181=0.188
σ0.395-0.386=0.009
min1812.090-1811.932=0.158
max1812.948-1812.753=0.194
mean840.000
σ0.000
min840.000
max840.000
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean2.886-2.825=0.060
σ0.006-0.010=-0.004
min2.877-2.812=0.065
max2.890-2.836=0.054
policies=200
mean18129.090-18128.905=0.185
σ0.526-0.629=-0.103
min18128.626-18128.495=0.132
max18129.577-18129.842=-0.265
mean8400.000
σ0.000
min8400.000
max8400.000
mean2779.000-2504.000=275.000
σ0.000
min2779.000-2504.000=275.000
max2779.000-2504.000=275.000
mean28.545-28.423=0.122
σ0.238-0.009=0.229
min28.328-28.415=-0.087
max28.884-28.435=0.449