Compare commits

Home / Compare f94b20a0 .. c7aa0064

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.001
σ0.048-0.048=0.000
min70.749-70.753=-0.004
max70.915-70.916=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.159-0.160=-0.002
σ0.003-0.003=0.000
min0.155-0.157=-0.002
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.001
σ0.003-0.002=0.001
min21.488-21.490=-0.002
max21.496-21.497=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.066-0.063=0.003
σ0.004-0.004=0.000
min0.063-0.059=0.004
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.094=0.000
σ0.360-0.362=-0.001
min1753.530-1753.525=0.005
max1754.662-1754.675=-0.013
mean1632.550-1651.250=-18.700
σ598.058-620.322=-22.264
min653.000-669.000=-16.000
max2433.000-2664.000=-231.000
mean2.877-2.786=0.091
σ0.119-0.185=-0.066
min2.529-2.262=0.268
max3.125-3.121=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.592-271.599=-0.006
σ0.006-0.006=0.001
min271.585-271.589=-0.004
max271.603-271.604=-0.001
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean0.381-0.380=0.001
σ0.005-0.002=0.002
min0.378-0.378=0.000
max0.389-0.383=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.000-1931.999=0.001
σ0.008-0.009=-0.001
min1931.994-1931.984=0.010
max1932.011-1932.009=0.002
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean2.509-2.535=-0.026
σ0.111-0.086=0.025
min2.386-2.472=-0.087
max2.685-2.669=0.015
iters=5
new-facts=6402
prior-facts=1
mean4752.672-4752.691=-0.019
σ0.916-0.938=-0.022
min4751.917-4752.194=-0.277
max4754.265-4754.366=-0.100
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean8.296-8.746=-0.450
σ0.249-0.318=-0.068
min7.904-8.271=-0.367
max8.478-9.072=-0.594
iters=5
new-facts=6402
prior-facts=6402
mean4943.136-4943.140=-0.004
σ0.158-0.155=0.003
min4942.855-4942.864=-0.010
max4943.217-4943.234=-0.017
mean2991.800-3000.400=-8.600
σ299.331-267.684=31.647
min2585.000-2664.000=-79.000
max3360.000-3343.000=17.000
mean8.540-8.708=-0.168
σ0.085-0.218=-0.133
min8.448-8.447=0.001
max8.679-8.993=-0.314

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.781-1.249=0.531
σ0.194-0.295=-0.101
min1.446-1.053=0.393
max1.926-1.754=0.172

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.608-468.614=-0.006
σ574.884-574.888=-0.005
min181.166-181.165=0.001
max1330.934-1330.947=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean0.535-0.588=-0.053
σ0.491-0.585=-0.095
min0.286-0.288=-0.002
max1.271-1.466=-0.195
policies=20
mean1811.960-1811.950=0.010
σ0.380-0.381=-0.002
min1811.697-1811.691=0.006
max1812.517-1812.515=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean2.852-2.830=0.022
σ0.020-0.011=0.009
min2.832-2.815=0.017
max2.875-2.840=0.035
policies=200
mean18126.650-18126.797=-0.147
σ0.593-0.505=0.088
min18126.249-18126.519=-0.270
max18127.506-18127.554=-0.049
mean8400.000
σ0.000
min8400.000
max8400.000
mean2433.000-2664.000=-231.000
σ0.000
min2433.000-2664.000=-231.000
max2433.000-2664.000=-231.000
mean28.696-28.475=0.221
σ0.091-0.058=0.033
min28.562-28.418=0.144
max28.767-28.530=0.237