Compare commits

Home / Compare 685752b7 .. 16b7ce84

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.046-0.044=0.002
min70.750-70.753=-0.003
max70.911-70.903=0.008
mean417.000
σ0.000
min417.000
max417.000
mean0.162-0.159=0.002
σ0.003-0.005=-0.002
min0.159-0.153=0.007
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.001
σ0.003-0.003=0.000
min21.488-21.490=-0.002
max21.496-21.498=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.063-0.066=-0.003
σ0.003-0.003=0.001
min0.059-0.064=-0.005
max0.069-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.898=-0.001
σ0.362-0.360=0.002
min1754.336-1754.330=0.006
max1755.495-1755.479=0.016
mean1647.400-1641.800=5.600
σ632.249-629.030=3.219
min629.000-631.000=-2.000
max2788.000
mean2.748-2.842=-0.095
σ0.270-0.219=0.050
min2.212-2.177=0.035
max3.138-3.148=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.756=0.001
σ0.003-0.007=-0.004
min272.752-272.746=0.006
max272.759-272.761=-0.002
mean2788.000
σ0.000
min2788.000
max2788.000
mean0.390-0.383=0.007
σ0.010-0.004=0.006
min0.382-0.379=0.003
max0.402-0.388=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.132-1933.124=0.008
σ0.010-0.010=-0.001
min1933.116-1933.110=0.006
max1933.142-1933.137=0.005
mean2788.000
σ0.000
min2788.000
max2788.000
mean2.887-3.104=-0.217
σ0.172-0.099=0.073
min2.691-3.009=-0.319
max3.027-3.229=-0.202
iters=5
new-facts=6402
prior-facts=1
mean4753.852-4753.831=0.021
σ0.941-0.647=0.295
min4753.383-4753.353=0.030
max4755.534-4754.968=0.566
mean2788.000
σ0.000
min2788.000
max2788.000
mean8.693-8.137=0.557
σ0.515-0.606=-0.091
min7.831-7.709=0.122
max9.084-9.101=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4944.363-4944.362=0.001
σ0.010-0.019=-0.009
min4944.352-4944.341=0.011
max4944.374-4944.382=-0.008
mean3014.000-3050.600=-36.600
σ280.164-288.099=-7.934
min2788.000
max3436.000-3471.000=-35.000
mean8.404-8.540=-0.135
σ0.075-0.309=-0.233
min8.308-8.358=-0.051
max8.509-9.089=-0.580

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.027=0.043
σ0.170-0.135=0.035
min0.930-0.940=-0.010
max1.348-1.248=0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.664-468.671=-0.007
σ574.941-574.964=-0.023
min181.188-181.185=0.003
max1331.075-1331.117=-0.042
mean88.250
σ8.500
min84.000
max101.000
mean2788.000
σ0.000
min2788.000
max2788.000
mean0.484-0.547=-0.063
σ0.397-0.521=-0.124
min0.285-0.285=-0.001
max1.079-1.328=-0.250
policies=20
mean1812.217-1812.187=0.030
σ0.372-0.391=-0.019
min1811.993-1811.919=0.073
max1812.770-1812.764=0.005
mean840.000
σ0.000
min840.000
max840.000
mean2788.000
σ0.000
min2788.000
max2788.000
mean2.827-2.850=-0.023
σ0.013-0.026=-0.012
min2.807-2.821=-0.014
max2.837-2.879=-0.043
policies=200
mean18129.188-18129.105=0.084
σ0.322-0.501=-0.179
min18128.971-18128.714=0.256
max18129.667-18129.827=-0.160
mean8400.000
σ0.000
min8400.000
max8400.000
mean2788.000
σ0.000
min2788.000
max2788.000
mean28.636-28.549=0.087
σ0.032-0.028=0.004
min28.591-28.517=0.073
max28.667-28.583=0.084