Compare commits

Home / Compare 49a6f48c .. d57d07f1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.699=0.002
σ0.047-0.045=0.002
min70.673-70.665=0.008
max70.832-70.824=0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.152-0.160=-0.008
σ0.011-0.003=0.008
min0.126-0.155=-0.029
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.407-21.409=-0.002
σ0.001-0.003=-0.002
min21.405-21.403=0.002
max21.409-21.413=-0.004
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.053-0.065=-0.011
σ0.004-0.003=0.001
min0.050-0.063=-0.013
max0.061-0.072=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.898=0.034
σ0.363-0.362=0.001
min1754.367-1754.331=0.036
max1755.529-1755.484=0.045
mean1667.500-1666.650=0.850
σ620.926-644.656=-23.730
min625.000-676.000=-51.000
max2504.000-2713.000=-209.000
mean2.795-2.831=-0.037
σ0.186-0.182=0.004
min2.178-2.155=0.023
max3.034-3.041=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.759=-0.003
σ0.008-0.008=0.000
min272.744-272.749=-0.005
max272.766-272.766=-0.001
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean0.383-0.386=-0.003
σ0.010-0.006=0.004
min0.371-0.383=-0.012
max0.397-0.397=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.158-1933.136=0.022
σ0.017-0.014=0.003
min1933.130-1933.116=0.014
max1933.177-1933.150=0.027
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean3.070-3.009=0.061
σ0.214-0.044=0.170
min2.771-2.947=-0.176
max3.373-3.071=0.302
iters=5
new-facts=6402
prior-facts=1
mean4756.813-4753.839=2.974
σ7.653-0.931=6.722
min4753.000-4753.114=-0.114
max4770.497-4755.465=15.032
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean8.513-8.285=0.228
σ0.427-0.592=-0.165
min7.843-7.614=0.229
max9.034-8.948=0.086
iters=5
new-facts=6402
prior-facts=6402
mean4944.398-4944.362=0.035
σ0.025-0.016=0.009
min4944.363-4944.344=0.019
max4944.423-4944.383=0.041
mean2961.400-3039.000=-77.600
σ402.498-286.279=116.219
min2504.000-2713.000=-209.000
max3479.000-3424.000=55.000
mean8.495-8.501=-0.006
σ0.086-0.114=-0.028
min8.408-8.326=0.082
max8.616-8.601=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.620-1.021=0.599
σ0.274-0.163=0.111
min1.223-0.907=0.315
max1.842-1.263=0.579

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.642=-0.323
σ574.258-574.894=-0.636
min181.187-181.188=-0.001
max1329.706-1330.984=-1.278
mean88.250
σ8.500
min84.000
max101.000
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean0.560-0.556=0.004
σ0.548-0.534=0.013
min0.285-0.287=-0.003
max1.382-1.358=0.024
policies=20
mean1812.181-1812.197=-0.016
σ0.386-0.383=0.003
min1811.932-1811.941=-0.010
max1812.753-1812.763=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean2.825-2.842=-0.017
σ0.010-0.018=-0.008
min2.812-2.817=-0.005
max2.836-2.859=-0.023
policies=200
mean18128.905-18128.907=-0.002
σ0.629-0.577=0.052
min18128.495-18128.499=-0.005
max18129.842-18129.761=0.081
mean8400.000
σ0.000
min8400.000
max8400.000
mean2504.000-2713.000=-209.000
σ0.000
min2504.000-2713.000=-209.000
max2504.000-2713.000=-209.000
mean28.423-28.573=-0.150
σ0.009-0.073=-0.064
min28.415-28.484=-0.069
max28.435-28.661=-0.227