Compare commits

Home / Compare 99211020 .. 222ca62b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.047-0.048=-0.001
min70.748-70.746=0.001
max70.911-70.914=-0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.161-0.159=0.002
σ0.003-0.004=-0.001
min0.156-0.154=0.002
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.002=0.000
min21.489-21.488=0.000
max21.495-21.495=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.064=0.000
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.095=0.001
σ0.361-0.360=0.001
min1753.533-1753.530=0.003
max1754.680-1754.674=0.006
mean1644.000-1648.850=-4.850
σ633.139-624.808=8.331
min624.000-629.000=-5.000
max2769.000-2697.000=72.000
mean2.764-2.860=-0.096
σ0.236-0.137=0.099
min2.300-2.550=-0.250
max3.175-3.094=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-271.598=-0.001
σ0.009-0.007=0.002
min271.583-271.590=-0.007
max271.605-271.607=-0.002
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean0.386-0.382=0.004
σ0.009-0.004=0.005
min0.380-0.379=0.000
max0.400-0.389=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.001-1931.988=0.013
σ0.010-0.030=-0.020
min1931.984-1931.939=0.045
max1932.008-1932.018=-0.010
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean2.536-2.709=-0.172
σ0.063-0.376=-0.314
min2.490-2.407=0.083
max2.625-3.319=-0.694
iters=5
new-facts=6402
prior-facts=1
mean4752.698-4752.533=0.164
σ0.928-1.116=-0.187
min4752.235-4751.369=0.867
max4754.356-4754.388=-0.032
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean8.792-8.499=0.293
σ0.234-0.578=-0.343
min8.515-7.639=0.875
max9.040-9.091=-0.051
iters=5
new-facts=6402
prior-facts=6402
mean4943.208-4943.205=0.003
σ0.018-0.016=0.002
min4943.184-4943.181=0.003
max4943.227-4943.220=0.007
mean2993.600-2975.800=17.800
σ220.591-239.985=-19.394
min2769.000-2697.000=72.000
max3306.000-3308.000=-2.000
mean8.530-8.461=0.069
σ0.126-0.084=0.042
min8.427-8.329=0.099
max8.739-8.531=0.207

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.130=-0.045
σ0.110-0.180=-0.070
min0.941-0.942=-0.001
max1.251-1.326=-0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-468.639=0.002
σ574.937-574.947=-0.010
min181.163-181.160=0.003
max1331.046-1331.060=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean0.450-0.567=-0.117
σ0.304-0.564=-0.260
min0.296-0.283=0.012
max0.906-1.414=-0.507
policies=20
mean1811.988-1811.943=0.045
σ0.366-0.394=-0.028
min1811.719-1811.676=0.043
max1812.513-1812.525=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean2.918-2.840=0.078
σ0.113-0.010=0.104
min2.841-2.825=0.016
max3.086-2.847=0.239
policies=200
mean18126.646-18126.674=-0.028
σ0.445-0.432=0.013
min18126.288-18126.378=-0.090
max18127.297-18127.316=-0.019
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2697.000=72.000
σ0.000
min2769.000-2697.000=72.000
max2769.000-2697.000=72.000
mean28.579-28.510=0.070
σ0.093-0.082=0.011
min28.456-28.411=0.044
max28.680-28.607=0.074