Compare commits

Home / Compare 65d63041 .. b432ebec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.699=0.002
σ0.045-0.048=-0.003
min70.673-70.667=0.007
max70.826-70.831=-0.005
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.161-0.159=0.002
σ0.003-0.005=-0.002
min0.158-0.150=0.008
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.002-0.003=-0.001
min21.406-21.405=0.001
max21.412-21.414=-0.002
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.065-0.066=-0.000
σ0.003-0.003=0.000
min0.064-0.064=0.000
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.898=0.033
σ0.361-0.361=-0.000
min1754.367-1754.336=0.030
max1755.516-1755.477=0.038
mean1628.250-1630.550=-2.300
σ619.757-606.205=13.551
min623.000-667.000=-44.000
max2757.000-2439.000=318.000
mean2.814-2.865=-0.051
σ0.252-0.112=0.140
min2.286-2.726=-0.441
max3.114-3.098=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.788-272.760=0.028
σ0.006-0.007=-0.001
min272.781-272.752=0.028
max272.794-272.769=0.025
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean0.382-0.387=-0.005
σ0.008-0.008=0.000
min0.377-0.383=-0.006
max0.395-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.230-1933.131=0.099
σ0.004-0.003=0.001
min1933.227-1933.126=0.101
max1933.238-1933.134=0.104
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean3.044-3.143=-0.099
σ0.348-0.136=0.212
min2.735-3.013=-0.278
max3.593-3.293=0.300
iters=5
new-facts=6402
prior-facts=1
mean4756.641-4753.833=2.808
σ7.438-0.642=6.796
min4752.497-4753.384=-0.887
max4769.918-4754.967=14.952
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean8.405-8.181=0.224
σ0.362-0.558=-0.196
min7.982-7.711=0.272
max8.919-9.008=-0.089
iters=5
new-facts=6402
prior-facts=6402
mean4944.461-4944.364=0.096
σ0.020-0.013=0.006
min4944.433-4944.350=0.084
max4944.477-4944.378=0.099
mean3041.800-2928.400=113.400
σ272.668-389.628=-116.961
min2757.000-2439.000=318.000
max3422.000-3446.000=-24.000
mean8.483-8.479=0.005
σ0.112-0.114=-0.002
min8.366-8.382=-0.016
max8.624-8.619=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.794=-0.782
σ0.136-0.117=0.018
min0.918-1.605=-0.687
max1.232-1.893=-0.662

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.337-468.625=-0.288
σ574.292-574.876=-0.584
min181.186-181.181=0.005
max1329.775-1330.938=-1.163
mean88.250
σ8.500
min84.000
max101.000
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean0.486-0.565=-0.079
σ0.405-0.548=-0.143
min0.282-0.289=-0.007
max1.094-1.387=-0.294
policies=20
mean1812.183-1812.167=0.016
σ0.380-0.397=-0.017
min1811.932-1811.896=0.036
max1812.748-1812.752=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean2.806-2.868=-0.062
σ0.009-0.038=-0.029
min2.795-2.830=-0.035
max2.816-2.907=-0.091
policies=200
mean18129.029-18128.977=0.052
σ0.398-0.527=-0.129
min18128.761-18128.589=0.172
max18129.619-18129.737=-0.118
mean8400.000
σ0.000
min8400.000
max8400.000
mean2757.000-2439.000=318.000
σ0.000
min2757.000-2439.000=318.000
max2757.000-2439.000=318.000
mean28.428-28.790=-0.362
σ0.119-0.209=-0.090
min28.322-28.673=-0.351
max28.586-29.103=-0.518