Compare commits

Home / Compare 08077bf3 .. 6001a71f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.045-0.047=-0.001
min70.541-70.535=0.007
max70.692-70.693=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.161=-0.000
σ0.004-0.003=0.001
min0.157-0.159=-0.002
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.012-0.003=0.008
min21.283-21.284=-0.001
max21.323-21.295=0.028
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.003
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.569=-0.002
σ0.359-0.360=-0.000
min1752.998-1752.993=0.005
max1754.152-1754.154=-0.002
mean1648.550-1666.800=-18.250
σ634.966-628.953=6.013
min629.000-688.000=-59.000
max2863.000-2698.000=165.000
mean2.783-2.788=-0.006
σ0.169-0.162=0.007
min2.356-2.307=0.049
max3.023-2.998=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.013=0.004
σ0.008-0.006=0.002
min272.008-272.004=0.004
max272.029-272.018=0.011
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean0.385-0.382=0.004
σ0.007-0.009=-0.002
min0.377-0.376=0.001
max0.395-0.398=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.435=0.002
σ0.008-0.005=0.003
min1932.424-1932.428=-0.004
max1932.443-1932.440=0.002
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean3.058-3.005=0.053
σ0.122-0.070=0.052
min2.947-2.913=0.034
max3.254-3.104=0.149
iters=5
new-facts=6402
prior-facts=1
mean4753.199-4752.915=0.284
σ0.818-1.066=-0.249
min4752.702-4752.141=0.561
max4754.654-4754.766=-0.111
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean8.473-8.788=-0.315
σ0.297-0.210=0.087
min8.073-8.543=-0.470
max8.848-9.003=-0.154
iters=5
new-facts=6402
prior-facts=6402
mean4943.623-4943.626=-0.002
σ0.019-0.019=0.000
min4943.604-4943.602=0.003
max4943.647-4943.652=-0.006
mean3047.000-3018.200=28.800
σ203.405-258.036=-54.631
min2863.000-2698.000=165.000
max3357.000-3334.000=23.000
mean8.746-8.668=0.078
σ0.217-0.204=0.012
min8.447-8.480=-0.033
max9.022-8.997=0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.111=-0.063
σ0.126-0.194=-0.068
min0.938-0.931=0.006
max1.244-1.367=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.079=0.003
σ575.913-575.932=-0.019
min185.120-185.109=0.011
max1336.952-1336.977=-0.026
mean88.250
σ8.500
min84.000
max101.000
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean0.487-0.566=-0.078
σ0.376-0.555=-0.179
min0.298-0.283=0.014
max1.051-1.398=-0.348
policies=20
mean1851.463-1851.415=0.048
σ0.367-0.382=-0.015
min1851.200-1851.164=0.036
max1851.997-1851.980=0.017
mean840.000
σ0.000
min840.000
max840.000
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean2.938-2.859=0.079
σ0.010-0.020=-0.010
min2.928-2.830=0.098
max2.948-2.876=0.072
policies=200
mean18521.172-18521.106=0.066
σ0.442-0.526=-0.084
min18520.850-18520.662=0.188
max18521.822-18521.869=-0.047
mean8400.000
σ0.000
min8400.000
max8400.000
mean2863.000-2698.000=165.000
σ0.000
min2863.000-2698.000=165.000
max2863.000-2698.000=165.000
mean29.056-28.756=0.300
σ0.457-0.084=0.373
min28.706-28.655=0.051
max29.714-28.832=0.883