Compare commits

Home / Compare acfe31c8 .. e3b7a707

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.001
σ0.048-0.049=-0.001
min70.361-70.361=-0.001
max70.522-70.527=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.157-0.159=-0.002
σ0.005-0.003=0.002
min0.151-0.156=-0.005
max0.164-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.146=-0.001
σ0.003-0.003=0.000
min21.138-21.141=-0.003
max21.147-21.150=-0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.063-0.065=-0.002
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=-0.000
σ0.366-0.360=0.006
min1751.827-1751.827=0.000
max1752.976-1752.977=-0.001
mean1654.350-1664.800=-10.450
σ645.227-624.670=20.557
min631.000-638.000=-7.000
max2849.000-2517.000=332.000
mean2.763-2.766=-0.004
σ0.176-0.184=-0.008
min2.428-2.324=0.104
max3.032-2.949=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.133-270.138=-0.006
σ0.015-0.007=0.008
min270.119-270.130=-0.011
max270.154-270.146=0.009
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean0.386-0.379=0.007
σ0.008-0.006=0.001
min0.377-0.375=0.002
max0.398-0.390=0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.605=0.004
σ0.005-0.006=-0.001
min1930.602-1930.600=0.001
max1930.613-1930.614=-0.001
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean2.543-2.513=0.030
σ0.162-0.092=0.070
min2.383-2.444=-0.060
max2.806-2.673=0.134
iters=5
new-facts=6402
prior-facts=1
mean4751.351-4750.954=0.397
σ0.829-1.121=-0.292
min4750.877-4750.217=0.660
max4752.823-4752.907=-0.084
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean8.210-8.677=-0.467
σ0.452-0.650=-0.198
min7.705-7.603=0.101
max8.693-9.163=-0.470
iters=5
new-facts=6402
prior-facts=6402
mean4941.772-4941.773=-0.001
σ0.018-0.013=0.005
min4941.753-4941.760=-0.007
max4941.794-4941.794=0.000
mean3052.600-2980.600=72.000
σ188.894-290.380=-101.486
min2849.000-2593.000=256.000
max3323.000-3330.000=-7.000
mean8.534-8.513=0.020
σ0.151-0.158=-0.008
min8.387-8.359=0.028
max8.734-8.729=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.685=-0.663
σ0.187-0.161=0.026
min0.935-1.398=-0.463
max1.356-1.786=-0.430

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.370=0.007
σ575.924-575.927=-0.003
min178.409-178.403=0.006
max1330.263-1330.260=0.003
mean84.000
σ8.000
min80.000
max96.000
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean0.441-0.553=-0.113
σ0.303-0.546=-0.243
min0.284-0.278=0.006
max0.895-1.372=-0.477
policies=20
mean1784.368-1784.318=0.049
σ0.357-0.350=0.007
min1784.127-1784.095=0.032
max1784.895-1784.839=0.056
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean2.850-2.759=0.091
σ0.010-0.011=-0.001
min2.841-2.751=0.090
max2.861-2.775=0.086
policies=200
mean17849.829-17849.851=-0.023
σ0.501-0.366=0.135
min17849.461-17849.605=-0.144
max17850.550-17850.393=0.157
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2517.000=332.000
σ0.000
min2849.000-2517.000=332.000
max2849.000-2517.000=332.000
mean28.287-27.818=0.470
σ0.468-0.137=0.331
min27.782-27.705=0.077
max28.711-28.016=0.695