Compare commits

Home / Compare d71e9dee .. c135b59f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.382-70.380=0.002
σ0.048-0.047=0.001
min70.347-70.351=-0.004
max70.514-70.511=0.004
mean414.000-411.400=2.600
σ0.000-0.516=-0.516
min414.000-411.000=3.000
max414.000-412.000=2.000
mean0.161-0.158=0.003
σ0.003-0.005=-0.002
min0.159-0.151=0.008
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.001
min21.140-21.141=-0.001
max21.150-21.149=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.063-0.062=0.001
σ0.003-0.004=-0.001
min0.059-0.058=0.001
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.388=0.001
σ0.364-0.361=0.002
min1751.818-1751.817=0.001
max1752.967-1752.967=0.000
mean1627.550-1654.100=-26.550
σ589.196-644.477=-55.281
min626.000-623.000=3.000
max2414.000-2848.000=-434.000
mean2.826-2.853=-0.027
σ0.143-0.083=0.060
min2.312-2.679=-0.367
max3.006-3.023=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.131-270.127=0.004
σ0.004-0.003=0.001
min270.128-270.124=0.004
max270.138-270.131=0.007
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean0.380-0.381=-0.001
σ0.001-0.004=-0.004
min0.379-0.378=0.001
max0.381-0.389=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.598-1930.595=0.003
σ0.012-0.026=-0.014
min1930.582-1930.560=0.022
max1930.612-1930.629=-0.018
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean2.517-2.492=0.025
σ0.137-0.098=0.039
min2.368-2.427=-0.059
max2.725-2.664=0.061
iters=5
new-facts=6402
prior-facts=1
mean4751.069-4750.932=0.137
σ0.850-0.944=-0.094
min4750.547-4750.181=0.366
max4752.582-4752.582=-0.001
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean8.465-8.658=-0.192
σ0.515-0.171=0.344
min7.618-8.482=-0.864
max8.934-8.929=0.005
iters=5
new-facts=6402
prior-facts=6402
mean4941.529-4941.531=-0.003
σ0.084-0.082=0.003
min4941.459-4941.466=-0.007
max4941.628-4941.628=0.000
mean3024.200-3066.200=-42.000
σ299.401-233.615=65.786
min2608.000-2848.000=-240.000
max3410.000-3411.000=-1.000
mean8.517-8.566=-0.050
σ0.127-0.214=-0.086
min8.387-8.308=0.079
max8.685-8.832=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.697-0.997=0.700
σ0.194-0.137=0.057
min1.468-0.931=0.537
max1.990-1.242=0.749

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-466.358=-0.006
σ575.922-575.921=0.001
min178.388-178.392=-0.004
max1330.235-1330.239=-0.004
mean84.000
σ8.000
min80.000
max96.000
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean0.566-0.442=0.124
σ0.558-0.302=0.256
min0.276-0.289=-0.012
max1.404-0.896=0.508
policies=20
mean1784.224-1784.247=-0.023
σ0.361-0.356=0.005
min1783.984-1784.016=-0.032
max1784.760-1784.775=-0.015
mean800.000
σ0.000
min800.000
max800.000
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean2.770-2.858=-0.088
σ0.010-0.033=-0.023
min2.765-2.837=-0.072
max2.785-2.908=-0.123
policies=200
mean17848.736-17848.792=-0.056
σ0.478-0.443=0.035
min17848.361-17848.479=-0.118
max17849.430-17849.445=-0.015
mean8000.000
σ0.000
min8000.000
max8000.000
mean2414.000-2848.000=-434.000
σ0.000
min2414.000-2848.000=-434.000
max2414.000-2848.000=-434.000
mean27.911-28.297=-0.386
σ0.056-0.534=-0.478
min27.843-27.832=0.011
max27.968-28.771=-0.803