Compare commits

Home / Compare 34447a2b .. 45d8cf4c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.389=0.002
σ0.048-0.048=-0.000
min70.360-70.361=-0.000
max70.526-70.524=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.159-0.158=0.001
σ0.003-0.005=-0.001
min0.155-0.151=0.004
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.002-0.002=-0.000
min21.143-21.141=0.001
max21.148-21.148=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.064-0.062=0.002
σ0.003-0.003=-0.000
min0.062-0.058=0.004
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.394=-0.001
σ0.360-0.361=-0.001
min1751.829-1751.831=-0.002
max1752.966-1752.975=-0.009
mean1627.700-1665.250=-37.550
σ589.958-624.766=-34.808
min625.000-638.000=-13.000
max2415.000-2517.000=-102.000
mean2.824-2.822=0.002
σ0.168-0.136=0.032
min2.309-2.500=-0.191
max3.057-2.976=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.123-270.150=-0.026
σ0.008-0.004=0.004
min270.115-270.143=-0.028
max270.136-270.154=-0.018
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean0.383-0.386=-0.003
σ0.006-0.009=-0.003
min0.378-0.378=0.000
max0.392-0.398=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.605-1930.575=0.030
σ0.008-0.040=-0.032
min1930.598-1930.505=0.093
max1930.617-1930.607=0.010
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean2.537-2.487=0.050
σ0.150-0.125=0.025
min2.446-2.298=0.148
max2.801-2.621=0.180
iters=5
new-facts=6402
prior-facts=1
mean4751.196-4751.211=-0.015
σ0.925-1.111=-0.186
min4750.517-4750.214=0.304
max4752.825-4753.122=-0.297
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean8.450-8.737=-0.287
σ0.481-0.737=-0.256
min7.661-7.800=-0.139
max8.980-9.786=-0.806
iters=5
new-facts=6402
prior-facts=6402
mean4941.697-4941.773=-0.076
σ0.144-0.019=0.125
min4941.440-4941.750=-0.310
max4941.777-4941.789=-0.013
mean3004.400-2892.200=112.200
σ277.310-334.422=-57.112
min2618.000-2517.000=101.000
max3312.000-3350.000=-38.000
mean8.504-8.351=0.153
σ0.070-0.085=-0.015
min8.422-8.210=0.213
max8.617-8.412=0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.813-1.637=0.176
σ0.123-0.192=-0.069
min1.616-1.402=0.214
max1.937-1.895=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.364=-0.003
σ575.916-575.920=-0.004
min178.401-178.399=0.002
max1330.235-1330.244=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean0.548-0.557=-0.009
σ0.537-0.550=-0.013
min0.277-0.280=-0.003
max1.353-1.381=-0.028
policies=20
mean1784.312-1784.295=0.017
σ0.346-0.354=-0.008
min1784.084-1784.059=0.025
max1784.826-1784.821=0.005
mean800.000
σ0.000
min800.000
max800.000
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean2.794-2.782=0.012
σ0.070-0.026=0.044
min2.750-2.757=-0.008
max2.898-2.819=0.079
policies=200
mean17849.756-17849.839=-0.083
σ0.486-0.480=0.006
min17849.495-17849.466=0.029
max17850.484-17850.544=-0.061
mean8000.000
σ0.000
min8000.000
max8000.000
mean2415.000-2517.000=-102.000
σ0.000
min2415.000-2517.000=-102.000
max2415.000-2517.000=-102.000
mean27.923-27.933=-0.011
σ0.052-0.051=0.001
min27.871-27.859=0.012
max27.975-27.972=0.002