Compare commits

Home / Compare a3afcf9a .. ef336574

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.687-70.699=-0.012
σ0.047-0.046=0.001
min70.663-70.676=-0.013
max70.820-70.825=-0.005
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.162-0.155=0.007
σ0.003-0.006=-0.003
min0.159-0.147=0.012
max0.167-0.164=0.004
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=-0.000
σ0.002-0.003=-0.001
min21.417-21.414=0.003
max21.424-21.425=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.065=0.001
σ0.002-0.002=-0.000
min0.064-0.063=0.001
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.459=-0.000
σ0.360-0.360=-0.000
min1753.888-1753.887=0.001
max1755.043-1755.042=0.001
mean1668.900-1655.550=13.350
σ654.277-629.225=25.053
min638.000-622.000=16.000
max2866.000-2659.000=207.000
mean2.821-2.812=0.009
σ0.195-0.163=0.032
min2.183-2.344=-0.161
max3.064-3.033=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.506-273.499=0.006
σ0.010-0.007=0.003
min273.490-273.489=0.002
max273.518-273.507=0.011
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean0.378-0.375=0.002
σ0.004-0.005=-0.001
min0.374-0.370=0.004
max0.385-0.381=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1933.901=-0.003
σ0.005-0.011=-0.006
min1933.891-1933.890=0.001
max1933.902-1933.914=-0.012
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean2.986-2.909=0.077
σ0.182-0.130=0.052
min2.679-2.726=-0.047
max3.151-3.061=0.090
iters=5
new-facts=6402
prior-facts=1
mean4754.394-4754.691=-0.296
σ0.766-0.803=-0.037
min4753.580-4754.226=-0.645
max4755.664-4756.121=-0.457
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean8.851-8.262=0.589
σ0.190-0.323=-0.133
min8.613-7.915=0.697
max9.113-8.631=0.482
iters=5
new-facts=6402
prior-facts=6402
mean4945.045-4945.040=0.004
σ0.175-0.158=0.016
min4944.734-4944.758=-0.024
max4945.142-4945.121=0.021
mean3064.800-3011.800=53.000
σ182.211-388.072=-205.862
min2866.000-2659.000=207.000
max3325.000-3568.000=-243.000
mean8.643-8.417=0.226
σ0.205-0.130=0.075
min8.429-8.283=0.147
max8.950-8.630=0.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.144=-0.127
σ0.124-0.325=-0.201
min0.924-0.932=-0.008
max1.213-1.670=-0.456

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.561-473.062=-0.501
σ574.931-575.930=-0.999
min185.089-185.093=-0.003
max1334.958-1336.956=-1.999
mean88.250
σ8.500
min84.000
max101.000
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean0.448-0.535=-0.087
σ0.303-0.496=-0.193
min0.291-0.285=0.006
max0.902-1.279=-0.377
policies=20
mean1851.272-1851.263=0.009
σ0.372-0.372=-0.000
min1851.005-1851.014=-0.009
max1851.815-1851.813=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean2.950-2.861=0.089
σ0.008-0.026=-0.019
min2.942-2.834=0.108
max2.960-2.897=0.063
policies=200
mean18519.313-18519.356=-0.044
σ0.418-0.428=-0.010
min18518.968-18518.990=-0.021
max18519.920-18519.973=-0.053
mean8400.000
σ0.000
min8400.000
max8400.000
mean2866.000-2659.000=207.000
σ0.000
min2866.000-2659.000=207.000
max2866.000-2659.000=207.000
mean29.149-28.817=0.333
σ0.524-0.094=0.430
min28.840-28.712=0.128
max29.933-28.941=0.992