Compare commits

Home / Compare af26e3a9 .. 0fcda13c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.244=0.375
σ0.055-0.051=0.005
min35.587-35.218=0.370
max35.775-35.387=0.388
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.086-0.086=-0.000
σ0.004-0.004=0.001
min0.081-0.082=-0.001
max0.093-0.093=0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-23.770=0.277
σ0.003-0.002=0.001
min24.045-23.767=0.278
max24.053-23.773=0.280
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.069=-0.005
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.072-0.076=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.485=0.005
σ0.365-0.365=0.000
min1755.914-1755.913=0.002
max1757.076-1757.063=0.013
mean1642.300-1658.250=-15.950
σ643.911-642.350=1.561
min616.000-631.000=-15.000
max2718.000-2800.000=-82.000
mean2.385-2.333=0.052
σ0.113-0.145=-0.032
min2.221-2.097=0.124
max2.633-2.786=-0.153

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.692=0.074
σ0.042-0.048=-0.006
min324.691-324.609=0.082
max324.792-324.732=0.059
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean0.428-0.431=-0.003
σ0.009-0.011=-0.002
min0.421-0.423=-0.002
max0.442-0.448=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.262=0.054
σ0.021-0.009=0.011
min1985.292-1985.247=0.045
max1985.334-1985.269=0.065
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean2.631-2.640=-0.010
σ0.102-0.059=0.043
min2.551-2.590=-0.039
max2.761-2.715=0.045
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4808.774=0.322
σ7.647-7.783=-0.136
min4805.611-4804.838=0.773
max4822.775-4822.688=0.087
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean8.962-9.114=-0.152
σ0.362-0.179=0.184
min8.581-8.900=-0.318
max9.521-9.366=0.155
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.437=0.184
σ0.028-0.070=-0.042
min4996.589-4996.317=0.272
max4996.652-4996.492=0.160
mean2982.200-2989.200=-7.000
σ310.297-202.097=108.200
min2718.000-2800.000=-82.000
max3430.000-3291.000=139.000
mean8.458-8.687=-0.229
σ0.049-0.157=-0.108
min8.398-8.473=-0.075
max8.511-8.899=-0.389

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-0.949=0.025
σ0.145-0.051=0.093
min0.902-0.919=-0.017
max1.232-1.040=0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-462.964=0.261
σ574.795-574.250=0.546
min175.814-175.833=-0.019
max1325.417-1324.338=1.079
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean0.531-0.430=0.101
σ0.514-0.302=0.212
min0.273-0.278=-0.005
max1.302-0.883=0.419
policies=20
mean1758.498-1758.685=-0.186
σ0.321-0.327=-0.007
min1758.281-1758.470=-0.189
max1758.973-1759.170=-0.197
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean2.694-2.832=-0.138
σ0.016-0.077=-0.060
min2.677-2.781=-0.104
max2.711-2.946=-0.235
policies=200
mean17592.157-17592.425=-0.268
σ0.533-0.542=-0.009
min17591.851-17592.064=-0.213
max17592.955-17593.231=-0.276
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2800.000=-82.000
σ0.000
min2718.000-2800.000=-82.000
max2718.000-2800.000=-82.000
mean27.396-27.493=-0.097
σ0.121-0.117=0.004
min27.239-27.388=-0.149
max27.519-27.603=-0.084