Compare commits

Home / Compare 283e10d9 .. 2e5abb73

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=-0.000
σ0.047-0.048=-0.001
min70.352-70.353=-0.001
max70.510-70.513=-0.004
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.158-0.153=0.006
σ0.005-0.004=0.002
min0.151-0.149=0.002
max0.167-0.159=0.008
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.002=0.000
min21.140-21.141=-0.001
max21.147-21.147=-0.000
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.064-0.063=0.001
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.069-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.386=0.002
σ0.364-0.362=0.003
min1751.819-1751.818=0.001
max1752.970-1752.980=-0.009
mean1655.700-1631.400=24.300
σ632.457-622.595=9.862
min621.000-622.000=-1.000
max2759.000-2767.000=-8.000
mean2.759-2.784=-0.025
σ0.199-0.205=-0.006
min2.379-2.263=0.116
max3.034-3.054=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.125-270.106=0.019
σ0.006-0.007=-0.001
min270.114-270.095=0.019
max270.129-270.114=0.015
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean0.382-0.382=0.000
σ0.006-0.005=0.001
min0.378-0.377=0.001
max0.393-0.390=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.574-1930.594=-0.020
σ0.022-0.016=0.006
min1930.548-1930.577=-0.029
max1930.603-1930.616=-0.012
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean2.499-2.634=-0.135
σ0.169-0.133=0.036
min2.250-2.464=-0.214
max2.699-2.823=-0.124
iters=5
new-facts=6402
prior-facts=1
mean4751.117-4750.952=0.166
σ0.810-0.627=0.183
min4750.656-4750.580=0.077
max4752.555-4752.067=0.488
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean8.184-8.705=-0.522
σ0.380-0.383=-0.003
min7.699-8.068=-0.370
max8.649-9.035=-0.386
iters=5
new-facts=6402
prior-facts=6402
mean4941.379-4941.527=-0.149
σ0.102-0.094=0.007
min4941.267-4941.445=-0.178
max4941.465-4941.636=-0.171
mean3042.600-3025.400=17.200
σ339.472-304.155=35.317
min2759.000-2767.000=-8.000
max3545.000-3472.000=73.000
mean8.386-8.568=-0.183
σ0.104-0.069=0.035
min8.288-8.517=-0.229
max8.564-8.682=-0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.016=0.030
σ0.163-0.140=0.023
min0.943-0.926=0.017
max1.321-1.247=0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.374=-0.012
σ575.928-575.955=-0.027
min178.386-178.384=0.003
max1330.255-1330.307=-0.052
mean84.000
σ8.000
min80.000
max96.000
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean0.552-0.538=0.014
σ0.529-0.503=0.026
min0.282-0.282=-0.000
max1.345-1.293=0.053
policies=20
mean1784.217-1784.200=0.017
σ0.354-0.349=0.005
min1783.988-1783.965=0.023
max1784.744-1784.719=0.025
mean800.000
σ0.000
min800.000
max800.000
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean2.765-2.748=0.017
σ0.013-0.028=-0.016
min2.754-2.708=0.046
max2.777-2.775=0.002
policies=200
mean17848.879-17848.743=0.136
σ0.430-0.605=-0.175
min17848.622-17848.387=0.235
max17849.521-17849.648=-0.127
mean8000.000
σ0.000
min8000.000
max8000.000
mean2759.000-2767.000=-8.000
σ0.000
min2759.000-2767.000=-8.000
max2759.000-2767.000=-8.000
mean27.984-27.894=0.090
σ0.149-0.146=0.003
min27.856-27.783=0.073
max28.196-28.104=0.092