Compare commits

Home / Compare 3b5fc27b .. 15b2e049

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.000
σ0.046-0.048=-0.002
min70.674-70.668=0.006
max70.831-70.834=-0.003
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.162-0.161=0.001
σ0.004-0.003=0.001
min0.159-0.158=0.001
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.000
σ0.002-0.003=-0.000
min21.402-21.404=-0.002
max21.410-21.412=-0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.002
min0.060-0.058=0.002
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.931=0.000
σ0.363-0.361=0.002
min1754.362-1754.357=0.005
max1755.513-1755.515=-0.002
mean1656.700-1652.650=4.050
σ616.580-643.197=-26.618
min621.000-624.000=-3.000
max2492.000-2779.000=-287.000
mean2.796-2.830=-0.035
σ0.161-0.159=0.002
min2.258-2.293=-0.035
max2.977-3.171=-0.193

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.790=0.000
σ0.004-0.003=0.001
min272.786-272.786=-0.000
max272.796-272.794=0.003
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean0.381-0.378=0.003
σ0.008-0.003=0.005
min0.377-0.375=0.002
max0.395-0.381=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.211-1933.225=-0.014
σ0.017-0.011=0.006
min1933.189-1933.212=-0.023
max1933.233-1933.242=-0.009
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean3.072-3.057=0.014
σ0.121-0.063=0.058
min2.966-3.013=-0.046
max3.271-3.157=0.114
iters=5
new-facts=6402
prior-facts=1
mean4756.925-4756.609=0.316
σ7.588-7.463=0.125
min4753.463-4752.862=0.602
max4770.499-4769.950=0.549
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean8.727-8.808=-0.081
σ0.363-0.351=0.013
min8.306-8.475=-0.169
max9.117-9.342=-0.225
iters=5
new-facts=6402
prior-facts=6402
mean4944.387-4944.451=-0.065
σ0.151-0.015=0.136
min4944.118-4944.435=-0.317
max4944.467-4944.474=-0.007
mean2943.400-2988.800=-45.400
σ317.421-268.947=48.473
min2492.000-2779.000=-287.000
max3349.000-3398.000=-49.000
mean8.465-8.376=0.089
σ0.118-0.064=0.053
min8.305-8.296=0.009
max8.607-8.440=0.167

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.509-1.062=0.447
σ0.092-0.221=-0.129
min1.354-0.908=0.446
max1.600-1.394=0.206

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.322-468.342=-0.021
σ574.259-574.272=-0.013
min181.187-181.201=-0.014
max1329.711-1329.751=-0.040
mean88.250
σ8.500
min84.000
max101.000
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean0.559-0.442=0.117
σ0.557-0.302=0.256
min0.278-0.289=-0.012
max1.395-0.895=0.501
policies=20
mean1812.168-1812.375=-0.207
σ0.384-0.400=-0.017
min1811.911-1812.101=-0.189
max1812.737-1812.964=-0.227
mean840.000
σ0.000
min840.000
max840.000
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean2.806-2.885=-0.079
σ0.013-0.017=-0.004
min2.793-2.862=-0.069
max2.822-2.902=-0.080
policies=200
mean18129.044-18129.139=-0.094
σ0.489-0.388=0.102
min18128.770-18128.769=0.001
max18129.777-18129.548=0.229
mean8400.000
σ0.000
min8400.000
max8400.000
mean2492.000-2779.000=-287.000
σ0.000
min2492.000-2779.000=-287.000
max2492.000-2779.000=-287.000
mean28.313-28.400=-0.087
σ0.072-0.228=-0.156
min28.260-28.254=0.006
max28.415-28.739=-0.324