Compare commits

Home / Compare 4c0cac2c .. 1302fbbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-30.958=0.001
σ0.048-0.049=-0.001
min30.919-30.912=0.007
max31.091-31.092=-0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.078-0.076=0.003
σ0.003-0.004=-0.001
min0.075-0.070=0.005
max0.085-0.082=0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.000
σ0.003-0.003=0.000
min21.054-21.056=-0.002
max21.064-21.064=0.000
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.061-0.063=-0.002
σ0.003-0.002=0.001
min0.058-0.061=-0.004
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.408-1751.412=-0.004
σ0.362-0.364=-0.001
min1750.840-1750.839=0.001
max1752.006-1751.991=0.015
mean1637.950-1636.650=1.300
σ620.598-614.115=6.483
min646.000-653.000=-7.000
max2478.000-2466.000=12.000
mean2.789-2.739=0.049
σ0.163-0.210=-0.047
min2.513-2.321=0.192
max3.207-3.189=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.403-273.401=0.002
σ0.010-0.011=-0.001
min273.393-273.392=0.001
max273.414-273.418=-0.005
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean0.384-0.389=-0.005
σ0.008-0.017=-0.009
min0.376-0.375=0.001
max0.397-0.415=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1933.843-1933.841=0.003
σ0.009-0.006=0.003
min1933.833-1933.834=-0.001
max1933.856-1933.850=0.006
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean3.194-3.085=0.110
σ0.216-0.099=0.117
min2.891-3.000=-0.109
max3.469-3.219=0.250
iters=5
new-facts=6402
prior-facts=1
mean4754.340-4754.340=-0.001
σ0.872-0.900=-0.028
min4753.866-4753.741=0.124
max4755.896-4755.937=-0.041
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean8.680-8.590=0.090
σ0.514-0.630=-0.115
min7.783-7.661=0.122
max9.077-9.157=-0.081
iters=5
new-facts=6402
prior-facts=6402
mean4944.663-4944.798=-0.135
σ0.193-0.075=0.118
min4944.394-4944.741=-0.346
max4944.889-4944.881=0.008
mean3028.600-3034.200=-5.600
σ415.514-358.411=57.103
min2478.000-2558.000=-80.000
max3558.000-3368.000=190.000
mean8.641-8.752=-0.111
σ0.079-0.224=-0.145
min8.548-8.509=0.039
max8.745-9.077=-0.332

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.737-1.835=-0.098
σ0.137-0.097=0.040
min1.496-1.766=-0.270
max1.839-2.003=-0.165

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.332-463.333=-0.001
σ572.197-572.193=0.004
min177.231-177.234=-0.003
max1321.628-1321.624=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean0.556-0.553=0.003
σ0.556-0.535=0.021
min0.274-0.275=-0.000
max1.389-1.355=0.034
policies=20
mean1772.552-1772.586=-0.034
σ0.314-0.327=-0.013
min1772.340-1772.368=-0.028
max1773.018-1773.071=-0.053
mean760.000
σ0.000
min760.000
max760.000
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean2.723-2.749=-0.026
σ0.011-0.009=0.001
min2.708-2.739=-0.031
max2.731-2.761=-0.030
policies=200
mean17732.322-17732.517=-0.194
σ0.566-0.500=0.066
min17732.001-17732.240=-0.239
max17733.168-17733.266=-0.097
mean7600.000
σ0.000
min7600.000
max7600.000
mean2478.000-2466.000=12.000
σ0.000
min2478.000-2466.000=12.000
max2478.000-2466.000=12.000
mean27.607-27.655=-0.048
σ0.119-0.142=-0.023
min27.483-27.548=-0.065
max27.768-27.862=-0.095