Compare commits

Home / Compare 7f2a9918 .. 91e7d6db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.055-0.054=0.001
min35.215-35.220=-0.004
max35.398-35.397=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.085-0.083=0.001
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.002-0.003=-0.001
min23.765-23.762=0.002
max23.770-23.774=-0.003
mean413.600-413.000=0.600
σ0.516-0.000=0.516
min413.000
max414.000-413.000=1.000
mean0.066-0.066=0.001
σ0.006-0.004=0.001
min0.060-0.061=-0.001
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1718.426=37.939
σ0.365-169.655=-169.290
min1755.788-997.644=758.144
max1756.949-1756.952=-0.004
mean1649.800-1616.950=32.850
σ641.535-607.494=34.041
min626.000-625.000=1.000
max2828.000-2450.000=378.000
mean2.334-2.298=0.035
σ0.093-0.239=-0.146
min2.244-1.371=0.874
max2.610-2.603=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.576-324.581=-0.005
σ0.058-0.053=0.004
min324.474-324.486=-0.012
max324.609-324.610=-0.001
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean0.423-0.430=-0.007
σ0.001-0.010=-0.008
min0.422-0.423=-0.001
max0.425-0.443=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.138-1985.142=-0.004
σ0.011-0.015=-0.004
min1985.121-1985.123=-0.002
max1985.148-1985.159=-0.011
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean2.616-2.647=-0.031
σ0.084-0.075=0.010
min2.535-2.550=-0.016
max2.738-2.732=0.006
iters=5
new-facts=6402
prior-facts=1
mean4808.742-4808.741=0.000
σ7.661-7.695=-0.034
min4805.263-4805.275=-0.011
max4822.445-4822.506=-0.060
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean8.941-8.955=-0.014
σ0.149-0.093=0.056
min8.747-8.849=-0.103
max9.132-9.081=0.051
iters=5
new-facts=6402
prior-facts=6402
mean4996.270-4996.348=-0.078
σ0.159-0.009=0.150
min4995.988-4996.336=-0.348
max4996.365-4996.360=0.005
mean3030.800-2945.600=85.200
σ273.175-425.815=-152.640
min2828.000-2464.000=364.000
max3460.000-3516.000=-56.000
mean8.499-8.504=-0.005
σ0.147-0.115=0.032
min8.422-8.428=-0.006
max8.760-8.705=0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.966-1.527=-0.561
σ0.072-0.284=-0.212
min0.902-1.076=-0.174
max1.047-1.857=-0.810

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.965-462.948=0.017
σ574.247-574.248=-0.001
min175.833-175.819=0.015
max1324.336-1324.320=0.016
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean0.434-0.567=-0.134
σ0.304-0.581=-0.277
min0.278-0.274=0.005
max0.889-1.438=-0.550
policies=20
mean1758.707-1758.500=0.207
σ0.344-0.349=-0.004
min1758.483-1758.270=0.214
max1759.218-1759.018=0.201
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean2.784-2.714=0.070
σ0.006-0.009=-0.003
min2.777-2.705=0.073
max2.789-2.723=0.066
policies=200
mean17593.331-17592.460=0.872
σ0.692-0.477=0.215
min17592.396-17592.170=0.226
max17593.870-17593.173=0.697
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2450.000=378.000
σ0.000
min2828.000-2450.000=378.000
max2828.000-2450.000=378.000
mean27.840-27.443=0.397
σ0.454-0.092=0.363
min27.462-27.321=0.141
max28.387-27.536=0.851