Compare commits

Home / Compare b6df6f8b .. 8ed2a49d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.000
σ0.055-0.053=0.001
min35.217-35.215=0.002
max35.399-35.395=0.004
mean412.000-415.700=-3.700
σ0.000-0.483=-0.483
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.085-0.086=-0.000
σ0.004-0.004=0.000
min0.082-0.083=-0.001
max0.093-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.004=-0.000
min23.765-23.765=-0.000
max23.778-23.778=0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.068-0.067=0.000
σ0.002-0.004=-0.002
min0.065-0.062=0.004
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=0.000
σ0.365-0.366=-0.001
min1755.792-1755.787=0.004
max1756.935-1756.954=-0.019
mean1652.850-1646.600=6.250
σ627.209-634.173=-6.964
min667.000-627.000=40.000
max2754.000-2828.000=-74.000
mean2.321-2.325=-0.004
σ0.103-0.073=0.030
min2.163-2.241=-0.078
max2.581-2.475=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.563-324.587=-0.024
σ0.034-0.039=-0.005
min324.504-324.520=-0.017
max324.585-324.621=-0.035
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean0.424-0.424=0.001
σ0.005-0.001=0.004
min0.421-0.422=-0.002
max0.433-0.425=0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.142-1985.138=0.004
σ0.016-0.006=0.009
min1985.117-1985.128=-0.011
max1985.155-1985.144=0.012
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean2.606-2.558=0.048
σ0.095-0.074=0.021
min2.515-2.493=0.022
max2.721-2.681=0.040
iters=5
new-facts=6402
prior-facts=1
mean4808.791-4808.770=0.021
σ7.760-7.656=0.104
min4805.263-4805.293=-0.030
max4822.672-4822.464=0.208
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean9.236-8.718=0.517
σ0.459-0.379=0.080
min8.912-8.078=0.833
max9.969-9.087=0.883
iters=5
new-facts=6402
prior-facts=6402
mean4996.346-4996.344=0.002
σ0.014-0.021=-0.007
min4996.329-4996.319=0.011
max4996.365-4996.368=-0.003
mean3017.600-3071.800=-54.200
σ234.060-235.388=-1.328
min2754.000-2828.000=-74.000
max3309.000-3419.000=-110.000
mean8.639-8.744=-0.105
σ0.174-0.164=0.011
min8.438-8.510=-0.073
max8.881-8.958=-0.076

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.966-1.003=-0.037
σ0.066-0.068=-0.002
min0.911-0.922=-0.010
max1.042-1.057=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.978=-0.006
σ574.255-574.252=0.003
min175.839-175.837=0.002
max1324.355-1324.357=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean0.432-0.433=-0.001
σ0.300-0.297=0.002
min0.281-0.283=-0.002
max0.881-0.879=0.002
policies=20
mean1758.712-1758.715=-0.003
σ0.347-0.350=-0.002
min1758.475-1758.484=-0.008
max1759.227-1759.235=-0.007
mean820.000
σ0.000
min820.000
max820.000
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean2.811-2.785=0.027
σ0.066-0.011=0.055
min2.772-2.769=0.003
max2.909-2.794=0.116
policies=200
mean17592.431-17593.164=-0.732
σ0.476-0.657=-0.181
min17592.171-17592.216=-0.046
max17593.144-17593.631=-0.487
mean8200.000
σ0.000
min8200.000
max8200.000
mean2754.000-2828.000=-74.000
σ0.000
min2754.000-2828.000=-74.000
max2754.000-2828.000=-74.000
mean27.310-27.857=-0.547
σ0.114-0.360=-0.246
min27.183-27.548=-0.365
max27.431-28.291=-0.860