Compare commits

Home / Compare 1cbfc410 .. 03ec3545

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.042-31.040=0.002
σ0.050-0.049=0.000
min30.997-30.997=-0.001
max31.178-31.175=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.078-0.075=0.004
σ0.002-0.004=-0.002
min0.077-0.070=0.007
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.003-0.003=0.000
min21.140-21.138=0.002
max21.150-21.149=0.001
mean414.000-415.600=-1.600
σ0.000-0.516=-0.516
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.065-0.064=0.001
σ0.003-0.002=0.001
min0.062-0.062=-0.000
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.363-0.360=0.003
min1750.840-1750.842=-0.002
max1751.992-1751.972=0.020
mean1661.900-1662.050=-0.150
σ634.764-623.264=11.499
min624.000-661.000=-37.000
max2777.000-2508.000=269.000
mean2.811-2.857=-0.046
σ0.152-0.121=0.031
min2.279-2.465=-0.186
max2.999-3.103=-0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.784-279.072=-12.288
σ0.007-0.011=-0.004
min266.779-279.058=-12.279
max266.795-279.086=-12.291
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean0.369-0.393=-0.024
σ0.008-0.012=-0.004
min0.365-0.384=-0.020
max0.383-0.413=-0.029
iters=5
new-facts=1
prior-facts=6402
mean1927.218-1939.507=-12.289
σ0.011-0.007=0.004
min1927.208-1939.494=-12.287
max1927.237-1939.513=-12.276
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean2.855-3.013=-0.158
σ0.161-0.116=0.045
min2.638-2.879=-0.240
max3.051-3.195=-0.144
iters=5
new-facts=6402
prior-facts=1
mean4747.658-4760.028=-12.370
σ0.513-0.899=-0.385
min4747.356-4759.549=-12.193
max4748.567-4761.631=-13.065
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean8.045-8.355=-0.310
σ0.304-0.649=-0.346
min7.776-7.681=0.095
max8.539-9.271=-0.732
iters=5
new-facts=6402
prior-facts=6402
mean4938.166-4950.465=-12.299
σ0.082-0.074=0.008
min4938.092-4950.403=-12.310
max4938.258-4950.546=-12.288
mean3030.400-2952.800=77.600
σ315.412-407.743=-92.331
min2777.000-2508.000=269.000
max3514.000-3497.000=17.000
mean8.389-8.457=-0.067
σ0.117-0.088=0.029
min8.301-8.374=-0.073
max8.592-8.606=-0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.717=-0.667
σ0.130-0.185=-0.055
min0.927-1.434=-0.507
max1.248-1.923=-0.675

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.122-463.335=1.787
σ575.755-572.197=3.558
min177.235-177.233=0.002
max1328.754-1321.630=7.124
mean79.750
σ7.500
min76.000
max91.000
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean0.442-0.567=-0.126
σ0.302-0.572=-0.270
min0.288-0.280=0.009
max0.895-1.426=-0.531
policies=20
mean1772.628-1772.585=0.043
σ0.319-0.334=-0.015
min1772.394-1772.362=0.031
max1773.095-1773.081=0.014
mean760.000
σ0.000
min760.000
max760.000
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean2.839-2.746=0.093
σ0.087-0.018=0.069
min2.736-2.724=0.013
max2.948-2.760=0.188
policies=200
mean17732.511-17732.462=0.049
σ0.481-0.530=-0.049
min17732.214-17732.114=0.100
max17733.230-17733.251=-0.021
mean7600.000
σ0.000
min7600.000
max7600.000
mean2777.000-2508.000=269.000
σ0.000
min2777.000-2508.000=269.000
max2777.000-2508.000=269.000
mean27.788-27.704=0.084
σ0.122-0.154=-0.033
min27.606-27.600=0.007
max27.866-27.933=-0.067