Compare commits

Home / Compare db18b0e7 .. 09680fd2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.781=2.265
σ0.044-0.047=-0.004
min73.023-70.750=2.272
max73.169-70.913=2.256
mean416.000
σ0.000
min416.000
max416.000
mean0.161-0.160=0.000
σ0.004-0.004=0.000
min0.156-0.152=0.004
max0.167-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean23.738-21.492=2.246
σ0.003-0.002=0.001
min23.735-21.487=2.248
max23.744-21.495=2.249
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.065=-0.001
σ0.005-0.003=0.002
min0.060-0.059=0.000
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1754.091=4.696
σ0.360-0.357=0.003
min1758.225-1753.528=4.697
max1759.371-1754.670=4.701
mean1660.750-1659.150=1.600
σ628.782-627.037=1.745
min621.000-630.000=-9.000
max2854.000-2777.000=77.000
mean2.861-2.828=0.034
σ0.146-0.120=0.026
min2.466-2.479=-0.012
max3.190-3.065=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.015-271.953=52.062
σ0.051-0.008=0.044
min323.925-271.944=51.981
max324.050-271.965=52.086
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean0.431-0.384=0.047
σ0.006-0.008=-0.002
min0.425-0.377=0.048
max0.440-0.397=0.043
iters=5
new-facts=1
prior-facts=6402
mean1984.594-1932.319=52.275
σ0.012-0.013=-0.001
min1984.574-1932.299=52.275
max1984.603-1932.332=52.271
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean2.611-2.966=-0.355
σ0.077-0.071=0.006
min2.557-2.872=-0.314
max2.745-3.029=-0.284
iters=5
new-facts=6402
prior-facts=1
mean4808.243-4753.031=55.212
σ7.777-0.941=6.836
min4804.716-4752.574=52.142
max4822.154-4754.712=67.442
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean8.893-8.707=0.186
σ0.256-0.450=-0.194
min8.533-7.960=0.573
max9.117-9.038=0.079
iters=5
new-facts=6402
prior-facts=6402
mean4995.814-4943.556=52.258
σ0.020-0.017=0.003
min4995.794-4943.530=52.264
max4995.835-4943.571=52.264
mean3078.600-3002.800=75.800
σ309.364-218.613=90.750
min2854.000-2777.000=77.000
max3561.000-3326.000=235.000
mean8.610-8.470=0.140
σ0.158-0.139=0.019
min8.397-8.292=0.105
max8.741-8.634=0.107

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-0.965=0.021
σ0.141-0.078=0.063
min0.920-0.927=-0.007
max1.238-1.104=0.134

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.347-468.626=-0.279
σ574.231-574.923=-0.692
min181.224-181.150=0.074
max1329.694-1331.011=-1.317
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean0.442-0.447=-0.005
σ0.307-0.303=0.004
min0.287-0.287=-0.001
max0.902-0.901=0.001
policies=20
mean1812.603-1811.858=0.745
σ0.398-0.376=0.022
min1812.328-1811.589=0.739
max1813.189-1812.402=0.787
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean2.879-2.884=-0.005
σ0.009-0.089=-0.079
min2.867-2.834=0.034
max2.887-3.017=-0.130
policies=200
mean18132.317-18126.064=6.253
σ0.730-0.883=-0.153
min18131.371-18125.170=6.201
max18132.974-18127.278=5.696
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2777.000=77.000
σ0.000
min2854.000-2777.000=77.000
max2854.000-2777.000=77.000
mean28.682-28.559=0.123
σ0.362-0.110=0.253
min28.324-28.467=-0.143
max29.008-28.715=0.293