Compare commits

Home / Compare b9d0f0d3 .. 927d0dce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.049-0.048=0.001
min33.946-33.950=-0.003
max34.113-34.111=0.002
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.085-0.084=0.001
σ0.003-0.003=0.001
min0.083-0.082=0.001
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.004-0.003=0.000
min23.314-23.315=-0.001
max23.325-23.324=0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.064-0.063=0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.430=0.063
σ0.363-0.364=-0.000
min1756.922-1756.855=0.066
max1758.083-1758.018=0.064
mean1674.750-1650.650=24.100
σ636.122-637.866=-1.744
min663.000-654.000=9.000
max2643.000-2849.000=-206.000
mean2.369-2.383=-0.014
σ0.105-0.102=0.003
min2.256-2.273=-0.016
max2.706-2.684=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.576=0.056
σ0.056-0.051=0.004
min326.533-326.485=0.047
max326.666-326.607=0.059
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean0.429-0.435=-0.007
σ0.006-0.013=-0.007
min0.424-0.423=0.001
max0.435-0.449=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.806-1988.740=0.066
σ0.009-0.007=0.003
min1988.796-1988.734=0.062
max1988.816-1988.750=0.067
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean2.722-2.701=0.020
σ0.138-0.052=0.087
min2.570-2.657=-0.087
max2.921-2.789=0.132
iters=5
new-facts=6402
prior-facts=1
mean4813.459-4813.545=-0.086
σ7.561-7.484=0.077
min4809.668-4810.026=-0.358
max4826.977-4826.928=0.049
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean8.522-8.547=-0.024
σ0.606-0.865=-0.258
min7.983-7.815=0.168
max9.516-9.561=-0.045
iters=5
new-facts=6402
prior-facts=6402
mean5001.200-5001.139=0.061
σ0.032-0.022=0.010
min5001.152-5001.113=0.039
max5001.228-5001.167=0.061
mean2992.000-3061.000=-69.000
σ389.460-285.668=103.792
min2643.000-2849.000=-206.000
max3549.000-3505.000=44.000
mean9.522-9.697=-0.175
σ0.614-0.099=0.515
min8.441-9.558=-1.118
max9.979-9.799=0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-0.981=0.211
σ0.349-0.073=0.276
min0.933-0.919=0.014
max1.801-1.062=0.739

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.628-464.574=0.054
σ574.778-574.771=0.007
min177.232-177.179=0.053
max1326.796-1326.730=0.065
mean88.250
σ8.500
min84.000
max101.000
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean0.552-0.432=0.121
σ0.551-0.311=0.240
min0.275-0.259=0.016
max1.379-0.898=0.482
policies=20
mean1772.660-1772.074=0.585
σ0.355-0.362=-0.007
min1772.425-1771.834=0.590
max1773.187-1772.611=0.576
mean840.000
σ0.000
min840.000
max840.000
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean2.730-2.790=-0.061
σ0.008-0.011=-0.003
min2.723-2.776=-0.053
max2.741-2.801=-0.060
policies=200
mean17734.011-17727.557=6.454
σ0.507-0.336=0.171
min17733.648-17727.362=6.286
max17734.761-17728.059=6.701
mean8400.000
σ0.000
min8400.000
max8400.000
mean2643.000-2849.000=-206.000
σ0.000
min2643.000-2849.000=-206.000
max2643.000-2849.000=-206.000
mean27.582-27.780=-0.199
σ0.152-0.393=-0.241
min27.435-27.286=0.149
max27.717-28.127=-0.410