Compare commits

Home / Compare 9328fd12 .. be3044c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.983-33.985=-0.002
σ0.051-0.050=0.001
min33.944-33.956=-0.012
max34.123-34.124=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.082-0.083=-0.001
σ0.004-0.005=-0.001
min0.077-0.077=0.000
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.323-23.323=0.000
σ0.004-0.003=0.001
min23.320-23.320=0.000
max23.333-23.328=0.005
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.064=0.000
σ0.005-0.003=0.001
min0.060-0.059=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.297-1757.298=-0.001
σ0.362-0.363=-0.001
min1756.725-1756.727=-0.002
max1757.883-1757.882=0.001
mean1649.750-1641.600=8.150
σ629.976-626.941=3.035
min651.000-620.000=31.000
max2823.000-2698.000=125.000
mean2.358-2.375=-0.017
σ0.102-0.104=-0.001
min2.274-2.243=0.031
max2.628-2.633=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.440-326.414=0.025
σ0.060-0.043=0.017
min326.334-326.338=-0.004
max326.476-326.439=0.037
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean0.427-0.427=0.001
σ0.005-0.001=0.005
min0.422-0.425=-0.003
max0.435-0.428=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.614-1988.613=0.001
σ0.008-0.003=0.006
min1988.602-1988.609=-0.007
max1988.624-1988.616=0.008
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean2.706-2.732=-0.026
σ0.133-0.154=-0.021
min2.597-2.619=-0.022
max2.923-3.001=-0.078
iters=5
new-facts=6402
prior-facts=1
mean4812.292-4812.283=0.009
σ7.842-7.792=0.050
min4808.308-4808.269=0.039
max4826.310-4826.210=0.100
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean8.897-8.437=0.460
σ0.601-0.561=0.040
min8.113-7.831=0.283
max9.760-9.242=0.518
iters=5
new-facts=6402
prior-facts=6402
mean4999.936-4999.858=0.078
σ0.025-0.146=-0.121
min4999.912-4999.600=0.312
max4999.973-4999.960=0.014
mean3045.600-3010.400=35.200
σ194.185-369.650=-175.465
min2823.000-2698.000=125.000
max3320.000-3556.000=-236.000
mean9.869-9.712=0.157
σ0.096-0.146=-0.050
min9.777-9.455=0.322
max10.006-9.819=0.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.005=-0.030
σ0.069-0.122=-0.053
min0.913-0.916=-0.003
max1.057-1.200=-0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.432-464.422=0.010
σ574.772-574.773=-0.002
min177.033-177.032=0.000
max1326.590-1326.582=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean0.439-0.559=-0.120
σ0.306-0.562=-0.256
min0.284-0.273=0.011
max0.897-1.402=-0.505
policies=20
mean1770.694-1770.639=0.055
σ0.361-0.354=0.007
min1770.443-1770.416=0.027
max1771.226-1771.167=0.059
mean840.000
σ0.000
min840.000
max840.000
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean2.809-2.756=0.053
σ0.011-0.026=-0.016
min2.799-2.730=0.069
max2.820-2.792=0.028
policies=200
mean17713.852-17713.793=0.059
σ0.356-0.498=-0.142
min17713.575-17713.389=0.186
max17714.373-17714.518=-0.145
mean8400.000
σ0.000
min8400.000
max8400.000
mean2823.000-2698.000=125.000
σ0.000
min2823.000-2698.000=125.000
max2823.000-2698.000=125.000
mean28.101-27.641=0.460
σ0.397-0.084=0.314
min27.669-27.544=0.125
max28.535-27.739=0.796