Compare commits

Home / Compare 25a78d17 .. 3f3461e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.050-0.049=0.001
min31.004-31.002=0.003
max31.180-31.176=0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.077-0.073=0.004
σ0.005-0.004=0.001
min0.072-0.070=0.001
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.001
σ0.002-0.003=-0.001
min21.139-21.141=-0.002
max21.146-21.148=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.066=-0.004
σ0.003-0.003=0.000
min0.059-0.063=-0.005
max0.068-0.072=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.412=0.000
σ0.363-0.360=0.003
min1750.839-1750.853=-0.014
max1751.994-1751.976=0.018
mean1638.450-1660.600=-22.150
σ616.278-621.270=-4.992
min632.000-639.000=-7.000
max2475.000-2505.000=-30.000
mean2.799-2.831=-0.032
σ0.128-0.191=-0.064
min2.563-2.293=0.269
max3.046-3.210=-0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.760-273.397=-6.636
σ0.008-0.018=-0.010
min266.751-273.367=-6.616
max266.771-273.412=-6.641
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean0.370-0.384=-0.015
σ0.011-0.009=0.002
min0.363-0.377=-0.013
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1927.208-1933.834=-6.626
σ0.007-0.004=0.003
min1927.199-1933.831=-6.632
max1927.217-1933.841=-6.624
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean2.995-3.030=-0.034
σ0.089-0.109=-0.020
min2.877-2.876=0.001
max3.128-3.165=-0.037
iters=5
new-facts=6402
prior-facts=1
mean4747.627-4754.292=-6.665
σ0.850-0.879=-0.029
min4746.849-4753.614=-6.765
max4749.073-4755.835=-6.762
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean8.193-8.069=0.125
σ0.421-0.382=0.040
min7.687-7.740=-0.053
max8.685-8.707=-0.022
iters=5
new-facts=6402
prior-facts=6402
mean4938.167-4944.727=-6.560
σ0.082-0.199=-0.117
min4938.095-4944.391=-6.297
max4938.265-4944.876=-6.611
mean2950.400-2962.200=-11.800
σ413.733-412.198=1.535
min2475.000-2505.000=-30.000
max3504.000-3523.000=-19.000
mean8.438-8.625=-0.186
σ0.236-0.461=-0.225
min8.262-8.393=-0.131
max8.854-9.449=-0.594

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.719-1.732=-0.013
σ0.166-0.066=0.099
min1.463-1.639=-0.176
max1.870-1.801=0.069

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.111-463.333=1.778
σ575.755-572.193=3.562
min177.230-177.235=-0.004
max1328.743-1321.623=7.120
mean79.750
σ7.500
min76.000
max91.000
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean0.550-0.540=0.011
σ0.543-0.519=0.023
min0.276-0.272=0.005
max1.364-1.319=0.045
policies=20
mean1772.548-1772.587=-0.038
σ0.338-0.337=0.001
min1772.321-1772.366=-0.046
max1773.049-1773.087=-0.038
mean760.000
σ0.000
min760.000
max760.000
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean2.750-2.741=0.009
σ0.046-0.001=0.044
min2.707-2.739=-0.032
max2.803-2.742=0.060
policies=200
mean17732.412-17732.364=0.049
σ0.528-0.596=-0.068
min17732.043-17731.993=0.049
max17733.182-17733.247=-0.065
mean7600.000
σ0.000
min7600.000
max7600.000
mean2475.000-2505.000=-30.000
σ0.000
min2475.000-2505.000=-30.000
max2475.000-2505.000=-30.000
mean27.643-27.666=-0.023
σ0.129-0.154=-0.024
min27.558-27.521=0.037
max27.834-27.878=-0.044