Compare commits

Home / Compare 7bd17dd0 .. 12efd224

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.957=0.002
σ0.049-0.049=-0.000
min30.917-30.918=-0.000
max31.095-31.094=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.079-0.076=0.002
σ0.003-0.004=-0.001
min0.076-0.071=0.005
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.003-0.003=0.000
min21.054-21.055=-0.001
max21.064-21.064=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.060=0.001
σ0.002-0.003=-0.000
min0.058-0.057=0.000
max0.065-0.065=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.000
σ0.362-0.363=-0.001
min1750.840-1750.838=0.002
max1752.007-1751.994=0.012
mean1661.950-1655.000=6.950
σ622.704-649.188=-26.484
min643.000-646.000=-3.000
max2508.000-2861.000=-353.000
mean2.809-2.807=0.002
σ0.162-0.186=-0.024
min2.352-2.536=-0.184
max3.050-3.175=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.764-275.762=0.002
σ0.013-0.004=0.009
min275.748-275.756=-0.009
max275.781-275.767=0.014
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean0.403-0.406=-0.003
σ0.008-0.010=-0.002
min0.397-0.398=-0.001
max0.416-0.418=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.291-2168.280=0.011
σ0.017-0.019=-0.002
min2168.269-2168.251=0.018
max2168.310-2168.300=0.010
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean2.874-2.803=0.071
σ0.115-0.107=0.008
min2.774-2.674=0.100
max3.003-2.942=0.061
iters=5
new-facts=6402
prior-facts=1
mean4889.187-5048.004=-158.817
σ355.850-1.004=354.846
min4252.625-5047.265=-794.639
max5049.760-5049.766=-0.006
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean8.546-8.727=-0.181
σ0.712-0.504=0.208
min7.498-8.041=-0.544
max9.262-9.271=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean5179.168-5179.253=-0.085
σ0.204-0.087=0.117
min5178.819-5179.171=-0.352
max5179.317-5179.350=-0.033
mean3080.600-3318.800=-238.200
σ461.709-446.028=15.681
min2515.000-2861.000=-346.000
max3711.000-3953.000=-242.000
mean9.794-10.071=-0.276
σ0.181-0.103=0.078
min9.584-9.970=-0.385
max10.068-10.220=-0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.616-1.052=0.565
σ0.155-0.123=0.032
min1.422-0.937=0.485
max1.804-1.238=0.566

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.342=-0.009
σ572.197-572.196=0.002
min177.231-177.238=-0.008
max1321.629-1321.635=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean0.555-0.440=0.115
σ0.550-0.304=0.246
min0.275-0.282=-0.007
max1.381-0.896=0.485
policies=20
mean1772.579-1772.638=-0.059
σ0.342-0.334=0.009
min1772.337-1772.398=-0.061
max1773.085-1773.126=-0.041
mean760.000
σ0.000
min760.000
max760.000
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean2.753-2.850=-0.097
σ0.006-0.009=-0.002
min2.748-2.842=-0.094
max2.761-2.859=-0.098
policies=200
mean17732.383-17732.449=-0.067
σ0.428-0.537=-0.108
min17732.103-17732.160=-0.057
max17733.014-17733.254=-0.240
mean7600.000
σ0.000
min7600.000
max7600.000
mean2508.000-2861.000=-353.000
σ0.000
min2508.000-2861.000=-353.000
max2508.000-2861.000=-353.000
mean27.834-28.385=-0.551
σ0.134-0.450=-0.316
min27.697-27.997=-0.301
max28.016-28.869=-0.852