Compare commits

Home / Compare abb8c9cb .. 1df50bd8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.795=-5.026
σ0.046-0.108=-0.062
min30.733-35.752=-5.020
max30.896-36.101=-5.205
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.076-0.076=0.001
σ0.004-0.003=0.001
min0.070-0.073=-0.003
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-26.065=-5.004
σ0.002-0.004=-0.002
min21.058-26.058=-5.001
max21.064-26.072=-5.008
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.062=0.002
σ0.002-0.002=0.000
min0.062-0.060=0.003
max0.071-0.067=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1751.237=0.183
σ0.363-0.362=0.001
min1750.848-1750.666=0.182
max1752.000-1751.823=0.177
mean1660.550-1652.300=8.250
σ631.808-641.430=-9.621
min681.000-630.000=51.000
max2689.000-2854.000=-165.000
mean2.860-2.816=0.044
σ0.109-0.201=-0.092
min2.646-2.167=0.480
max3.022-3.050=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.755-275.570=0.185
σ0.011-0.009=0.002
min275.741-275.556=0.184
max275.767-275.582=0.185
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean0.405-0.403=0.002
σ0.009-0.010=-0.002
min0.398-0.391=0.007
max0.418-0.414=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.286-2168.090=0.196
σ0.006-0.018=-0.012
min2168.277-2168.058=0.219
max2168.291-2168.099=0.192
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean2.975-2.943=0.031
σ0.217-0.123=0.094
min2.682-2.761=-0.079
max3.258-3.067=0.191
iters=5
new-facts=6402
prior-facts=1
mean5048.149-5047.803=0.346
σ0.916-0.991=-0.076
min5047.544-5046.909=0.634
max5049.774-5049.507=0.267
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean8.761-8.859=-0.098
σ0.539-0.543=-0.005
min8.061-8.041=0.020
max9.301-9.358=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean5179.229-5179.044=0.186
σ0.076-0.087=-0.011
min5179.143-5178.970=0.173
max5179.310-5179.147=0.163
mean3227.400-3253.400=-26.000
σ389.684-336.560=53.123
min2702.000-2854.000=-152.000
max3736.000-3724.000=12.000
mean9.771-9.989=-0.218
σ0.657-0.048=0.609
min8.728-9.954=-1.226
max10.438-10.074=0.364

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.032=0.094
σ0.196-0.136=0.059
min0.948-0.939=0.008
max1.398-1.256=0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.206=0.372
σ572.675-572.650=0.025
min177.237-176.867=0.370
max1322.591-1322.181=0.410
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean0.546-0.435=0.111
σ0.540-0.305=0.235
min0.274-0.280=-0.006
max1.357-0.893=0.464
policies=20
mean1772.631-1768.980=3.651
σ0.341-0.332=0.010
min1772.389-1768.756=3.633
max1773.136-1769.470=3.666
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean2.747-2.825=-0.078
σ0.012-0.009=0.003
min2.736-2.815=-0.079
max2.763-2.834=-0.071
policies=200
mean17733.064-17696.230=36.833
σ0.458-0.503=-0.045
min17732.751-17695.961=36.790
max17733.742-17696.985=36.757
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2689.000-2854.000=-165.000
σ0.000
min2689.000-2854.000=-165.000
max2689.000-2854.000=-165.000
mean27.774-28.209=-0.435
σ0.186-0.531=-0.345
min27.603-27.696=-0.093
max28.038-28.679=-0.641