Compare commits

Home / Compare 2e355742 .. db464776

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.957=-0.001
σ0.102-0.102=-0.000
min35.913-35.915=-0.001
max36.246-36.247=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.076-0.078=-0.002
σ0.004-0.004=-0.000
min0.073-0.075=-0.001
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.204-26.204=0.000
σ0.005-0.004=0.001
min26.198-26.197=0.001
max26.212-26.209=0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.061-0.063=-0.002
σ0.003-0.004=-0.001
min0.059-0.060=-0.001
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1718.266=38.037
σ0.368-170.184=-169.816
min1755.730-995.238=760.493
max1756.899-1756.883=0.015
mean1656.900-1616.500=40.400
σ626.850-618.963=7.887
min611.000-618.000=-7.000
max2641.000-2673.000=-32.000
mean2.387-2.349=0.038
σ0.183-0.278=-0.095
min2.259-1.361=0.898
max3.111-2.873=0.238

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.826-278.818=0.008
σ0.005-0.019=-0.014
min278.820-278.785=0.035
max278.830-278.831=-0.001
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean0.411-0.412=-0.001
σ0.004-0.002=0.002
min0.407-0.410=-0.002
max0.418-0.415=0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.885-2268.886=-0.001
σ0.021-0.015=0.007
min2268.849-2268.875=-0.026
max2268.901-2268.911=-0.010
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean2.904-3.146=-0.242
σ0.078-0.165=-0.088
min2.847-2.918=-0.071
max3.041-3.365=-0.324
iters=5
new-facts=6402
prior-facts=1
mean4954.274-4954.269=0.005
σ0.885-0.951=-0.066
min4953.779-4953.694=0.084
max4955.849-4955.952=-0.103
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean7.946-8.117=-0.171
σ0.275-0.347=-0.071
min7.632-7.837=-0.205
max8.279-8.608=-0.330
iters=5
new-facts=6402
prior-facts=6402
mean5168.827-5168.822=0.005
σ0.095-0.090=0.005
min5168.720-5168.719=0.001
max5168.901-5168.897=0.004
mean3399.400-3447.400=-48.000
σ463.511-477.946=-14.436
min2814.000-2890.000=-76.000
max4023.000-4139.000=-116.000
mean9.402-9.221=0.181
σ0.237-0.240=-0.003
min9.146-9.015=0.131
max9.708-9.597=0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-0.947=0.107
σ0.100-0.010=0.090
min0.940-0.940=0.000
max1.190-0.964=0.227

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.355-460.350=0.005
σ572.652-572.651=0.001
min174.020-174.015=0.005
max1319.333-1319.326=0.007
mean79.500
σ7.000
min76.000
max90.000
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean0.547-0.529=0.018
σ0.551-0.519=0.033
min0.267-0.267=-0.000
max1.375-1.307=0.068
policies=20
mean1740.427-1740.423=0.004
σ0.307-0.322=-0.015
min1740.228-1740.227=0.001
max1740.884-1740.904=-0.020
mean760.000
σ0.000
min760.000
max760.000
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean2.674-2.691=-0.017
σ0.015-0.010=0.005
min2.653-2.680=-0.028
max2.685-2.700=-0.016
policies=200
mean17411.123-17411.315=-0.192
σ0.482-0.524=-0.042
min17410.728-17411.028=-0.300
max17411.821-17412.100=-0.279
mean7600.000
σ0.000
min7600.000
max7600.000
mean2641.000-2673.000=-32.000
σ0.000
min2641.000-2673.000=-32.000
max2641.000-2673.000=-32.000
mean26.938-27.017=-0.080
σ0.053-0.064=-0.012
min26.898-26.928=-0.030
max27.013-27.075=-0.062