Compare commits

Home / Compare a51f117b .. a2717ca0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.003
σ0.044-0.045=-0.001
min70.538-70.536=0.002
max70.685-70.688=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.158-0.160=-0.001
σ0.003-0.004=-0.000
min0.155-0.157=-0.002
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.290=-0.003
σ0.003-0.012=-0.009
min21.284-21.283=0.001
max21.293-21.323=-0.030
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.062=0.002
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.069-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.000
σ0.362-0.363=-0.001
min1752.800-1752.799=0.001
max1753.960-1753.955=0.005
mean1640.100-1666.700=-26.600
σ597.131-634.091=-36.959
min634.000-679.000=-45.000
max2436.000-2701.000=-265.000
mean2.777-2.781=-0.004
σ0.215-0.163=0.052
min2.207-2.349=-0.142
max2.985-2.966=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.755-271.753=0.002
σ0.006-0.007=-0.001
min271.750-271.746=0.004
max271.765-271.764=0.001
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean0.383-0.381=0.002
σ0.007-0.005=0.001
min0.376-0.378=-0.001
max0.393-0.391=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.181-1932.170=0.012
σ0.007-0.017=-0.010
min1932.173-1932.143=0.030
max1932.192-1932.187=0.005
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean3.076-3.022=0.054
σ0.186-0.069=0.117
min2.885-2.958=-0.073
max3.341-3.104=0.237
iters=5
new-facts=6402
prior-facts=1
mean4752.911-4752.924=-0.013
σ0.852-0.841=0.011
min4752.449-4752.459=-0.010
max4754.426-4754.423=0.004
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean8.387-8.349=0.038
σ0.498-0.453=0.045
min7.605-7.605=0.000
max8.806-8.802=0.004
iters=5
new-facts=6402
prior-facts=6402
mean4943.378-4943.308=0.070
σ0.012-0.167=-0.155
min4943.361-4943.010=0.351
max4943.391-4943.400=-0.009
mean3018.600-2980.200=38.400
σ302.662-231.869=70.793
min2607.000-2701.000=-94.000
max3404.000-3303.000=101.000
mean8.564-8.482=0.082
σ0.070-0.078=-0.008
min8.493-8.398=0.095
max8.667-8.569=0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.715-1.224=0.491
σ0.159-0.420=-0.261
min1.439-0.932=0.507
max1.848-1.942=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.854-467.860=-0.006
σ575.924-575.936=-0.012
min179.887-179.889=-0.001
max1331.740-1331.764=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean0.552-0.576=-0.024
σ0.538-0.590=-0.052
min0.280-0.279=0.002
max1.360-1.461=-0.101
policies=20
mean1799.148-1799.151=-0.003
σ0.379-0.375=0.004
min1798.910-1798.909=0.000
max1799.713-1799.710=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean2.780-2.791=-0.011
σ0.012-0.014=-0.002
min2.764-2.771=-0.007
max2.793-2.804=-0.012
policies=200
mean17998.552-17998.515=0.037
σ0.480-0.464=0.016
min17998.267-17998.255=0.012
max17999.270-17999.210=0.060
mean8200.000
σ0.000
min8200.000
max8200.000
mean2436.000-2701.000=-265.000
σ0.000
min2436.000-2701.000=-265.000
max2436.000-2701.000=-265.000
mean28.115-28.216=-0.101
σ0.074-0.121=-0.047
min28.024-28.119=-0.095
max28.200-28.372=-0.172