Compare commits

Home / Compare 5e90aaf7 .. e408f733

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.568=-0.006
σ0.046-0.046=0.001
min70.535-70.537=-0.002
max70.692-70.693=-0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.158-0.163=-0.006
σ0.005-0.009=-0.004
min0.149-0.150=-0.001
max0.165-0.180=-0.014
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.001
σ0.002-0.003=-0.001
min21.284-21.282=0.001
max21.291-21.292=-0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.360-0.361=-0.001
min1752.813-1752.804=0.008
max1753.959-1753.962=-0.004
mean1654.650-1657.700=-3.050
σ642.665-642.274=0.391
min629.000-621.000=8.000
max2886.000-2764.000=122.000
mean2.834-2.812=0.022
σ0.232-0.172=0.060
min2.316-2.266=0.050
max3.541-3.127=0.413

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.758-271.755=0.003
σ0.005-0.007=-0.002
min271.753-271.748=0.005
max271.765-271.765=-0.000
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean0.381-0.382=-0.002
σ0.004-0.006=-0.002
min0.377-0.376=0.000
max0.386-0.391=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.183=-0.009
σ0.007-0.010=-0.003
min1932.168-1932.173=-0.005
max1932.184-1932.198=-0.014
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean3.094-2.913=0.181
σ0.097-0.177=-0.080
min3.008-2.604=0.404
max3.252-3.052=0.199
iters=5
new-facts=6402
prior-facts=1
mean4752.965-4752.771=0.194
σ0.881-0.602=0.279
min4752.385-4752.444=-0.059
max4754.527-4753.845=0.683
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean8.243-8.588=-0.345
σ0.501-0.305=0.196
min7.755-8.178=-0.423
max9.031-8.919=0.111
iters=5
new-facts=6402
prior-facts=6402
mean4943.307-4943.377=-0.070
σ0.166-0.018=0.148
min4943.012-4943.350=-0.337
max4943.402-4943.399=0.003
mean3069.000-3041.800=27.200
σ265.868-233.898=31.971
min2886.000-2764.000=122.000
max3484.000-3324.000=160.000
mean8.479-8.710=-0.231
σ0.217-0.373=-0.156
min8.235-8.425=-0.190
max8.790-9.332=-0.542

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-1.052=0.066
σ0.267-0.124=0.143
min0.936-0.939=-0.004
max1.529-1.241=0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.858=0.003
σ575.930-575.934=-0.004
min179.886-179.883=0.003
max1331.756-1331.759=-0.003
mean86.250
σ8.500
min82.000
max99.000
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean0.445-0.478=-0.034
σ0.302-0.386=-0.084
min0.291-0.279=0.012
max0.898-1.058=-0.160
policies=20
mean1799.164-1799.170=-0.007
σ0.382-0.341=0.041
min1798.900-1798.912=-0.012
max1799.726-1799.672=0.053
mean820.000
σ0.000
min820.000
max820.000
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean2.880-2.798=0.082
σ0.014-0.017=-0.003
min2.871-2.783=0.088
max2.900-2.813=0.087
policies=200
mean17998.455-17998.413=0.041
σ0.365-0.464=-0.099
min17998.154-17998.001=0.153
max17998.987-17999.080=-0.093
mean8200.000
σ0.000
min8200.000
max8200.000
mean2886.000-2764.000=122.000
σ0.000
min2886.000-2764.000=122.000
max2886.000-2764.000=122.000
mean28.481-28.124=0.357
σ0.467-0.108=0.359
min28.070-28.025=0.045
max28.911-28.277=0.633