Compare commits

Home / Compare 414a6626 .. f2e2b7c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.045-0.046=-0.001
min70.538-70.540=-0.001
max70.689-70.691=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.158-0.161=-0.004
σ0.003-0.003=0.000
min0.152-0.159=-0.007
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.292-21.287=0.005
σ0.011-0.003=0.008
min21.285-21.283=0.002
max21.323-21.291=0.032
mean413.000-413.800=-0.800
σ0.000-0.422=-0.422
min413.000
max413.000-414.000=-1.000
mean0.064-0.064=-0.000
σ0.002-0.001=0.001
min0.062-0.063=-0.001
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=-0.000
σ0.363-0.360=0.003
min1752.803-1752.805=-0.001
max1753.958-1753.977=-0.019
mean1652.550-1659.750=-7.200
σ644.542-638.154=6.388
min651.000-617.000=34.000
max2884.000-2813.000=71.000
mean2.798-2.791=0.006
σ0.200-0.132=0.068
min2.275-2.457=-0.182
max3.087-3.039=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.760-271.754=0.006
σ0.006-0.006=0.001
min271.752-271.746=0.005
max271.769-271.760=0.010
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean0.389-0.382=0.007
σ0.011-0.005=0.005
min0.376-0.378=-0.002
max0.400-0.392=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.182-1932.175=0.007
σ0.021-0.005=0.016
min1932.163-1932.171=-0.008
max1932.217-1932.183=0.034
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean2.812-3.024=-0.212
σ0.234-0.071=0.163
min2.524-2.972=-0.448
max3.001-3.149=-0.148
iters=5
new-facts=6402
prior-facts=1
mean4752.913-4752.769=0.144
σ0.864-1.030=-0.167
min4752.399-4751.874=0.525
max4754.452-4754.549=-0.097
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean8.612-8.726=-0.113
σ0.287-0.382=-0.096
min8.340-8.282=0.058
max9.064-9.051=0.014
iters=5
new-facts=6402
prior-facts=6402
mean4943.308-4943.379=-0.071
σ0.156-0.019=0.137
min4943.030-4943.358=-0.328
max4943.396-4943.401=-0.005
mean3057.400-3005.800=51.600
σ177.737-208.541=-30.804
min2884.000-2813.000=71.000
max3305.000-3317.000=-12.000
mean8.646-8.537=0.109
σ0.253-0.065=0.187
min8.403-8.473=-0.070
max9.050-8.637=0.413

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.102-1.095=0.007
σ0.184-0.218=-0.034
min0.926-0.935=-0.009
max1.328-1.378=-0.050

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.859=0.003
σ575.933-575.934=-0.000
min179.889-179.886=0.003
max1331.762-1331.760=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean0.446-0.478=-0.033
σ0.306-0.400=-0.094
min0.290-0.269=0.021
max0.904-1.078=-0.173
policies=20
mean1799.187-1799.144=0.042
σ0.376-0.331=0.045
min1798.926-1798.906=0.020
max1799.742-1799.635=0.108
mean820.000
σ0.000
min820.000
max820.000
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean2.878-2.803=0.075
σ0.006-0.011=-0.005
min2.872-2.788=0.084
max2.885-2.813=0.072
policies=200
mean17998.518-17998.287=0.232
σ0.458-0.451=0.008
min17998.239-17997.991=0.248
max17999.202-17998.959=0.244
mean8200.000
σ0.000
min8200.000
max8200.000
mean2884.000-2813.000=71.000
σ0.000
min2884.000-2813.000=71.000
max2884.000-2813.000=71.000
mean28.548-28.287=0.261
σ0.515-0.143=0.372
min28.095-28.138=-0.042
max29.065-28.481=0.584