Compare commits

Home / Compare 0b8ca2d3 .. f9507d31

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.562=0.005
σ0.044-0.046=-0.002
min70.542-70.540=0.002
max70.688-70.693=-0.005
mean413.900-414.000=-0.100
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.000
min0.157-0.152=0.005
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.001
σ0.003-0.002=0.001
min21.283-21.284=-0.001
max21.290-21.289=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.060=0.004
σ0.003-0.003=0.000
min0.063-0.058=0.004
max0.073-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.373=0.002
σ0.362-0.360=0.003
min1752.805-1752.805=-0.001
max1753.968-1753.937=0.031
mean1661.900-1661.000=0.900
σ637.344-634.467=2.877
min618.000
max2804.000-2778.000=26.000
mean2.769-2.729=0.040
σ0.185-0.217=-0.032
min2.392-2.086=0.306
max3.058-2.993=0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.752-271.752=0.000
σ0.007-0.006=0.001
min271.746-271.743=0.002
max271.765-271.759=0.006
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean0.382-0.383=-0.001
σ0.006-0.005=0.001
min0.377-0.380=-0.003
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.164-1932.189=-0.026
σ0.021-0.011=0.010
min1932.136-1932.178=-0.042
max1932.190-1932.203=-0.012
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean2.817-2.882=-0.066
σ0.295-0.285=0.009
min2.453-2.505=-0.052
max3.120-3.187=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4752.882-4752.902=-0.020
σ0.916-0.882=0.033
min4752.426-4752.400=0.026
max4754.517-4754.468=0.049
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean8.755-8.704=0.051
σ0.171-0.475=-0.305
min8.541-7.896=0.645
max8.925-9.094=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean4943.298-4943.369=-0.071
σ0.170-0.016=0.154
min4942.994-4943.352=-0.358
max4943.381-4943.387=-0.006
mean3012.400-3022.000=-9.600
σ276.545-229.290=47.255
min2804.000-2778.000=26.000
max3447.000-3330.000=117.000
mean8.613-8.730=-0.116
σ0.354-0.187=0.167
min8.413-8.552=-0.139
max9.244-9.033=0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.123=0.076
σ0.299-0.259=0.039
min0.945-0.943=0.002
max1.545-1.573=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.861=0.002
σ575.934-575.925=0.009
min179.887-179.888=-0.002
max1331.763-1331.747=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean0.481-0.484=-0.003
σ0.397-0.288=0.108
min0.279-0.286=-0.006
max1.076-0.898=0.178
policies=20
mean1799.181-1799.166=0.015
σ0.372-0.337=0.034
min1798.892-1798.918=-0.026
max1799.726-1799.664=0.062
mean820.000
σ0.000
min820.000
max820.000
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean2.877-2.815=0.062
σ0.070-0.040=0.030
min2.808-2.773=0.035
max2.962-2.869=0.093
policies=200
mean17998.509-17998.407=0.102
σ0.466-0.594=-0.128
min17998.235-17997.996=0.240
max17999.203-17999.286=-0.083
mean8200.000
σ0.000
min8200.000
max8200.000
mean2804.000-2778.000=26.000
σ0.000
min2804.000-2778.000=26.000
max2804.000-2778.000=26.000
mean28.253-28.290=-0.037
σ0.180-0.093=0.087
min28.104-28.201=-0.098
max28.515-28.421=0.094