Compare commits

Home / Compare 13f27fd7 .. 3c8e9b85

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.043-0.045=-0.002
min70.542-70.535=0.007
max70.685-70.691=-0.006
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.157-0.161=-0.004
σ0.005-0.005=0.000
min0.150-0.156=-0.006
max0.165-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.000
σ0.003-0.003=0.000
min21.282-21.283=-0.001
max21.292-21.290=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.058-0.058=0.000
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=0.001
σ0.362-0.362=-0.001
min1752.802-1752.806=-0.004
max1753.971-1753.976=-0.005
mean1647.350-1659.950=-12.600
σ640.810-637.803=3.008
min634.000-616.000=18.000
max2874.000-2811.000=63.000
mean2.768-2.802=-0.034
σ0.224-0.205=0.019
min2.268-2.287=-0.019
max3.023-3.128=-0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.733-271.752=-0.019
σ0.006-0.007=-0.001
min271.725-271.744=-0.019
max271.740-271.758=-0.018
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean0.380-0.382=-0.002
σ0.008-0.004=0.003
min0.368-0.379=-0.011
max0.388-0.390=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.180=-0.004
σ0.013-0.017=-0.004
min1932.162-1932.156=0.006
max1932.196-1932.201=-0.005
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean2.975-2.939=0.036
σ0.143-0.049=0.094
min2.739-2.852=-0.113
max3.125-2.974=0.151
iters=5
new-facts=6402
prior-facts=1
mean4752.807-4752.797=0.009
σ0.961-1.014=-0.054
min4752.012-4751.992=0.020
max4754.471-4754.567=-0.096
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean8.343-8.672=-0.329
σ0.501-0.297=0.204
min7.809-8.374=-0.565
max9.028-9.094=-0.066
iters=5
new-facts=6402
prior-facts=6402
mean4943.375-4943.372=0.004
σ0.020-0.019=0.001
min4943.354-4943.347=0.007
max4943.397-4943.388=0.009
mean3058.800-3019.800=39.000
σ242.936-266.401=-23.466
min2874.000-2811.000=63.000
max3423.000-3428.000=-5.000
mean8.456-8.427=0.030
σ0.098-0.030=0.068
min8.394-8.404=-0.010
max8.625-8.474=0.151

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.021=0.029
σ0.145-0.134=0.012
min0.924-0.928=-0.004
max1.281-1.239=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.861=0.002
σ575.935-575.941=-0.006
min179.884-179.887=-0.003
max1331.766-1331.773=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean0.446-0.466=-0.020
σ0.299-0.369=-0.069
min0.294-0.280=0.015
max0.895-1.018=-0.124
policies=20
mean1799.161-1799.156=0.006
σ0.377-0.358=0.019
min1798.890-1798.924=-0.034
max1799.714-1799.690=0.025
mean820.000
σ0.000
min820.000
max820.000
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean2.873-2.791=0.082
σ0.012-0.024=-0.012
min2.859-2.764=0.095
max2.888-2.821=0.067
policies=200
mean17998.576-17998.478=0.098
σ0.505-0.508=-0.003
min17998.261-17998.196=0.064
max17999.330-17999.239=0.091
mean8200.000
σ0.000
min8200.000
max8200.000
mean2874.000-2811.000=63.000
σ0.000
min2874.000-2811.000=63.000
max2874.000-2811.000=63.000
mean28.488-28.168=0.320
σ0.386-0.121=0.265
min28.116-28.046=0.069
max28.969-28.334=0.634