Compare commits

Home / Compare 3c8e9b85 .. dad726be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.046-0.043=0.003
min70.541-70.542=-0.001
max70.694-70.685=0.009
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.158-0.157=0.001
σ0.003-0.005=-0.002
min0.155-0.150=0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.002-0.003=-0.001
min21.285-21.282=0.003
max21.292-21.292=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.064-0.062=0.003
σ0.002-0.004=-0.001
min0.062-0.058=0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.375=-0.001
σ0.361-0.362=-0.000
min1752.802-1752.802=-0.000
max1753.956-1753.971=-0.015
mean1658.000-1647.350=10.650
σ644.335-640.810=3.525
min618.000-634.000=-16.000
max2771.000-2874.000=-103.000
mean2.832-2.768=0.064
σ0.142-0.224=-0.082
min2.441-2.268=0.173
max3.134-3.023=0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.733=0.024
σ0.007-0.006=0.000
min271.750-271.725=0.025
max271.766-271.740=0.026
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean0.380-0.380=0.000
σ0.007-0.008=-0.001
min0.373-0.368=0.005
max0.388-0.388=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.184-1932.176=0.009
σ0.007-0.013=-0.006
min1932.177-1932.162=0.015
max1932.193-1932.196=-0.002
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean2.988-2.975=0.013
σ0.137-0.143=-0.006
min2.811-2.739=0.072
max3.196-3.125=0.071
iters=5
new-facts=6402
prior-facts=1
mean4752.712-4752.807=-0.094
σ0.736-0.961=-0.224
min4751.913-4752.012=-0.099
max4753.919-4754.471=-0.552
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean8.319-8.343=-0.025
σ0.415-0.501=-0.086
min7.749-7.809=-0.060
max8.736-9.028=-0.292
iters=5
new-facts=6402
prior-facts=6402
mean4943.374-4943.375=-0.001
σ0.023-0.020=0.003
min4943.342-4943.354=-0.012
max4943.401-4943.397=0.004
mean3018.400-3058.800=-40.400
σ285.605-242.936=42.670
min2771.000-2874.000=-103.000
max3424.000-3423.000=1.000
mean8.434-8.456=-0.022
σ0.119-0.098=0.022
min8.316-8.394=-0.078
max8.633-8.625=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.050=-0.035
σ0.140-0.145=-0.006
min0.922-0.924=-0.002
max1.244-1.281=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.863=-0.002
σ575.925-575.935=-0.011
min179.890-179.884=0.006
max1331.748-1331.766=-0.018
mean86.250
σ8.500
min82.000
max99.000
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean0.443-0.446=-0.002
σ0.299-0.299=-0.000
min0.292-0.294=-0.003
max0.892-0.895=-0.003
policies=20
mean1799.177-1799.161=0.016
σ0.337-0.377=-0.041
min1798.924-1798.890=0.035
max1799.672-1799.714=-0.042
mean820.000
σ0.000
min820.000
max820.000
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean2.841-2.873=-0.033
σ0.081-0.012=0.069
min2.796-2.859=-0.062
max2.962-2.888=0.075
policies=200
mean17998.497-17998.576=-0.080
σ0.464-0.505=-0.041
min17998.156-17998.261=-0.105
max17999.182-17999.330=-0.149
mean8200.000
σ0.000
min8200.000
max8200.000
mean2771.000-2874.000=-103.000
σ0.000
min2771.000-2874.000=-103.000
max2771.000-2874.000=-103.000
mean28.190-28.488=-0.298
σ0.076-0.386=-0.309
min28.119-28.116=0.004
max28.297-28.969=-0.672