Compare commits

Home / Compare 5f77be88 .. 4edd990e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.648=-0.000
σ0.367-0.367=-0.000
min53.519-53.517=0.002
max54.693-54.694=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.140=-0.001
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean42.942-42.942=-0.000
σ0.005-0.007=-0.002
min42.935-42.928=0.006
max42.950-42.954=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.122=-0.002
σ0.005-0.003=0.001
min0.115-0.119=-0.004
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.800-991.793=0.007
σ1.268-1.263=0.005
min991.242-991.248=-0.005
max997.142-997.114=0.028
mean1065.250-1063.650=1.600
σ322.595-322.083=0.513
min567.000
max1639.000
mean1.528-1.531=-0.003
σ0.091-0.104=-0.013
min1.452-1.383=0.069
max1.821-1.758=0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.396-285.397=-0.001
σ0.015-0.008=0.007
min285.375-285.390=-0.016
max285.416-285.410=0.005
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.379-0.383=-0.004
σ0.008-0.010=-0.003
min0.374-0.375=-0.001
max0.392-0.395=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.352-1285.353=-0.002
σ0.128-0.133=-0.005
min1285.286-1285.287=-0.001
max1285.581-1285.591=-0.011
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.009-1.891=0.119
σ0.249-0.076=0.173
min1.792-1.798=-0.006
max2.407-2.003=0.404
iters=5
new-facts=6402
prior-facts=1
mean1807.674-1807.673=0.001
σ7.015-7.041=-0.026
min1804.310-1804.324=-0.014
max1820.206-1820.253=-0.047
mean1639.000
σ0.000
min1639.000
max1639.000
mean4.130-4.152=-0.022
σ0.191-0.278=-0.087
min3.841-3.918=-0.077
max4.371-4.602=-0.231
iters=5
new-facts=6402
prior-facts=6402
mean2070.177-2070.178=-0.001
σ0.008-0.008=-0.001
min2070.164-2070.170=-0.006
max2070.182-2070.191=-0.009
mean1837.200-1847.000=-9.800
σ174.292-174.303=-0.011
min1639.000
max2073.000-2091.000=-18.000
mean4.536-4.462=0.074
σ0.054-0.062=-0.008
min4.481-4.399=0.082
max4.607-4.538=0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.174=0.024
σ0.248-0.260=-0.013
min0.908-0.907=0.001
max1.560-1.545=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.773-436.774=-0.001
σ572.366-572.364=0.002
min150.586-150.590=-0.004
max1295.322-1295.320=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean0.505-0.536=-0.030
σ0.510-0.562=-0.052
min0.247-0.251=-0.004
max1.270-1.379=-0.108
policies=20
mean1506.164-1506.185=-0.021
σ0.240-0.241=-0.001
min1506.003-1506.026=-0.022
max1506.520-1506.543=-0.023
mean860.000
σ0.000
min860.000
max860.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean2.517-2.522=-0.005
σ0.013-0.009=0.003
min2.501-2.509=-0.008
max2.532-2.529=0.003
policies=200
mean15069.370-15069.543=-0.173
σ0.086-0.054=0.032
min15069.263-15069.497=-0.234
max15069.474-15069.617=-0.143
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000
σ0.000
min1639.000
max1639.000
mean25.460-25.470=-0.010
σ0.125-0.154=-0.029
min25.319-25.310=0.009
max25.621-25.662=-0.041