Compare commits

Home / Compare 0a359f2a .. 41c069d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.648=0.000
σ0.366-0.367=-0.001
min53.520-53.521=-0.001
max54.691-54.692=-0.002
mean412.000-416.600=-4.600
σ0.000-0.516=-0.516
min412.000-416.000=-4.000
max412.000-417.000=-5.000
mean0.139-0.139=0.000
σ0.006-0.004=0.002
min0.132-0.136=-0.003
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean42.945-42.941=0.003
σ0.007-0.005=0.002
min42.934-42.933=0.001
max42.954-42.947=0.006
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.130-0.119=0.011
σ0.009-0.004=0.005
min0.117-0.112=0.004
max0.144-0.127=0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.863-991.863=-0.001
σ1.226-1.206=0.020
min991.267-991.335=-0.068
max996.996-996.914=0.083
mean1052.100-1056.050=-3.950
σ316.482-312.563=3.919
min577.000-589.000=-12.000
max1537.000-1529.000=8.000
mean1.522-1.528=-0.006
σ0.087-0.096=-0.010
min1.385-1.420=-0.035
max1.736-1.860=-0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.442-285.439=0.003
σ0.012-0.009=0.003
min285.424-285.429=-0.005
max285.453-285.449=0.004
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean0.380-0.382=-0.002
σ0.007-0.008=-0.001
min0.374-0.376=-0.002
max0.390-0.393=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.501-1285.507=-0.007
σ0.058-0.084=-0.026
min1285.406-1285.363=0.043
max1285.559-1285.567=-0.008
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean2.009-1.969=0.040
σ0.093-0.244=-0.152
min1.887-1.814=0.073
max2.145-2.400=-0.255
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1705.838=-0.009
σ6.859-6.862=-0.003
min1702.634-1702.657=-0.022
max1718.096-1718.109=-0.013
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean2.992-2.911=0.081
σ0.218-0.293=-0.075
min2.730-2.544=0.186
max3.263-3.305=-0.043
iters=5
new-facts=6402
prior-facts=6402
mean1968.425-1968.448=-0.022
σ0.013-0.014=-0.001
min1968.403-1968.435=-0.032
max1968.436-1968.464=-0.027
mean1817.000-1849.400=-32.400
σ217.668-229.391=-11.723
min1539.000-1565.000=-26.000
max2087.000-2127.000=-40.000
mean3.166-3.279=-0.113
σ0.293-0.108=0.185
min2.881-3.169=-0.289
max3.663-3.431=0.233

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.539-1.554=-0.015
σ0.287-0.225=0.062
min1.062-1.228=-0.167
max1.758-1.782=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.772-436.770=0.002
σ572.354-572.351=0.002
min150.593-150.590=0.004
max1295.302-1295.297=0.006
mean90.250
σ8.500
min86.000
max103.000
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean0.528-0.527=0.001
σ0.551-0.553=-0.002
min0.250-0.247=0.002
max1.355-1.357=-0.002
policies=20
mean1506.211-1506.191=0.020
σ0.235-0.235=-0.000
min1506.047-1506.023=0.024
max1506.559-1506.538=0.020
mean860.000
σ0.000
min860.000
max860.000
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean2.504-2.511=-0.007
σ0.016-0.008=0.008
min2.494-2.503=-0.009
max2.527-2.521=0.006
policies=200
mean15069.895-15069.853=0.043
σ0.091-0.124=-0.033
min15069.821-15069.699=0.122
max15070.026-15069.973=0.053
mean8600.000
σ0.000
min8600.000
max8600.000
mean1537.000-1529.000=8.000
σ0.000
min1537.000-1529.000=8.000
max1537.000-1529.000=8.000
mean25.461-25.595=-0.134
σ0.099-0.277=-0.178
min25.347-25.387=-0.040
max25.574-25.993=-0.420