Compare commits

Home / Compare 2b0d8299 .. 0a22204c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.915=-0.268
σ0.366-0.366=0.000
min53.510-53.778=-0.268
max54.688-54.956=-0.268
mean413.000-417.200=-4.200
σ0.000-0.632=-0.632
min413.000-417.000=-4.000
max413.000-419.000=-6.000
mean0.137-0.139=-0.002
σ0.005-0.005=-0.001
min0.133-0.133=-0.001
max0.146-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.942-43.141=-0.199
σ0.006-0.006=-0.000
min42.932-43.131=-0.198
max42.952-43.152=-0.200
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.118-0.121=-0.002
σ0.001-0.003=-0.002
min0.117-0.118=-0.001
max0.120-0.125=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.799-991.819=-0.020
σ1.250-1.247=0.003
min991.234-991.232=0.002
max997.062-997.057=0.005
mean1063.650-1069.500=-5.850
σ322.894-322.827=0.067
min565.000-570.000=-5.000
max1639.000-1641.000=-2.000
mean1.522-1.545=-0.024
σ0.084-0.092=-0.008
min1.439-1.469=-0.029
max1.724-1.774=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.410=-0.017
σ0.013-0.010=0.002
min285.372-285.393=-0.021
max285.405-285.419=-0.014
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean0.378-0.375=0.003
σ0.008-0.005=0.003
min0.374-0.373=0.001
max0.392-0.383=0.008
iters=5
new-facts=1
prior-facts=6402
mean1285.347-1285.339=0.008
σ0.107-0.059=0.048
min1285.290-1285.307=-0.017
max1285.538-1285.444=0.094
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean2.002-1.932=0.070
σ0.254-0.118=0.136
min1.773-1.810=-0.038
max2.381-2.093=0.288
iters=5
new-facts=6402
prior-facts=1
mean1807.690-1807.727=-0.037
σ7.001-6.987=0.014
min1804.333-1804.375=-0.042
max1820.199-1820.213=-0.014
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean4.187-4.174=0.014
σ0.200-0.247=-0.047
min3.861-3.943=-0.082
max4.385-4.501=-0.115
iters=5
new-facts=6402
prior-facts=6402
mean2070.176-2070.191=-0.015
σ0.010-0.006=0.004
min2070.168-2070.182=-0.014
max2070.193-2070.197=-0.004
mean1837.000-1864.000=-27.000
σ169.663-200.975=-31.312
min1639.000-1641.000=-2.000
max2073.000-2096.000=-23.000
mean4.557-4.442=0.114
σ0.127-0.078=0.049
min4.459-4.323=0.136
max4.776-4.536=0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.266=-0.105
σ0.277-0.311=-0.034
min0.894-1.043=-0.149
max1.553-1.799=-0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.772-436.785=-0.014
σ572.360-572.355=0.005
min150.587-150.598=-0.011
max1295.311-1295.318=-0.006
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean0.545-0.527=0.018
σ0.579-0.550=0.029
min0.249-0.247=0.002
max1.413-1.352=0.061
policies=20
mean1506.159-1506.266=-0.107
σ0.220-0.237=-0.016
min1506.016-1506.106=-0.090
max1506.488-1506.618=-0.130
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean2.493-2.510=-0.017
σ0.029-0.024=0.006
min2.456-2.486=-0.031
max2.528-2.543=-0.015
policies=200
mean15069.480-15070.401=-0.921
σ0.100-0.119=-0.019
min15069.397-15070.304=-0.907
max15069.597-15070.555=-0.958
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1641.000=-2.000
σ0.000
min1639.000-1641.000=-2.000
max1639.000-1641.000=-2.000
mean25.394-25.505=-0.110
σ0.087-0.136=-0.049
min25.311-25.371=-0.061
max25.491-25.692=-0.201