Compare commits

Home / Compare 957bd3c2 .. f8c27bf1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.649=0.000
σ0.364-0.367=-0.003
min53.521-53.524=-0.003
max54.685-54.692=-0.007
mean418.600-414.000=4.600
σ0.516-0.000=0.516
min418.000-414.000=4.000
max419.000-414.000=5.000
mean0.140-0.138=0.002
σ0.004-0.004=-0.000
min0.136-0.130=0.006
max0.147-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean42.941-42.944=-0.002
σ0.006-0.007=-0.001
min42.933-42.935=-0.002
max42.953-42.955=-0.002
mean419.000-414.400=4.600
σ0.000-0.516=-0.516
min419.000-414.000=5.000
max419.000-415.000=4.000
mean0.121-0.121=0.000
σ0.003-0.005=-0.002
min0.119-0.115=0.004
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.803=0.062
σ1.210-1.271=-0.061
min991.331-991.250=0.080
max996.929-997.155=-0.226
mean1059.850-1064.550=-4.700
σ313.143-321.237=-8.094
min592.000-568.000=24.000
max1534.000-1632.000=-98.000
mean1.516-1.526=-0.009
σ0.061-0.132=-0.071
min1.453-1.362=0.091
max1.648-1.822=-0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.392=0.044
σ0.012-0.007=0.005
min285.423-285.386=0.037
max285.451-285.401=0.049
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean0.379-0.382=-0.003
σ0.005-0.007=-0.002
min0.375-0.373=0.002
max0.388-0.391=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.465-1285.353=0.112
σ0.073-0.131=-0.058
min1285.357-1285.286=0.071
max1285.537-1285.586=-0.050
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean1.883-1.964=-0.081
σ0.181-0.143=0.038
min1.687-1.829=-0.142
max2.170-2.151=0.020
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1807.690=-101.861
σ6.849-6.973=-0.124
min1702.644-1804.359=-101.714
max1718.078-1820.148=-102.070
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean2.913-4.140=-1.228
σ0.258-0.070=0.189
min2.560-4.064=-1.504
max3.177-4.206=-1.028
iters=5
new-facts=6402
prior-facts=6402
mean1968.451-2070.178=-101.728
σ0.015-0.018=-0.003
min1968.436-2070.167=-101.731
max1968.471-2070.211=-101.740
mean1855.200-1855.800=-0.600
σ233.318-199.416=33.902
min1567.000-1632.000=-65.000
max2139.000-2084.000=55.000
mean3.264-4.485=-1.222
σ0.112-0.083=0.029
min3.148-4.407=-1.259
max3.429-4.581=-1.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.174=0.358
σ0.232-0.243=-0.012
min1.231-0.917=0.314
max1.836-1.516=0.319

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.769-436.774=-0.004
σ572.351-572.360=-0.009
min150.587-150.588=-0.001
max1295.296-1295.314=-0.017
mean90.250
σ8.500
min86.000
max103.000
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean0.533-0.518=0.015
σ0.558-0.538=0.020
min0.251-0.245=0.005
max1.369-1.325=0.045
policies=20
mean1506.155-1506.177=-0.023
σ0.245-0.226=0.018
min1505.990-1506.029=-0.039
max1506.518-1506.514=0.004
mean860.000
σ0.000
min860.000
max860.000
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean2.525-2.500=0.024
σ0.018-0.030=-0.012
min2.502-2.475=0.028
max2.540-2.535=0.005
policies=200
mean15069.474-15069.481=-0.007
σ0.115-0.096=0.019
min15069.367-15069.396=-0.029
max15069.594-15069.616=-0.022
mean8600.000
σ0.000
min8600.000
max8600.000
mean1534.000-1632.000=-98.000
σ0.000
min1534.000-1632.000=-98.000
max1534.000-1632.000=-98.000
mean25.490-25.422=0.068
σ0.114-0.090=0.024
min25.387-25.290=0.097
max25.619-25.486=0.133