Compare commits

Home / Compare 93af33cb .. 1123f40f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.915=-0.266
σ0.364-0.367=-0.003
min53.521-53.787=-0.266
max54.685-54.960=-0.275
mean418.600-417.000=1.600
σ0.516-0.000=0.516
min418.000-417.000=1.000
max419.000-417.000=2.000
mean0.140-0.138=0.002
σ0.004-0.005=-0.002
min0.136-0.130=0.006
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-43.141=-0.199
σ0.006-0.006=0.000
min42.933-43.133=-0.200
max42.953-43.149=-0.196
mean419.000-417.900=1.100
σ0.000-0.316=-0.316
min419.000-417.000=2.000
max419.000-418.000=1.000
mean0.121-0.121=0.001
σ0.003-0.004=-0.001
min0.119-0.117=0.002
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-992.070=-0.206
σ1.210-1.255=-0.045
min991.331-991.516=-0.185
max996.929-997.353=-0.423
mean1059.850-1069.000=-9.150
σ313.143-319.572=-6.429
min592.000-585.000=7.000
max1534.000-1651.000=-117.000
mean1.516-1.548=-0.031
σ0.061-0.091=-0.030
min1.453-1.465=-0.012
max1.648-1.756=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.678=-0.242
σ0.012-0.009=0.003
min285.423-285.665=-0.242
max285.451-285.689=-0.238
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean0.379-0.382=-0.003
σ0.005-0.012=-0.006
min0.375-0.376=-0.001
max0.388-0.403=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.465-1285.640=-0.175
σ0.073-0.134=-0.061
min1285.357-1285.572=-0.215
max1285.537-1285.880=-0.343
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean1.883-1.875=0.009
σ0.181-0.112=0.069
min1.687-1.746=-0.059
max2.170-2.053=0.117
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1807.976=-102.147
σ6.849-7.027=-0.178
min1702.644-1804.605=-101.960
max1718.078-1820.531=-102.453
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean2.913-4.205=-1.293
σ0.258-0.196=0.063
min2.560-3.970=-1.410
max3.177-4.507=-1.330
iters=5
new-facts=6402
prior-facts=6402
mean1968.451-2070.463=-102.012
σ0.015-0.007=0.007
min1968.436-2070.453=-102.017
max1968.471-2070.473=-102.002
mean1855.200-1840.400=14.800
σ233.318-167.140=66.178
min1567.000-1651.000=-84.000
max2139.000-2075.000=64.000
mean3.264-4.500=-1.236
σ0.112-0.040=0.072
min3.148-4.448=-1.300
max3.429-4.558=-1.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.236=0.296
σ0.232-0.326=-0.094
min1.231-1.022=0.209
max1.836-1.805=0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.769-437.379=-0.610
σ572.351-572.364=-0.012
min150.587-151.196=-0.608
max1295.296-1295.925=-0.629
mean90.250
σ8.500
min86.000
max103.000
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean0.533-0.537=-0.004
σ0.558-0.545=0.013
min0.251-0.257=-0.007
max1.369-1.354=0.016
policies=20
mean1506.155-1512.210=-6.055
σ0.245-0.253=-0.009
min1505.990-1512.033=-6.042
max1506.518-1512.585=-6.067
mean860.000
σ0.000
min860.000
max860.000
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean2.525-2.526=-0.002
σ0.018-0.012=0.006
min2.502-2.508=-0.006
max2.540-2.533=0.007
policies=200
mean15069.474-15129.739=-60.265
σ0.115-0.055=0.060
min15069.367-15129.673=-60.306
max15069.594-15129.793=-60.199
mean8600.000
σ0.000
min8600.000
max8600.000
mean1534.000-1651.000=-117.000
σ0.000
min1534.000-1651.000=-117.000
max1534.000-1651.000=-117.000
mean25.490-25.583=-0.093
σ0.114-0.127=-0.013
min25.387-25.440=-0.053
max25.619-25.748=-0.130