Compare commits

Home / Compare b6c05cc2 .. 4ad38d7c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.646=0.002
σ0.364-0.366=-0.002
min53.521-53.510=0.011
max54.685-54.688=-0.003
mean418.600-413.000=5.600
σ0.516-0.000=0.516
min418.000-413.000=5.000
max419.000-413.000=6.000
mean0.140-0.137=0.002
σ0.004-0.005=-0.001
min0.136-0.133=0.003
max0.147-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-42.942=-0.000
σ0.006-0.006=0.000
min42.933-42.932=0.001
max42.953-42.952=0.001
mean419.000-413.000=6.000
σ0.000
min419.000-413.000=6.000
max419.000-413.000=6.000
mean0.121-0.118=0.003
σ0.003-0.001=0.002
min0.119-0.117=0.002
max0.127-0.120=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.799=0.066
σ1.210-1.250=-0.041
min991.331-991.234=0.097
max996.929-997.062=-0.133
mean1059.850-1063.650=-3.800
σ313.143-322.894=-9.752
min592.000-565.000=27.000
max1534.000-1639.000=-105.000
mean1.516-1.522=-0.005
σ0.061-0.084=-0.024
min1.453-1.439=0.014
max1.648-1.724=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.393=0.043
σ0.012-0.013=-0.001
min285.423-285.372=0.051
max285.451-285.405=0.046
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean0.379-0.378=0.001
σ0.005-0.008=-0.003
min0.375-0.374=0.002
max0.388-0.392=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.465-1285.347=0.118
σ0.073-0.107=-0.034
min1285.357-1285.290=0.067
max1285.537-1285.538=-0.002
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean1.883-2.002=-0.119
σ0.181-0.254=-0.074
min1.687-1.773=-0.085
max2.170-2.381=-0.210
iters=5
new-facts=6402
prior-facts=1
mean1705.829-1807.690=-101.861
σ6.849-7.001=-0.152
min1702.644-1804.333=-101.688
max1718.078-1820.199=-102.121
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean2.913-4.187=-1.275
σ0.258-0.200=0.058
min2.560-3.861=-1.302
max3.177-4.385=-1.208
iters=5
new-facts=6402
prior-facts=6402
mean1968.451-2070.176=-101.725
σ0.015-0.010=0.005
min1968.436-2070.168=-101.732
max1968.471-2070.193=-101.722
mean1855.200-1837.000=18.200
σ233.318-169.663=63.655
min1567.000-1639.000=-72.000
max2139.000-2073.000=66.000
mean3.264-4.557=-1.293
σ0.112-0.127=-0.015
min3.148-4.459=-1.311
max3.429-4.776=-1.347

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.533-1.162=0.371
σ0.232-0.277=-0.045
min1.231-0.894=0.337
max1.836-1.553=0.282

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.769-436.772=-0.002
σ572.351-572.360=-0.008
min150.587-150.587=0.001
max1295.296-1295.311=-0.015
mean90.250
σ8.500
min86.000
max103.000
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean0.533-0.545=-0.012
σ0.558-0.579=-0.021
min0.251-0.249=0.002
max1.369-1.413=-0.043
policies=20
mean1506.155-1506.159=-0.004
σ0.245-0.220=0.024
min1505.990-1506.016=-0.025
max1506.518-1506.488=0.031
mean860.000
σ0.000
min860.000
max860.000
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean2.525-2.493=0.031
σ0.018-0.029=-0.012
min2.502-2.456=0.047
max2.540-2.528=0.013
policies=200
mean15069.474-15069.480=-0.006
σ0.115-0.100=0.015
min15069.367-15069.397=-0.030
max15069.594-15069.597=-0.003
mean8600.000
σ0.000
min8600.000
max8600.000
mean1534.000-1639.000=-105.000
σ0.000
min1534.000-1639.000=-105.000
max1534.000-1639.000=-105.000
mean25.490-25.394=0.096
σ0.114-0.087=0.027
min25.387-25.311=0.076
max25.619-25.491=0.127