Compare commits

Home / Compare c8ce5118 .. de770a83

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.002
σ0.367-0.369=-0.002
min53.786-53.788=-0.002
max54.959-54.967=-0.007
mean414.000-415.500=-1.500
σ0.000-0.527=-0.527
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.136-0.140=-0.004
σ0.005-0.005=0.000
min0.130-0.135=-0.005
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.000
σ0.005-0.005=0.001
min43.133-43.133=0.000
max43.150-43.147=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.118-0.120=-0.002
σ0.004-0.004=0.000
min0.113-0.114=-0.001
max0.125-0.125=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.085-992.064=0.021
σ1.236-1.234=0.002
min991.495-991.524=-0.030
max997.273-997.260=0.013
mean1066.000-1056.650=9.350
σ310.938-320.506=-9.568
min603.000-607.000=-4.000
max1627.000-1624.000=3.000
mean1.550-1.541=0.008
σ0.130-0.099=0.031
min1.445-1.455=-0.010
max2.046-1.777=0.269

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.679-285.677=0.002
σ0.010-0.016=-0.006
min285.669-285.653=0.015
max285.690-285.690=-0.000
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean0.378-0.371=0.007
σ0.006-0.001=0.005
min0.375-0.370=0.006
max0.388-0.371=0.017
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1285.642=-0.001
σ0.135-0.135=0.000
min1285.577-1285.575=0.001
max1285.884-1285.883=0.000
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean1.936-1.878=0.058
σ0.128-0.069=0.059
min1.869-1.805=0.064
max2.165-1.987=0.178
iters=5
new-facts=6402
prior-facts=1
mean1807.988-1807.962=0.026
σ7.019-7.004=0.015
min1804.629-1804.624=0.005
max1820.530-1820.476=0.054
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean4.205-4.159=0.046
σ0.271-0.162=0.109
min3.942-3.977=-0.035
max4.527-4.400=0.127
iters=5
new-facts=6402
prior-facts=6402
mean2070.466-2070.461=0.005
σ0.008-0.010=-0.002
min2070.457-2070.452=0.005
max2070.478-2070.478=-0.000
mean1834.000-1854.200=-20.200
σ173.540-211.995=-38.455
min1627.000-1624.000=3.000
max2073.000-2093.000=-20.000
mean4.588-4.473=0.116
σ0.116-0.090=0.026
min4.492-4.401=0.091
max4.790-4.629=0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.211-1.417=-0.206
σ0.275-0.426=-0.151
min0.912-0.906=0.006
max1.639-1.820=-0.181

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.387-437.384=0.003
σ572.361-572.365=-0.004
min151.198-151.197=0.001
max1295.929-1295.931=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean0.522-0.530=-0.008
σ0.528-0.553=-0.025
min0.257-0.253=0.003
max1.314-1.359=-0.045
policies=20
mean1512.252-1512.230=0.023
σ0.243-0.262=-0.019
min1512.087-1512.062=0.025
max1512.613-1512.620=-0.007
mean860.000
σ0.000
min860.000
max860.000
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean2.524-2.547=-0.023
σ0.012-0.024=-0.012
min2.509-2.528=-0.018
max2.538-2.580=-0.042
policies=200
mean15130.183-15130.079=0.104
σ0.047-0.074=-0.027
min15130.131-15129.984=0.147
max15130.240-15130.156=0.084
mean8600.000
σ0.000
min8600.000
max8600.000
mean1627.000-1624.000=3.000
σ0.000
min1627.000-1624.000=3.000
max1627.000-1624.000=3.000
mean25.603-25.610=-0.008
σ0.058-0.082=-0.023
min25.525-25.552=-0.027
max25.661-25.731=-0.071