Compare commits

Home / Compare 3c172b02 .. 589188c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.000
σ0.367-0.368=-0.001
min53.788-53.785=0.002
max54.959-54.961=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.137-0.139=-0.002
σ0.004-0.005=-0.001
min0.129-0.132=-0.003
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.000
σ0.005-0.005=-0.001
min43.135-43.135=-0.000
max43.148-43.150=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.118-0.120=-0.003
σ0.003-0.003=0.000
min0.114-0.118=-0.004
max0.121-0.125=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.807-991.809=-0.002
σ1.271-1.252=0.019
min991.254-991.259=-0.005
max997.163-997.081=0.081
mean1070.950-1068.150=2.800
σ327.956-322.897=5.059
min570.000-569.000=1.000
max1645.000-1644.000=1.000
mean1.540-1.549=-0.009
σ0.093-0.090=0.003
min1.455-1.401=0.054
max1.783-1.771=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.416=-0.006
σ0.010-0.012=-0.003
min285.399-285.396=0.003
max285.421-285.429=-0.009
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.377-0.383=-0.006
σ0.002-0.013=-0.011
min0.374-0.373=0.002
max0.380-0.403=-0.023
iters=5
new-facts=1
prior-facts=6402
mean1285.378-1285.368=0.010
σ0.131-0.119=0.012
min1285.316-1285.306=0.009
max1285.612-1285.581=0.031
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean1.986-1.894=0.092
σ0.239-0.134=0.105
min1.793-1.811=-0.018
max2.396-2.125=0.271
iters=5
new-facts=6402
prior-facts=1
mean1807.763-1807.688=0.075
σ6.991-6.984=0.007
min1804.341-1804.348=-0.007
max1820.254-1820.168=0.086
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean4.346-4.124=0.221
σ0.283-0.192=0.091
min3.951-3.974=-0.023
max4.595-4.458=0.137
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.195=0.004
σ0.021-0.008=0.013
min2070.183-2070.187=-0.004
max2070.237-2070.208=0.029
mean1840.400-1876.800=-36.400
σ184.543-191.711=-7.168
min1645.000-1644.000=1.000
max2096.000-2086.000=10.000
mean4.481-4.504=-0.023
σ0.147-0.111=0.036
min4.279-4.444=-0.165
max4.694-4.702=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.177-1.086=0.091
σ0.279-0.138=0.141
min0.918-0.905=0.013
max1.637-1.231=0.406

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.790=-0.005
σ572.363-572.355=0.009
min150.597-150.596=0.001
max1295.330-1295.322=0.008
mean90.250
σ8.500
min86.000
max103.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean0.532-0.521=0.011
σ0.562-0.544=0.019
min0.248-0.246=0.002
max1.375-1.336=0.039
policies=20
mean1506.251-1506.258=-0.006
σ0.235-0.234=0.002
min1506.100-1506.108=-0.009
max1506.602-1506.606=-0.004
mean860.000
σ0.000
min860.000
max860.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean2.518-2.515=0.004
σ0.008-0.020=-0.012
min2.508-2.490=0.018
max2.526-2.537=-0.012
policies=200
mean15070.370-15070.351=0.019
σ0.062-0.097=-0.034
min15070.296-15070.226=0.069
max15070.448-15070.431=0.018
mean8600.000
σ0.000
min8600.000
max8600.000
mean1645.000-1644.000=1.000
σ0.000
min1645.000-1644.000=1.000
max1645.000-1644.000=1.000
mean25.508-25.452=0.055
σ0.125-0.076=0.049
min25.353-25.367=-0.015
max25.613-25.537=0.076