Compare commits

Home / Compare e72d5fea .. 68ec7354

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.025-54.024=0.001
σ0.371-0.369=0.002
min53.878-53.886=-0.007
max55.079-55.073=0.007
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.140-0.141=-0.001
σ0.004-0.004=0.000
min0.136-0.137=-0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.002
σ0.008-0.008=0.000
min43.311-43.311=0.000
max43.338-43.340=-0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.123-0.123=-0.000
σ0.004-0.004=-0.000
min0.120-0.120=0.000
max0.131-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.994-1010.996=-0.002
σ1.190-1.180=0.010
min1010.429-1010.421=0.008
max1015.985-1015.940=0.046
mean1049.800-1046.250=3.550
σ309.972-309.399=0.573
min553.000-550.000=3.000
max1516.000-1512.000=4.000
mean1.540-1.531=0.009
σ0.069-0.068=0.002
min1.464-1.448=0.016
max1.721-1.761=-0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.745-300.870=-0.124
σ0.221-0.256=-0.036
min300.551-300.698=-0.147
max301.345-301.547=-0.202
mean1946.000-1977.000=-31.000
σ0.000
min1946.000-1977.000=-31.000
max1946.000-1977.000=-31.000
mean0.540-0.558=-0.018
σ0.035-0.031=0.003
min0.501-0.505=-0.004
max0.577-0.586=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.448-299.444=0.004
σ0.041-0.046=-0.005
min299.386-299.372=0.015
max299.490-299.487=0.003
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean0.386-0.385=0.001
σ0.001-0.005=-0.004
min0.384-0.379=0.005
max0.387-0.393=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1309.876-1309.891=-0.014
σ0.081-0.113=-0.032
min1309.767-1309.751=0.016
max1309.977-1310.011=-0.033
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean1.922-1.863=0.059
σ0.088-0.097=-0.009
min1.812-1.779=0.034
max2.054-2.001=0.053
iters=5
new-facts=6402
prior-facts=1
mean1553.979-1553.969=0.010
σ6.891-6.876=0.015
min1550.635-1550.665=-0.030
max1566.301-1566.265=0.035
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean2.237-2.170=0.067
σ0.188-0.149=0.040
min2.083-2.015=0.068
max2.553-2.412=0.141
iters=5
new-facts=6402
prior-facts=6402
mean1871.771-1871.775=-0.004
σ0.054-0.066=-0.012
min1871.709-1871.702=0.006
max1871.836-1871.859=-0.024
mean1729.000-1702.600=26.400
σ157.713-195.505=-37.792
min1530.000-1512.000=18.000
max1946.000-1977.000=-31.000
mean2.915-2.867=0.048
σ0.146-0.060=0.086
min2.715-2.818=-0.103
max3.106-2.967=0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.577-1.657=-0.080
σ0.237-0.196=0.041
min1.267-1.373=-0.106
max1.794-1.835=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.078-448.076=0.002
σ581.785-581.786=-0.001
min157.182-157.180=0.002
max1320.755-1320.755=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean0.545-0.535=0.010
σ0.566-0.552=0.014
min0.261-0.258=0.003
max1.394-1.363=0.031
policies=20
mean1572.101-1572.101=0.000
σ0.342-0.340=0.002
min1571.875-1571.881=-0.007
max1572.611-1572.608=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean2.621-2.623=-0.001
σ0.009-0.016=-0.006
min2.608-2.600=0.009
max2.628-2.633=-0.005
policies=200
mean15729.022-15729.016=0.006
σ0.097-0.066=0.031
min15728.968-15728.938=0.030
max15729.167-15729.099=0.068
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1512.000=4.000
σ0.000
min1516.000-1512.000=4.000
max1516.000-1512.000=4.000
mean26.613-26.436=0.177
σ0.131-0.159=-0.027
min26.494-26.315=0.179
max26.736-26.670=0.066