Compare commits

Home / Compare b56b8092 .. fae5414e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.836=0.000
σ0.370-0.368=0.002
min53.694-53.692=0.003
max54.888-54.881=0.007
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.137-0.138=-0.001
σ0.004-0.006=-0.001
min0.131-0.129=0.002
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.007-0.007=-0.000
min43.195-43.197=-0.002
max43.222-43.219=0.003
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.114-0.114=-0.000
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.213=-0.009
σ1.173-1.145=0.028
min1015.633-1015.631=0.001
max1021.117-1020.988=0.129
mean1051.900-1040.050=11.850
σ300.480-310.367=-9.887
min605.000-586.000=19.000
max1452.000-1627.000=-175.000
mean1.520-1.537=-0.017
σ0.053-0.096=-0.043
min1.450-1.450=-0.000
max1.613-1.803=-0.190

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.435-301.128=0.307
σ0.215-0.225=-0.009
min301.267-300.944=0.323
max302.012-301.692=0.320
mean1950.000-2019.000=-69.000
σ0.000
min1950.000-2019.000=-69.000
max1950.000-2019.000=-69.000
mean0.533-0.576=-0.043
σ0.029-0.027=0.002
min0.500-0.523=-0.023
max0.575-0.604=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.491-301.483=0.008
σ0.034-0.045=-0.011
min301.451-301.415=0.037
max301.535-301.532=0.003
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean0.394-0.392=0.002
σ0.004-0.001=0.003
min0.390-0.391=-0.000
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1324.046-1324.057=-0.011
σ0.108-0.105=0.004
min1323.920-1323.924=-0.004
max1324.204-1324.185=0.019
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean1.965-1.887=0.078
σ0.126-0.062=0.065
min1.833-1.823=0.010
max2.171-1.964=0.207
iters=5
new-facts=6402
prior-facts=1
mean1562.091-1562.091=0.001
σ6.936-6.902=0.034
min1558.747-1558.815=-0.068
max1574.491-1574.433=0.058
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean2.407-2.333=0.073
σ0.346-0.287=0.059
min2.081-2.076=0.006
max2.914-2.667=0.247
iters=5
new-facts=6402
prior-facts=6402
mean1891.983-1891.964=0.019
σ0.091-0.063=0.029
min1891.830-1891.855=-0.025
max1892.071-1892.010=0.061
mean1779.400-1767.600=11.800
σ162.077-170.636=-8.560
min1523.000-1627.000=-104.000
max1950.000-2019.000=-69.000
mean3.010-2.922=0.088
σ0.199-0.065=0.134
min2.841-2.880=-0.039
max3.350-3.036=0.314

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.741-1.179=0.562
σ0.139-0.346=-0.206
min1.554-0.917=0.637
max1.858-1.754=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.474-443.486=-0.013
σ574.222-574.239=-0.016
min156.355-156.363=-0.007
max1304.807-1304.844=-0.037
mean96.250
σ8.500
min92.000
max109.000
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean0.529-0.531=-0.001
σ0.533-0.524=0.009
min0.260-0.263=-0.003
max1.328-1.317=0.012
policies=20
mean1563.901-1563.884=0.017
σ0.339-0.262=0.077
min1563.679-1563.738=-0.060
max1564.405-1564.276=0.129
mean920.000
σ0.000
min920.000
max920.000
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean2.617-2.604=0.014
σ0.007-0.013=-0.006
min2.610-2.592=0.018
max2.626-2.621=0.005
policies=200
mean15646.992-15646.933=0.059
σ0.065-0.202=-0.137
min15646.942-15646.650=0.292
max15647.087-15647.113=-0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1452.000-1627.000=-175.000
σ0.000
min1452.000-1627.000=-175.000
max1452.000-1627.000=-175.000
mean26.505-26.426=0.079
σ0.268-0.121=0.147
min26.328-26.264=0.064
max26.902-26.526=0.375