Compare commits

Home / Compare 8051ce2c .. 27a9db55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.949-53.947=0.002
σ0.365-0.367=-0.002
min53.800-53.799=0.002
max54.988-54.992=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.150-0.139=0.011
σ0.009-0.003=0.006
min0.137-0.136=0.001
max0.164-0.144=0.019
cache=y
dps=1
iters=10
policies=100
mean43.325-43.325=0.001
σ0.006-0.009=-0.002
min43.313-43.313=-0.001
max43.336-43.339=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.126-0.130=-0.004
σ0.008-0.013=-0.005
min0.120-0.114=0.005
max0.139-0.147=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.701-1010.701=-0.000
σ1.155-1.152=0.003
min1010.123-1010.125=-0.002
max1015.525-1015.513=0.012
mean1048.800-1045.600=3.200
σ309.577-309.071=0.506
min564.000-586.000=-22.000
max1642.000-1638.000=4.000
mean1.520-1.504=0.016
σ0.101-0.072=0.029
min1.412-1.442=-0.029
max1.754-1.717=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.947-300.989=-0.041
σ0.291-0.255=0.036
min300.700-300.825=-0.125
max301.703-301.700=0.003
mean1903.000-1934.000=-31.000
σ0.000
min1903.000-1934.000=-31.000
max1903.000-1934.000=-31.000
mean0.553-0.586=-0.034
σ0.047-0.037=0.011
min0.495-0.525=-0.030
max0.644-0.671=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.172-299.168=0.004
σ0.052-0.031=0.021
min299.096-299.137=-0.041
max299.223-299.203=0.019
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.383-0.383=0.000
σ0.001-0.001=0.000
min0.382-0.382=-0.001
max0.384-0.384=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1309.614-1309.623=-0.009
σ0.096-0.104=-0.007
min1309.491-1309.496=-0.005
max1309.725-1309.737=-0.012
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean1.892-1.867=0.025
σ0.101-0.092=0.008
min1.794-1.781=0.012
max2.013-1.996=0.017
iters=5
new-facts=6402
prior-facts=1
mean1553.692-1553.714=-0.022
σ6.873-6.864=0.009
min1550.357-1550.404=-0.048
max1565.981-1565.988=-0.006
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean2.231-2.353=-0.122
σ0.254-0.291=-0.037
min2.088-2.042=0.046
max2.682-2.666=0.016
iters=5
new-facts=6402
prior-facts=6402
mean1871.496-1871.487=0.009
σ0.049-0.046=0.003
min1871.431-1871.435=-0.004
max1871.545-1871.540=0.005
mean1769.400-1781.000=-11.600
σ129.036-148.422=-19.386
min1642.000-1638.000=4.000
max1903.000-1934.000=-31.000
mean3.105-2.826=0.279
σ0.368-0.099=0.269
min2.791-2.686=0.105
max3.732-2.959=0.773

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.212=-0.012
σ0.298-0.401=-0.102
min0.917-0.907=0.011
max1.693-1.899=-0.206

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.454
σ575.145-575.145=0.000
min156.874-156.873=0.001
max1307.170-1307.170=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean0.556-0.555=0.000
σ0.573-0.573=-0.000
min0.262-0.265=-0.003
max1.414-1.415=-0.000
policies=20
mean1569.032-1569.014=0.018
σ0.334-0.327=0.007
min1568.843-1568.840=0.003
max1569.532-1569.504=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean2.628-2.631=-0.003
σ0.040-0.034=0.006
min2.598-2.581=0.018
max2.686-2.653=0.033
policies=200
mean15697.991-15697.982=0.009
σ0.137-0.145=-0.008
min15697.861-15697.831=0.030
max15698.184-15698.159=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1638.000=4.000
σ0.000
min1642.000-1638.000=4.000
max1642.000-1638.000=4.000
mean26.351-26.354=-0.004
σ0.123-0.171=-0.048
min26.220-26.211=0.010
max26.504-26.557=-0.053