Compare commits

Home / Compare 072ca25e .. df328140

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.946-53.947=-0.001
σ0.368-0.369=-0.001
min53.810-53.804=0.006
max54.992-54.997=-0.005
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.139-0.140=-0.001
σ0.005-0.004=0.001
min0.132-0.136=-0.004
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.007-0.007=-0.000
min43.313-43.309=0.004
max43.335-43.336=-0.000
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.120-0.122=-0.002
σ0.005-0.004=0.001
min0.114-0.119=-0.004
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.694-1010.695=-0.001
σ1.169-1.166=0.003
min1010.122-1010.125=-0.003
max1015.591-1015.575=0.015
mean1053.700-1049.900=3.800
σ299.284-299.701=-0.417
min574.000-570.000=4.000
max1460.000-1457.000=3.000
mean1.538-1.524=0.014
σ0.090-0.090=-0.001
min1.446-1.304=0.142
max1.734-1.705=0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.968-300.940=0.028
σ0.247-0.227=0.020
min300.802-300.728=0.074
max301.639-301.531=0.108
mean2049.000-1952.000=97.000
σ0.000
min2049.000-1952.000=97.000
max2049.000-1952.000=97.000
mean0.537-0.585=-0.048
σ0.035-0.047=-0.012
min0.503-0.517=-0.015
max0.592-0.681=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.178-299.157=0.021
σ0.046-0.042=0.003
min299.105-299.090=0.015
max299.217-299.193=0.024
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean0.385-0.388=-0.003
σ0.002-0.007=-0.005
min0.383-0.383=-0.000
max0.388-0.402=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1309.611-1309.618=-0.008
σ0.097-0.100=-0.003
min1309.487-1309.490=-0.002
max1309.734-1309.732=0.002
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean1.918-1.902=0.016
σ0.098-0.095=0.002
min1.812-1.811=0.001
max2.028-2.023=0.005
iters=5
new-facts=6402
prior-facts=1
mean1553.699-1553.706=-0.008
σ6.890-6.863=0.027
min1550.360-1550.404=-0.044
max1566.019-1565.978=0.041
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean2.281-2.323=-0.042
σ0.301-0.238=0.063
min2.117-2.046=0.071
max2.817-2.584=0.233
iters=5
new-facts=6402
prior-facts=6402
mean1871.494-1871.487=0.006
σ0.063-0.051=0.012
min1871.421-1871.423=-0.002
max1871.542-1871.526=0.015
mean1749.800-1747.200=2.600
σ233.901-217.091=16.810
min1460.000-1457.000=3.000
max2049.000-1952.000=97.000
mean2.941-2.940=0.000
σ0.090-0.135=-0.045
min2.834-2.839=-0.005
max3.017-3.154=-0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.610-1.696=-0.086
σ0.178-0.121=0.057
min1.390-1.505=-0.115
max1.802-1.830=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.444-444.442=0.002
σ575.137-575.127=0.010
min156.872-156.874=-0.002
max1307.149-1307.133=0.017
mean96.250
σ8.500
min92.000
max109.000
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean0.546-0.539=0.007
σ0.570-0.558=0.011
min0.258-0.257=0.001
max1.400-1.376=0.024
policies=20
mean1568.988-1569.013=-0.025
σ0.332-0.326=0.005
min1568.776-1568.811=-0.035
max1569.483-1569.501=-0.018
mean920.000
σ0.000
min920.000
max920.000
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean2.604-2.605=-0.001
σ0.008-0.017=-0.008
min2.592-2.582=0.010
max2.609-2.622=-0.013
policies=200
mean15697.909-15698.034=-0.125
σ0.094-0.062=0.032
min15697.770-15697.958=-0.187
max15697.976-15698.087=-0.111
mean9200.000
σ0.000
min9200.000
max9200.000
mean1460.000-1457.000=3.000
σ0.000
min1460.000-1457.000=3.000
max1460.000-1457.000=3.000
mean26.467-26.425=0.042
σ0.226-0.165=0.061
min26.208-26.218=-0.010
max26.669-26.592=0.078