Compare commits

Home / Compare 81bf121e .. fe03c402

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.964=0.000
σ0.370-0.369=0.001
min53.821-53.828=-0.006
max55.017-55.013=0.004
mean419.700-416.000=3.700
σ0.483-0.000=0.483
min419.000-416.000=3.000
max420.000-416.000=4.000
mean0.139-0.139=0.000
σ0.004-0.004=0.001
min0.135-0.135=0.000
max0.148-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.006-0.006=-0.001
min43.313-43.317=-0.004
max43.334-43.339=-0.005
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.001
min0.118-0.113=0.006
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1011.205-1011.212=-0.006
σ1.185-1.157=0.028
min1010.666-1010.637=0.029
max1016.180-1016.044=0.135
mean1055.500-1045.850=9.650
σ310.825-309.331=1.493
min591.000-549.000=42.000
max1659.000-1512.000=147.000
mean1.542-1.533=0.009
σ0.071-0.081=-0.010
min1.464-1.456=0.008
max1.745-1.819=-0.074

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.084-301.147=-0.064
σ0.207-0.205=0.002
min300.883-300.973=-0.090
max301.634-301.690=-0.056
mean1977.000-1975.000=2.000
σ0.000
min1977.000-1975.000=2.000
max1977.000-1975.000=2.000
mean0.538-0.552=-0.014
σ0.032-0.034=-0.002
min0.508-0.501=0.007
max0.579-0.582=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.787-299.782=0.004
σ0.046-0.052=-0.005
min299.718-299.702=0.016
max299.832-299.835=-0.004
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean0.387-0.384=0.002
σ0.001-0.001=-0.000
min0.386-0.384=0.002
max0.387-0.386=0.001
iters=5
new-facts=1
prior-facts=6402
mean1310.203-1310.203=-0.001
σ0.080-0.092=-0.012
min1310.103-1310.086=0.016
max1310.315-1310.333=-0.018
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean1.869-1.902=-0.033
σ0.054-0.094=-0.041
min1.800-1.809=-0.009
max1.938-2.044=-0.106
iters=5
new-facts=6402
prior-facts=1
mean1554.315-1554.314=0.000
σ6.879-6.871=0.008
min1550.988-1551.021=-0.034
max1566.616-1566.601=0.015
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean2.210-2.320=-0.110
σ0.135-0.262=-0.127
min2.122-2.017=0.106
max2.441-2.684=-0.243
iters=5
new-facts=6402
prior-facts=6402
mean1872.098-1872.107=-0.008
σ0.046-0.051=-0.005
min1872.037-1872.039=-0.002
max1872.140-1872.158=-0.019
mean1770.600-1731.800=38.800
σ130.049-173.638=-43.589
min1659.000-1522.000=137.000
max1977.000-1975.000=2.000
mean2.918-2.798=0.121
σ0.074-0.167=-0.093
min2.848-2.638=0.211
max3.019-3.014=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.262-1.509=-0.247
σ0.280-0.363=-0.083
min0.949-0.961=-0.012
max1.558-1.835=-0.278

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.217-448.209=0.009
σ581.362-581.354=0.008
min157.528-157.528=0.001
max1320.260-1320.240=0.020
mean96.250
σ8.500
min92.000
max109.000
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean0.551-0.561=-0.010
σ0.579-0.597=-0.017
min0.260-0.261=-0.001
max1.420-1.455=-0.036
policies=20
mean1575.592-1575.564=0.027
σ0.339-0.337=0.002
min1575.389-1575.353=0.035
max1576.099-1576.068=0.031
mean920.000
σ0.000
min920.000
max920.000
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean2.630-2.621=0.010
σ0.015-0.015=-0.001
min2.610-2.606=0.004
max2.642-2.637=0.005
policies=200
mean15763.742-15763.452=0.290
σ0.105-0.149=-0.043
min15763.594-15763.301=0.293
max15763.844-15763.657=0.187
mean9200.000
σ0.000
min9200.000
max9200.000
mean1659.000-1512.000=147.000
σ0.000
min1659.000-1512.000=147.000
max1659.000-1512.000=147.000
mean26.685-26.578=0.107
σ0.209-0.149=0.061
min26.471-26.377=0.094
max26.964-26.693=0.270