Compare commits

Home / Compare 9692b373 .. d7780de0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.040-54.050=-0.009
σ0.370-0.369=0.001
min53.894-53.905=-0.010
max55.094-55.099=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.139=-0.000
σ0.003-0.003=0.000
min0.135-0.135=-0.000
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.343-43.341=0.002
σ0.006-0.005=0.002
min43.334-43.333=0.001
max43.357-43.349=0.009
mean414.600-417.000=-2.400
σ0.516-0.000=0.516
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.125-0.117=0.008
σ0.010-0.004=0.005
min0.115-0.114=0.001
max0.142-0.124=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.198-1017.201=-0.003
σ1.192-1.160=0.032
min1016.655-1016.627=0.028
max1022.196-1022.056=0.140
mean1052.850-1051.400=1.450
σ310.326-319.904=-9.578
min562.000-589.000=-27.000
max1510.000-1611.000=-101.000
mean1.559-1.546=0.013
σ0.054-0.095=-0.041
min1.472-1.462=0.010
max1.658-1.782=-0.124

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.035-301.904=0.131
σ0.248-0.253=-0.005
min301.778-301.642=0.136
max302.685-302.446=0.239
mean2042.000-2071.000=-29.000
σ0.000
min2042.000-2071.000=-29.000
max2042.000-2071.000=-29.000
mean0.580-0.582=-0.002
σ0.041-0.036=0.005
min0.499-0.505=-0.006
max0.612-0.608=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.782-303.781=0.001
σ0.061-0.065=-0.004
min303.684-303.678=0.005
max303.836-303.843=-0.006
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean0.393-0.394=-0.001
σ0.001-0.009=-0.007
min0.392-0.389=0.003
max0.395-0.409=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1326.328-1326.333=-0.005
σ0.106-0.106=0.000
min1326.199-1326.199=0.000
max1326.461-1326.463=-0.002
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean1.928-1.943=-0.015
σ0.146-0.107=0.040
min1.791-1.823=-0.032
max2.130-2.040=0.090
iters=5
new-facts=6402
prior-facts=1
mean1564.375-1564.464=-0.088
σ6.912-6.823=0.089
min1561.081-1561.268=-0.187
max1576.735-1576.666=0.070
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean2.297-2.394=-0.097
σ0.261-0.333=-0.072
min2.040-2.081=-0.041
max2.619-2.864=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean1894.277-1894.284=-0.007
σ0.068-0.073=-0.005
min1894.156-1894.155=0.001
max1894.316-1894.336=-0.020
mean1735.200-1796.600=-61.400
σ217.188-200.651=16.537
min1510.000-1611.000=-101.000
max2042.000-2071.000=-29.000
mean2.947-3.036=-0.089
σ0.114-0.125=-0.011
min2.879-2.882=-0.004
max3.150-3.223=-0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.515-1.349=0.166
σ0.276-0.318=-0.041
min1.217-1.036=0.181
max1.810-1.683=0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.051-448.339=-0.288
σ581.227-581.803=-0.576
min157.432-157.435=-0.003
max1319.891-1321.044=-1.153
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean0.551-0.517=0.035
σ0.563-0.511=0.052
min0.266-0.260=0.007
max1.396-1.284=0.112
policies=20
mean1574.599-1574.596=0.003
σ0.358-0.322=0.036
min1574.367-1574.404=-0.037
max1575.133-1575.078=0.056
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean2.649-2.609=0.040
σ0.042-0.015=0.027
min2.611-2.594=0.017
max2.707-2.629=0.078
policies=200
mean15754.092-15754.078=0.014
σ0.048-0.090=-0.043
min15754.041-15753.987=0.054
max15754.148-15754.189=-0.041
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1611.000=-101.000
σ0.000
min1510.000-1611.000=-101.000
max1510.000-1611.000=-101.000
mean26.849-26.520=0.328
σ0.172-0.186=-0.014
min26.716-26.315=0.400
max27.089-26.757=0.332