Compare commits

Home / Compare f180aa12 .. 09d94652

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.656-53.709=-0.053
σ0.370-0.364=0.006
min53.513-53.577=-0.064
max54.708-54.745=-0.037
mean416.000-418.900=-2.900
σ0.000-0.316=-0.316
min416.000-418.000=-2.000
max416.000-419.000=-3.000
mean0.138-0.138=-0.000
σ0.007-0.003=0.004
min0.130-0.134=-0.004
max0.155-0.145=0.011
cache=y
dps=1
iters=10
policies=100
mean42.981-42.978=0.003
σ0.006-0.005=0.001
min42.974-42.970=0.004
max42.990-42.987=0.003
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.000
min0.115-0.114=0.001
max0.128-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.679-1017.530=-3.851
σ1.250-1.211=0.040
min1013.106-1016.993=-3.887
max1018.943-1022.597=-3.655
mean1062.800-1058.550=4.250
σ317.407-312.682=4.725
min599.000-596.000=3.000
max1657.000-1517.000=140.000
mean1.639-1.565=0.074
σ0.081-0.081=0.000
min1.553-1.498=0.054
max1.851-1.855=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean334.172-337.361=-3.189
σ0.241-0.276=-0.034
min334.001-337.180=-3.178
max334.835-338.114=-3.278
mean1963.000-2109.000=-146.000
σ0.000
min1963.000-2109.000=-146.000
max1963.000-2109.000=-146.000
mean0.825-0.783=0.043
σ0.051-0.055=-0.004
min0.754-0.706=0.048
max0.894-0.849=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.412-297.586=-3.174
σ0.015-0.008=0.007
min294.392-297.575=-3.183
max294.431-297.598=-3.167
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean0.383-0.392=-0.009
σ0.005-0.009=-0.005
min0.379-0.385=-0.006
max0.391-0.409=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1316.731-1320.546=-3.815
σ0.093-0.076=0.017
min1316.565-1320.417=-3.851
max1316.779-1320.601=-3.822
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean1.917-1.955=-0.039
σ0.056-0.098=-0.042
min1.847-1.875=-0.028
max1.990-2.125=-0.135
iters=5
new-facts=6402
prior-facts=1
mean1736.953-1740.706=-3.753
σ6.900-6.935=-0.035
min1733.766-1737.507=-3.741
max1749.293-1753.108=-3.815
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean3.047-3.180=-0.132
σ0.408-0.185=0.223
min2.670-3.028=-0.358
max3.701-3.494=0.207
iters=5
new-facts=6402
prior-facts=6402
mean1999.609-2003.482=-3.873
σ0.042-0.013=0.030
min1999.554-2003.469=-3.915
max1999.664-2003.499=-3.835
mean1779.600-1837.800=-58.200
σ134.368-211.508=-77.140
min1657.000-1565.000=92.000
max1963.000-2109.000=-146.000
mean3.180-3.252=-0.072
σ0.060-0.077=-0.017
min3.129-3.149=-0.019
max3.281-3.346=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.168-1.533=-0.365
σ0.301-0.267=0.034
min0.915-1.181=-0.266
max1.664-1.804=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.085-441.092=-0.007
σ573.042-573.031=0.011
min154.562-154.567=-0.005
max1300.648-1300.638=0.010
mean94.250
σ8.500
min90.000
max107.000
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean0.519-0.554=-0.035
σ0.516-0.553=-0.037
min0.259-0.264=-0.006
max1.293-1.383=-0.090
policies=20
mean1545.938-1546.041=-0.103
σ0.336-0.345=-0.009
min1545.751-1545.812=-0.062
max1546.442-1546.554=-0.112
mean900.000
σ0.000
min900.000
max900.000
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean2.632-2.629=0.003
σ0.023-0.024=-0.002
min2.614-2.600=0.014
max2.665-2.658=0.007
policies=200
mean15467.085-15468.286=-1.202
σ0.032-0.035=-0.004
min15467.046-15468.244=-1.198
max15467.123-15468.324=-1.201
mean9000.000
σ0.000
min9000.000
max9000.000
mean1657.000-1517.000=140.000
σ0.000
min1657.000-1517.000=140.000
max1657.000-1517.000=140.000
mean26.672-26.653=0.019
σ0.083-0.101=-0.018
min26.597-26.570=0.027
max26.778-26.785=-0.007