Compare commits

Home / Compare bfa52d1b .. d0154fd4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.835-53.835=-0.000
σ0.366-0.369=-0.004
min53.690-53.684=0.006
max54.875-54.885=-0.010
mean413.700-416.000=-2.300
σ0.483-0.000=0.483
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.138-0.137=0.001
σ0.003-0.006=-0.003
min0.135-0.129=0.006
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.006-0.005=0.001
min43.202-43.201=0.000
max43.216-43.213=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.117=0.004
σ0.003-0.003=0.000
min0.118-0.112=0.006
max0.127-0.121=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.207=-0.002
σ1.146-1.155=-0.009
min1015.632-1015.630=0.002
max1020.998-1021.040=-0.042
mean1040.100-1056.350=-16.250
σ311.089-308.579=2.511
min585.000-578.000=7.000
max1627.000-1510.000=117.000
mean1.527-1.511=0.016
σ0.118-0.055=0.063
min1.420-1.440=-0.020
max1.798-1.601=0.197

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.245-301.369=-0.125
σ0.240-0.254=-0.013
min301.095-301.181=-0.086
max301.905-302.062=-0.157
mean2034.000-2019.000=15.000
σ0.000
min2034.000-2019.000=15.000
max2034.000-2019.000=15.000
mean0.571-0.547=0.025
σ0.031-0.041=-0.010
min0.506-0.495=0.011
max0.603-0.606=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.465-301.476=-0.011
σ0.074-0.047=0.027
min301.339-301.401=-0.063
max301.527-301.521=0.006
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean0.396-0.396=0.000
σ0.010-0.007=0.003
min0.389-0.390=-0.000
max0.414-0.404=0.010
iters=5
new-facts=1
prior-facts=6402
mean1324.055-1324.063=-0.008
σ0.104-0.106=-0.001
min1323.922-1323.936=-0.013
max1324.186-1324.182=0.004
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean1.923-1.885=0.038
σ0.117-0.053=0.064
min1.814-1.838=-0.024
max2.109-1.956=0.153
iters=5
new-facts=6402
prior-facts=1
mean1562.107-1562.098=0.009
σ6.950-6.903=0.046
min1558.785-1558.807=-0.022
max1574.535-1574.443=0.091
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean2.425-2.408=0.017
σ0.409-0.337=0.072
min2.050-2.047=0.003
max3.000-2.841=0.159
iters=5
new-facts=6402
prior-facts=6402
mean1891.970-1891.974=-0.004
σ0.066-0.085=-0.019
min1891.853-1891.826=0.027
max1892.016-1892.044=-0.028
mean1767.800-1728.800=39.000
σ171.545-206.533=-34.988
min1627.000-1510.000=117.000
max2034.000-2019.000=15.000
mean2.891-3.023=-0.132
σ0.031-0.276=-0.245
min2.867-2.756=0.111
max2.946-3.452=-0.507

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.595=-0.388
σ0.216-0.261=-0.045
min1.021-1.212=-0.191
max1.555-1.852=-0.297

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.495-443.480=0.015
σ574.243-574.232=0.011
min156.368-156.362=0.005
max1304.858-1304.828=0.030
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean0.545-0.536=0.009
σ0.566-0.560=0.006
min0.258-0.246=0.013
max1.393-1.376=0.017
policies=20
mean1563.913-1563.909=0.004
σ0.317-0.354=-0.037
min1563.735-1563.693=0.042
max1564.388-1564.438=-0.050
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean2.601-2.650=-0.048
σ0.009-0.086=-0.076
min2.587-2.588=-0.000
max2.607-2.776=-0.169
policies=200
mean15646.833-15646.923=-0.089
σ0.450-0.064=0.386
min15646.160-15646.842=-0.682
max15647.098-15646.992=0.106
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1510.000=117.000
σ0.000
min1627.000-1510.000=117.000
max1627.000-1510.000=117.000
mean26.434-26.340=0.093
σ0.195-0.151=0.044
min26.262-26.198=0.064
max26.707-26.500=0.207