Compare commits

Home / Compare 08be61c8 .. 0ed9da55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.646=0.065
σ0.363-0.366=-0.003
min53.574-53.517=0.057
max54.742-54.688=0.054
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.146-0.136=0.010
σ0.012-0.005=0.007
min0.135-0.129=0.006
max0.167-0.146=0.021
cache=y
dps=1
iters=10
policies=100
mean42.979-42.942=0.036
σ0.005-0.007=-0.003
min42.970-42.931=0.039
max42.984-42.954=0.030
mean415.000-413.800=1.200
σ0.000-0.422=-0.422
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.124-0.120=0.003
σ0.008-0.005=0.003
min0.117-0.115=0.003
max0.142-0.130=0.012

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.531-991.869=25.662
σ1.219-1.215=0.004
min1017.002-991.333=25.669
max1022.643-996.960=25.683
mean1049.700-1060.750=-11.050
σ308.288-317.891=-9.603
min594.000-589.000=5.000
max1562.000-1550.000=12.000
mean1.573-1.515=0.058
σ0.099-0.077=0.022
min1.491-1.380=0.111
max1.832-1.650=0.182

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean337.527
σ0.196
min337.375
max338.070
mean2113.000
σ0.000
min2113.000
max2113.000
mean0.739
σ0.035
min0.713
max0.828

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.589-285.436=12.152
σ0.007-0.011=-0.005
min297.581-285.418=12.163
max297.595-285.449=12.147
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean0.391-0.377=0.014
σ0.006-0.001=0.005
min0.386-0.375=0.011
max0.397-0.378=0.019
iters=5
new-facts=1
prior-facts=6402
mean1320.551-1285.504=35.047
σ0.097-0.084=0.012
min1320.379-1285.355=35.024
max1320.605-1285.559=35.045
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean1.873-1.945=-0.072
σ0.052-0.082=-0.030
min1.829-1.816=0.013
max1.962-2.024=-0.062
iters=5
new-facts=6402
prior-facts=1
mean1740.715-1705.829=34.886
σ6.904-6.847=0.057
min1737.535-1702.653=34.882
max1753.062-1718.074=34.988
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean2.937-2.986=-0.049
σ0.354-0.194=0.160
min2.625-2.826=-0.202
max3.524-3.251=0.273
iters=5
new-facts=6402
prior-facts=6402
mean2003.481-1968.403=35.078
σ0.015-0.047=-0.032
min2003.462-1968.329=35.133
max2003.497-1968.439=35.058
mean1837.800-1790.400=47.400
σ222.981-188.654=34.327
min1565.000-1550.000=15.000
max2113.000-2025.000=88.000
mean3.267-3.265=0.002
σ0.115-0.440=-0.325
min3.083-2.938=0.145
max3.364-4.038=-0.674

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.477-1.514=-0.037
σ0.392-0.247=0.146
min0.916-1.217=-0.301
max1.805-1.825=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.093-436.770=4.322
σ573.032-572.351=0.681
min154.569-150.589=3.980
max1300.640-1295.296=5.344
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean0.562-0.527=0.034
σ0.590-0.550=0.040
min0.262-0.250=0.012
max1.447-1.353=0.095
policies=20
mean1546.030-1506.156=39.874
σ0.342-0.230=0.112
min1545.817-1506.011=39.806
max1546.539-1506.499=40.040
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean2.627-2.509=0.117
σ0.015-0.017=-0.002
min2.612-2.494=0.119
max2.642-2.534=0.108
policies=200
mean15468.231-15069.464=398.766
σ0.046-0.112=-0.066
min15468.184-15069.332=398.852
max15468.271-15069.589=398.682
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1562.000-1550.000=12.000
σ0.000
min1562.000-1550.000=12.000
max1562.000-1550.000=12.000
mean26.563-25.539=1.023
σ0.204-0.225=-0.021
min26.389-25.376=1.013
max26.858-25.864=0.994