Compare commits

Home / Compare fd6e92fb .. 7cb1f594

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.822=-0.000
σ0.370-0.366=0.003
min53.681-53.685=-0.004
max54.874-54.865=0.010
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.138=-0.001
σ0.003-0.004=-0.001
min0.130-0.130=-0.000
max0.143-0.143=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.206=0.002
σ0.007-0.004=0.003
min43.198-43.199=-0.002
max43.221-43.213=0.008
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.121=-0.000
σ0.004-0.005=-0.000
min0.114-0.114=-0.000
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.197-1016.199=-0.002
σ1.160-1.178=-0.018
min1015.624-1015.627=-0.002
max1021.051-1021.133=-0.082
mean1048.450-1050.350=-1.900
σ315.005-312.383=2.621
min563.000-557.000=6.000
max1671.000-1517.000=154.000
mean1.541-1.542=-0.002
σ0.054-0.060=-0.006
min1.491-1.435=0.056
max1.651-1.649=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.315-301.268=0.047
σ0.202-0.233=-0.031
min301.165-301.056=0.109
max301.870-301.895=-0.025
mean2020.000-2030.000=-10.000
σ0.000
min2020.000-2030.000=-10.000
max2020.000-2030.000=-10.000
mean0.559-0.558=0.001
σ0.032-0.025=0.007
min0.512-0.512=0.000
max0.599-0.583=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.727-300.720=0.007
σ0.023-0.022=0.000
min300.706-300.687=0.019
max300.763-300.745=0.018
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean0.395-0.396=-0.000
σ0.006-0.006=0.000
min0.389-0.389=-0.000
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1322.888-1322.895=-0.007
σ0.101-0.100=0.001
min1322.836-1322.838=-0.003
max1323.069-1323.071=-0.003
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean1.926-1.908=0.018
σ0.121-0.107=0.014
min1.826-1.776=0.050
max2.087-2.069=0.018
iters=5
new-facts=6402
prior-facts=1
mean1561.321-1561.332=-0.010
σ6.890-6.909=-0.018
min1557.980-1558.001=-0.021
max1573.642-1573.685=-0.043
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean2.217-2.277=-0.060
σ0.261-0.302=-0.041
min2.073-2.115=-0.042
max2.680-2.816=-0.136
iters=5
new-facts=6402
prior-facts=6402
mean1890.809-1890.809=0.001
σ0.018-0.018=0.000
min1890.789-1890.784=0.006
max1890.836-1890.833=0.003
mean1782.800-1739.000=43.800
σ150.501-216.639=-66.138
min1671.000-1517.000=154.000
max2020.000-2030.000=-10.000
mean2.913-2.944=-0.031
σ0.059-0.107=-0.049
min2.872-2.874=-0.001
max3.013-3.135=-0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.096-1.510=-0.414
σ0.266-0.274=-0.008
min0.914-1.070=-0.156
max1.502-1.738=-0.236

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.098-443.085=0.012
σ573.410-573.401=0.010
min156.379-156.379=-0.000
max1303.213-1303.186=0.027
mean96.250
σ8.500
min92.000
max109.000
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean0.547-0.558=-0.011
σ0.566-0.591=-0.026
min0.262-0.258=0.004
max1.396-1.445=-0.049
policies=20
mean1564.091-1564.081=0.010
σ0.312-0.347=-0.034
min1563.920-1563.867=0.054
max1564.559-1564.599=-0.040
mean920.000
σ0.000
min920.000
max920.000
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean2.609-2.641=-0.032
σ0.017-0.026=-0.008
min2.591-2.622=-0.031
max2.631-2.679=-0.048
policies=200
mean15648.581-15648.581=-0.000
σ0.147-0.158=-0.011
min15648.458-15648.476=-0.018
max15648.792-15648.812=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1671.000-1517.000=154.000
σ0.000
min1671.000-1517.000=154.000
max1671.000-1517.000=154.000
mean26.545-26.579=-0.034
σ0.178-0.194=-0.016
min26.352-26.352=0.000
max26.733-26.792=-0.060