Compare commits

Home / Compare 1ab3cc7c .. b821c77f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.836=0.001
σ0.368-0.366=0.003
min53.690-53.695=-0.005
max54.885-54.876=0.008
mean416.700-414.000=2.700
σ0.483-0.000=0.483
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.139-0.138=0.001
σ0.004-0.004=0.000
min0.135-0.135=0.000
max0.145-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.209-43.209=-0.000
σ0.007-0.007=-0.000
min43.197-43.199=-0.002
max43.222-43.220=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.121=0.000
σ0.004-0.004=-0.001
min0.118-0.118=0.000
max0.128-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.202=0.003
σ1.180-1.186=-0.005
min1015.629-1015.657=-0.029
max1021.147-1021.172=-0.025
mean1048.400-1051.350=-2.950
σ311.325-313.333=-2.008
min555.000-587.000=-32.000
max1512.000-1633.000=-121.000
mean1.545-1.558=-0.013
σ0.056-0.088=-0.033
min1.433-1.418=0.015
max1.669-1.805=-0.136

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.377-301.329=0.048
σ0.229-0.246=-0.018
min301.171-301.164=0.007
max301.984-302.006=-0.022
mean2022.000-2041.000=-19.000
σ0.000
min2022.000-2041.000=-19.000
max2022.000-2041.000=-19.000
mean0.560-0.583=-0.024
σ0.037-0.036=0.001
min0.502-0.513=-0.011
max0.598-0.612=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.483-301.466=0.017
σ0.043-0.065=-0.022
min301.417-301.367=0.050
max301.531-301.530=0.001
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean0.396-0.391=0.006
σ0.006-0.000=0.006
min0.391-0.390=0.001
max0.407-0.391=0.016
iters=5
new-facts=1
prior-facts=6402
mean1324.042-1324.053=-0.011
σ0.096-0.102=-0.006
min1323.925-1323.927=-0.002
max1324.182-1324.195=-0.013
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean1.862-1.912=-0.051
σ0.064-0.110=-0.046
min1.813-1.829=-0.016
max1.967-2.099=-0.133
iters=5
new-facts=6402
prior-facts=1
mean1562.076-1562.065=0.012
σ6.935-6.909=0.026
min1558.751-1558.774=-0.023
max1574.477-1574.418=0.059
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean2.328-2.269=0.059
σ0.261-0.219=0.041
min2.123-2.078=0.045
max2.782-2.604=0.178
iters=5
new-facts=6402
prior-facts=6402
mean1891.987-1891.977=0.010
σ0.083-0.072=0.011
min1891.846-1891.850=-0.004
max1892.068-1892.021=0.047
mean1710.200-1773.800=-63.600
σ211.228-172.545=38.683
min1512.000-1633.000=-121.000
max2022.000-2041.000=-19.000
mean2.904-2.871=0.032
σ0.047-0.040=0.007
min2.862-2.806=0.056
max2.983-2.914=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.451-1.120=0.330
σ0.305-0.248=0.057
min1.039-0.915=0.124
max1.741-1.481=0.260

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.931-443.937=-0.006
σ575.137-575.138=-0.001
min156.360-156.367=-0.007
max1306.637-1306.644=-0.007
mean96.250
σ8.500
min92.000
max109.000
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean0.545-0.539=0.006
σ0.562-0.549=0.013
min0.262-0.263=-0.001
max1.388-1.362=0.025
policies=20
mean1563.893-1563.928=-0.035
σ0.341-0.342=-0.002
min1563.674-1563.731=-0.057
max1564.402-1564.441=-0.039
mean920.000
σ0.000
min920.000
max920.000
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean2.624-2.641=-0.016
σ0.010-0.017=-0.007
min2.609-2.621=-0.012
max2.632-2.659=-0.026
policies=200
mean15646.954-15646.913=0.041
σ0.113-0.123=-0.010
min15646.806-15646.779=0.027
max15647.072-15647.052=0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000-1633.000=-121.000
σ0.000
min1512.000-1633.000=-121.000
max1512.000-1633.000=-121.000
mean26.620-26.724=-0.105
σ0.167-0.192=-0.024
min26.474-26.474=0.000
max26.806-26.877=-0.072