Compare commits

Home / Compare 4a5df4ba .. d1fc1a0a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.826-53.821=0.005
σ0.365-0.367=-0.002
min53.680-53.676=0.004
max54.864-54.865=-0.001
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.151-0.133=0.018
σ0.009-0.004=0.005
min0.133-0.130=0.003
max0.161-0.139=0.023
cache=y
dps=1
iters=10
policies=100
mean43.209-43.209=-0.000
σ0.005-0.007=-0.002
min43.201-43.199=0.002
max43.218-43.219=-0.001
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.123-0.123=-0.000
σ0.005-0.004=0.001
min0.116-0.119=-0.004
max0.132-0.132=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.181-1016.177=0.005
σ1.163-1.178=-0.015
min1015.605-1015.631=-0.026
max1021.044-1021.112=-0.068
mean1042.550-1055.350=-12.800
σ310.129-298.097=12.031
min597.000-583.000=14.000
max1633.000-1455.000=178.000
mean1.551-1.542=0.009
σ0.099-0.087=0.011
min1.468-1.373=0.095
max1.832-1.751=0.081

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.313-301.270=0.043
σ0.208-0.235=-0.028
min301.134-300.955=0.179
max301.845-301.695=0.150
mean2026.000-1963.000=63.000
σ0.000
min2026.000-1963.000=63.000
max2026.000-1963.000=63.000
mean0.557-0.559=-0.002
σ0.044-0.042=0.002
min0.504-0.503=0.001
max0.614-0.629=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.705-300.684=0.020
σ0.010-0.046=-0.036
min300.695-300.604=0.092
max300.722-300.717=0.005
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean0.397-0.396=0.001
σ0.008-0.006=0.003
min0.389-0.389=-0.000
max0.406-0.404=0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.865-1322.872=-0.007
σ0.103-0.094=0.009
min1322.810-1322.801=0.009
max1323.049-1323.031=0.018
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean1.964-1.920=0.043
σ0.114-0.095=0.018
min1.841-1.828=0.013
max2.092-2.050=0.042
iters=5
new-facts=6402
prior-facts=1
mean1561.302-1561.311=-0.009
σ6.903-6.882=0.021
min1557.975-1557.969=0.006
max1573.644-1573.615=0.029
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean2.307-2.367=-0.060
σ0.342-0.260=0.082
min2.087-2.116=-0.030
max2.914-2.717=0.196
iters=5
new-facts=6402
prior-facts=6402
mean1890.786-1890.799=-0.013
σ0.021-0.016=0.005
min1890.758-1890.784=-0.026
max1890.815-1890.824=-0.009
mean1768.600-1759.800=8.800
σ167.918-154.207=13.711
min1633.000-1532.000=101.000
max2026.000-1963.000=63.000
mean2.844-2.992=-0.148
σ0.120-0.124=-0.004
min2.745-2.861=-0.116
max3.028-3.175=-0.147

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.210-1.743=-0.533
σ0.327-0.120=0.207
min0.914-1.594=-0.680
max1.692-1.868=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.326-443.309=0.017
σ573.971-573.948=0.023
min156.339-156.329=0.010
max1304.282-1304.231=0.052
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean0.521-0.544=-0.023
σ0.524-0.571=-0.048
min0.257-0.256=0.001
max1.306-1.401=-0.094
policies=20
mean1563.603-1563.604=-0.001
σ0.326-0.344=-0.018
min1563.419-1563.407=0.012
max1564.091-1564.119=-0.028
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean2.598-2.634=-0.036
σ0.018-0.031=-0.014
min2.583-2.589=-0.006
max2.623-2.662=-0.040
policies=200
mean15644.083-15644.008=0.075
σ0.159-0.306=-0.147
min15643.949-15643.568=0.382
max15644.299-15644.272=0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1455.000=178.000
σ0.000
min1633.000-1455.000=178.000
max1633.000-1455.000=178.000
mean26.389-26.406=-0.017
σ0.143-0.106=0.036
min26.254-26.284=-0.029
max26.526-26.519=0.007