Compare commits

Home / Compare f9d51f3f .. c6c8723e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.835=0.001
σ0.369-0.368=0.001
min53.690-53.696=-0.006
max54.885-54.882=0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.139-0.140=-0.001
σ0.006-0.004=0.002
min0.134-0.136=-0.003
max0.150-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.004-0.006=-0.002
min43.201-43.200=0.001
max43.216-43.222=-0.006
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.123=-0.002
σ0.004-0.005=-0.001
min0.116-0.119=-0.003
max0.129-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.210=-0.006
σ1.175-1.164=0.011
min1015.646-1015.631=0.015
max1021.126-1021.077=0.049
mean1051.200-1047.500=3.700
σ311.451-310.560=0.891
min559.000-557.000=2.000
max1516.000-1511.000=5.000
mean1.521-1.522=-0.001
σ0.058-0.063=-0.004
min1.461-1.452=0.009
max1.646-1.636=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.228-301.376=-0.148
σ0.224-0.237=-0.013
min301.056-301.200=-0.144
max301.826-302.013=-0.187
mean2036.000-1945.000=91.000
σ0.000
min2036.000-1945.000=91.000
max2036.000-1945.000=91.000
mean0.547-0.561=-0.014
σ0.038-0.032=0.005
min0.499-0.504=-0.005
max0.581-0.601=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.481-301.482=-0.002
σ0.052-0.042=0.010
min301.401-301.418=-0.016
max301.530-301.521=0.009
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean0.393-0.393=-0.001
σ0.002-0.006=-0.004
min0.391-0.389=0.002
max0.396-0.401=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1324.073-1324.064=0.010
σ0.121-0.109=0.012
min1323.930-1323.926=0.005
max1324.214-1324.198=0.015
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean1.866-1.906=-0.040
σ0.071-0.086=-0.015
min1.801-1.822=-0.022
max1.979-2.026=-0.047
iters=5
new-facts=6402
prior-facts=1
mean1562.084-1562.089=-0.005
σ6.904-6.934=-0.030
min1558.776-1558.741=0.035
max1574.429-1574.485=-0.056
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean2.291-2.374=-0.084
σ0.234-0.332=-0.098
min2.014-2.073=-0.059
max2.590-2.854=-0.264
iters=5
new-facts=6402
prior-facts=6402
mean1891.967-1891.979=-0.012
σ0.066-0.080=-0.014
min1891.851-1891.837=0.014
max1892.012-1892.026=-0.014
mean1749.800-1776.200=-26.400
σ215.037-161.486=53.551
min1516.000-1520.000=-4.000
max2036.000-1945.000=91.000
mean2.921-2.997=-0.076
σ0.162-0.135=0.027
min2.705-2.878=-0.174
max3.106-3.223=-0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.549-1.617=-0.068
σ0.271-0.180=0.090
min1.243-1.330=-0.087
max1.851-1.760=0.091

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.483-443.479=0.005
σ574.236-574.233=0.002
min156.362-156.361=0.001
max1304.837-1304.829=0.008
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean0.544-0.541=0.003
σ0.559-0.569=-0.010
min0.261-0.251=0.010
max1.383-1.395=-0.011
policies=20
mean1563.907-1563.901=0.006
σ0.341-0.346=-0.005
min1563.693-1563.672=0.021
max1564.416-1564.416=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean2.618-2.619=-0.001
σ0.010-0.010=-0.000
min2.608-2.609=-0.001
max2.630-2.632=-0.003
policies=200
mean15646.915-15646.914=0.000
σ0.105-0.053=0.052
min15646.800-15646.853=-0.052
max15647.029-15646.973=0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1511.000=5.000
σ0.000
min1516.000-1511.000=5.000
max1516.000-1511.000=5.000
mean26.504-26.479=0.025
σ0.146-0.149=-0.003
min26.380-26.305=0.074
max26.696-26.661=0.035