Compare commits

Home / Compare ef6e162a .. 35d7fab9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.834-53.836=-0.002
σ0.369-0.367=0.002
min53.690-53.691=-0.000
max54.883-54.879=0.004
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.135-0.139=-0.004
σ0.009-0.004=0.005
min0.116-0.136=-0.020
max0.146-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.209-43.210=-0.001
σ0.006-0.006=-0.000
min43.201-43.198=0.003
max43.217-43.218=-0.001
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.121-0.127=-0.006
σ0.005-0.011=-0.006
min0.115-0.115=0.000
max0.128-0.146=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.203-1016.207=-0.004
σ1.160-1.161=-0.001
min1015.628-1015.630=-0.002
max1021.059-1021.068=-0.009
mean1041.450-1044.200=-2.750
σ310.487-310.750=-0.262
min587.000-579.000=8.000
max1628.000-1631.000=-3.000
mean1.535-1.533=0.002
σ0.087-0.095=-0.008
min1.443-1.444=-0.002
max1.772-1.816=-0.044

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.297-301.216=0.081
σ0.236-0.242=-0.006
min301.158-301.038=0.120
max301.951-301.887=0.064
mean2039.000-1960.000=79.000
σ0.000
min2039.000-1960.000=79.000
max2039.000-1960.000=79.000
mean0.555-0.548=0.007
σ0.034-0.036=-0.002
min0.504-0.506=-0.001
max0.591-0.599=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.487-301.484=0.003
σ0.045-0.042=0.003
min301.419-301.418=0.001
max301.534-301.530=0.004
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean0.394-0.393=0.001
σ0.008-0.006=0.001
min0.388-0.387=0.001
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1324.057-1324.053=0.004
σ0.105-0.098=0.008
min1323.924-1323.926=-0.002
max1324.190-1324.172=0.019
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean1.910-1.934=-0.024
σ0.097-0.120=-0.023
min1.836-1.830=0.007
max2.076-2.142=-0.065
iters=5
new-facts=6402
prior-facts=1
mean1562.096-1562.101=-0.005
σ6.932-6.927=0.004
min1558.782-1558.754=0.028
max1574.491-1574.487=0.004
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean2.389-2.379=0.010
σ0.337-0.295=0.042
min2.059-2.126=-0.067
max2.897-2.851=0.046
iters=5
new-facts=6402
prior-facts=6402
mean1891.971-1891.971=0.000
σ0.062-0.075=-0.013
min1891.864-1891.844=0.020
max1892.011-1892.028=-0.017
mean1771.200-1763.200=8.000
σ173.901-137.812=36.089
min1628.000-1631.000=-3.000
max2039.000-1960.000=79.000
mean2.807-2.894=-0.088
σ0.104-0.077=0.027
min2.719-2.814=-0.096
max2.950-3.010=-0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.195=0.037
σ0.253-0.361=-0.108
min1.049-0.907=0.142
max1.665-1.750=-0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.494-443.490=0.004
σ574.242-574.249=-0.007
min156.368-156.361=0.007
max1304.857-1304.863=-0.006
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean0.530-0.534=-0.004
σ0.543-0.552=-0.009
min0.258-0.258=-0.000
max1.345-1.362=-0.017
policies=20
mean1563.916-1563.920=-0.003
σ0.319-0.317=0.002
min1563.738-1563.751=-0.013
max1564.395-1564.395=-0.000
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean2.597-2.606=-0.009
σ0.009-0.009=0.000
min2.591-2.596=-0.005
max2.611-2.618=-0.007
policies=200
mean15647.014-15646.906=0.108
σ0.062-0.104=-0.043
min15646.948-15646.771=0.178
max15647.070-15646.990=0.080
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1631.000=-3.000
σ0.000
min1628.000-1631.000=-3.000
max1628.000-1631.000=-3.000
mean26.249-26.271=-0.022
σ0.436-0.153=0.284
min25.629-26.095=-0.466
max26.647-26.452=0.196