Compare commits

Home / Compare 71182c15 .. 4f64a31a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.653=0.000
σ0.366-0.367=-0.001
min53.516-53.510=0.006
max54.695-54.697=-0.002
mean414.900-418.000=-3.100
σ0.316-0.000=0.316
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.138-0.138=-0.000
σ0.003-0.004=-0.001
min0.134-0.131=0.003
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.981-42.979=0.002
σ0.006-0.006=-0.001
min42.974-42.970=0.004
max42.990-42.989=0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.119=0.002
σ0.003-0.004=-0.000
min0.116-0.114=0.002
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.972=-0.002
σ1.167-1.167=0.001
min1013.428-1013.417=0.010
max1018.855-1018.856=-0.001
mean1052.550-1050.800=1.750
σ318.028-317.722=0.305
min586.000-585.000=1.000
max1659.000-1655.000=4.000
mean1.633-1.618=0.015
σ0.095-0.080=0.014
min1.562-1.473=0.089
max1.884-1.849=0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.087-299.029=0.058
σ0.279-0.224=0.055
min298.908-298.856=0.051
max299.862-299.628=0.234
mean2044.000-1939.000=105.000
σ0.000
min2044.000-1939.000=105.000
max2044.000-1939.000=105.000
mean0.587-0.598=-0.011
σ0.023-0.041=-0.018
min0.554-0.551=0.003
max0.621-0.697=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.681-294.682=-0.001
σ0.016-0.017=-0.001
min294.660-294.662=-0.002
max294.706-294.707=-0.002
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean0.385-0.389=-0.004
σ0.007-0.006=0.001
min0.380-0.382=-0.002
max0.396-0.397=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1316.940-1316.929=0.011
σ0.097-0.112=-0.015
min1316.891-1316.820=0.071
max1317.114-1317.117=-0.003
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean1.945-2.000=-0.055
σ0.084-0.094=-0.010
min1.858-1.902=-0.044
max2.034-2.158=-0.124
iters=5
new-facts=6402
prior-facts=1
mean1555.289-1555.320=-0.031
σ6.866-6.847=0.020
min1551.994-1552.014=-0.020
max1567.566-1567.563=0.003
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean2.314-2.407=-0.093
σ0.247-0.235=0.012
min2.108-2.151=-0.044
max2.725-2.678=0.047
iters=5
new-facts=6402
prior-facts=6402
mean1884.777-1884.783=-0.007
σ0.025-0.037=-0.012
min1884.750-1884.758=-0.008
max1884.818-1884.848=-0.030
mean1800.400-1784.600=15.800
σ166.844-144.682=22.162
min1659.000-1655.000=4.000
max2044.000-1939.000=105.000
mean3.072-3.318=-0.246
σ0.256-0.460=-0.204
min2.897-2.872=0.025
max3.516-3.827=-0.311

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.184=-0.022
σ0.214-0.296=-0.082
min0.919-0.908=0.012
max1.489-1.625=-0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.568-440.570=-0.001
σ573.035-573.035=-0.000
min154.045-154.046=-0.001
max1300.121-1300.122=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean0.539-0.573=-0.034
σ0.541-0.594=-0.052
min0.268-0.273=-0.005
max1.351-1.464=-0.113
policies=20
mean1540.718-1540.695=0.023
σ0.327-0.316=0.011
min1540.526-1540.513=0.013
max1541.208-1541.168=0.040
mean920.000
σ0.000
min920.000
max920.000
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean2.615-2.597=0.018
σ0.030-0.024=0.006
min2.587-2.582=0.004
max2.655-2.632=0.023
policies=200
mean15414.972-15414.841=0.130
σ0.164-0.067=0.097
min15414.838-15414.763=0.075
max15415.196-15414.926=0.270
mean9200.000
σ0.000
min9200.000
max9200.000
mean1659.000-1655.000=4.000
σ0.000
min1659.000-1655.000=4.000
max1659.000-1655.000=4.000
mean26.231-26.221=0.010
σ0.114-0.148=-0.035
min26.069-26.084=-0.015
max26.312-26.354=-0.042