Compare commits

Home / Compare 3a9062d1 .. ac7e01a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.659=-0.004
σ0.368-0.365=0.003
min53.515-53.517=-0.002
max54.702-54.698=0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.137-0.154=-0.017
σ0.005-0.010=-0.005
min0.130-0.139=-0.010
max0.146-0.167=-0.021
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.001
σ0.005-0.008=-0.003
min42.974-42.968=0.006
max42.990-42.997=-0.007
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.122=0.001
σ0.004-0.004=-0.000
min0.118-0.115=0.003
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.971=-0.000
σ1.168-1.184=-0.016
min1013.414-1013.428=-0.014
max1018.862-1018.929=-0.066
mean1050.950-1052.600=-1.650
σ318.138-316.051=2.087
min584.000-601.000=-17.000
max1661.000-1657.000=4.000
mean1.614-1.622=-0.007
σ0.078-0.079=-0.001
min1.489-1.551=-0.062
max1.874-1.855=0.018

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.053-299.104=-0.051
σ0.225-0.233=-0.008
min298.922-298.928=-0.006
max299.675-299.746=-0.071
mean2082.000-2049.000=33.000
σ0.000
min2082.000-2049.000=33.000
max2082.000-2049.000=33.000
mean0.576-0.589=-0.013
σ0.032-0.018=0.014
min0.539-0.554=-0.015
max0.619-0.608=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.669-294.676=-0.007
σ0.023-0.017=0.006
min294.637-294.653=-0.015
max294.701-294.699=0.002
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean0.383-0.387=-0.005
σ0.001-0.007=-0.006
min0.381-0.380=0.001
max0.384-0.396=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1316.938-1316.945=-0.007
σ0.084-0.093=-0.008
min1316.893-1316.886=0.007
max1317.088-1317.106=-0.017
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean1.925-1.909=0.016
σ0.065-0.057=0.009
min1.857-1.849=0.008
max2.010-1.972=0.038
iters=5
new-facts=6402
prior-facts=1
mean1555.337-1555.277=0.060
σ6.882-6.868=0.014
min1552.047-1551.960=0.088
max1567.644-1567.557=0.087
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean2.451-2.246=0.205
σ0.372-0.207=0.165
min2.075-2.119=-0.045
max2.924-2.611=0.313
iters=5
new-facts=6402
prior-facts=6402
mean1884.774-1884.774=-0.001
σ0.025-0.038=-0.013
min1884.743-1884.740=0.003
max1884.810-1884.839=-0.028
mean1816.200-1791.000=25.200
σ184.526-171.009=13.517
min1661.000-1657.000=4.000
max2082.000-2049.000=33.000
mean2.999-2.953=0.046
σ0.138-0.105=0.032
min2.778-2.890=-0.112
max3.153-3.139=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.226=-0.014
σ0.316-0.314=0.002
min0.922-0.914=0.008
max1.740-1.714=0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.485-440.485=0.000
σ573.040-573.036=0.005
min153.962-153.961=0.001
max1300.046-1300.038=0.008
mean96.250
σ8.500
min92.000
max109.000
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean0.581-0.549=0.032
σ0.619-0.559=0.060
min0.270-0.269=0.001
max1.510-1.388=0.122
policies=20
mean1539.851-1539.846=0.006
σ0.302-0.313=-0.011
min1539.677-1539.661=0.015
max1540.303-1540.314=-0.011
mean920.000
σ0.000
min920.000
max920.000
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean2.596-2.593=0.003
σ0.018-0.010=0.008
min2.576-2.580=-0.004
max2.620-2.603=0.017
policies=200
mean15406.481-15406.497=-0.016
σ0.134-0.100=0.034
min15406.358-15406.406=-0.048
max15406.650-15406.585=0.065
mean9200.000
σ0.000
min9200.000
max9200.000
mean1661.000-1657.000=4.000
σ0.000
min1661.000-1657.000=4.000
max1661.000-1657.000=4.000
mean26.208-26.315=-0.107
σ0.170-0.177=-0.007
min26.016-26.140=-0.124
max26.403-26.485=-0.081