Compare commits

Home / Compare 5c5edc98 .. a41055b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=-0.000
σ0.369-0.367=0.001
min53.519-53.514=0.005
max54.703-54.699=0.003
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.139-0.139=0.000
σ0.004-0.006=-0.002
min0.135-0.131=0.004
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.982-42.983=-0.001
σ0.007-0.006=0.001
min42.974-42.974=0.000
max42.994-42.993=0.001
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.122-0.120=0.002
σ0.003-0.004=-0.001
min0.119-0.114=0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.980-1013.972=0.009
σ1.162-1.189=-0.027
min1013.430-1013.426=0.004
max1018.833-1018.926=-0.093
mean1053.650-1048.250=5.400
σ315.457-294.429=21.029
min603.000
max1655.000-1437.000=218.000
mean1.618-1.632=-0.014
σ0.063-0.101=-0.038
min1.557-1.531=0.026
max1.796-1.984=-0.188

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.198-299.014=0.184
σ0.183-0.225=-0.042
min299.055-298.844=0.211
max299.709-299.619=0.090
mean1964.000-1920.000=44.000
σ0.000
min1964.000-1920.000=44.000
max1964.000-1920.000=44.000
mean0.572-0.605=-0.033
σ0.025-0.045=-0.020
min0.538-0.540=-0.002
max0.600-0.689=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.683=-0.006
σ0.019-0.018=0.001
min294.652-294.659=-0.007
max294.705-294.709=-0.005
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean0.388-0.387=0.001
σ0.007-0.008=-0.001
min0.382-0.378=0.004
max0.398-0.397=0.001
iters=5
new-facts=1
prior-facts=6402
mean1316.943-1316.929=0.014
σ0.097-0.098=-0.001
min1316.891-1316.850=0.041
max1317.117-1317.098=0.018
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean1.897-2.008=-0.110
σ0.071-0.092=-0.021
min1.828-1.924=-0.096
max1.983-2.163=-0.181
iters=5
new-facts=6402
prior-facts=1
mean1555.287-1555.325=-0.038
σ6.891-6.851=0.040
min1551.959-1552.040=-0.081
max1567.608-1567.576=0.031
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean2.268-2.418=-0.149
σ0.293-0.209=0.084
min2.087-2.229=-0.141
max2.786-2.697=0.089
iters=5
new-facts=6402
prior-facts=6402
mean1884.781-1884.780=0.001
σ0.027-0.041=-0.014
min1884.764-1884.734=0.031
max1884.827-1884.846=-0.019
mean1745.200-1740.600=4.600
σ136.899-187.312=-50.414
min1655.000-1490.000=165.000
max1964.000-1920.000=44.000
mean2.953-3.183=-0.230
σ0.130-0.356=-0.227
min2.853-2.882=-0.030
max3.118-3.737=-0.620

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.156-1.717=-0.562
σ0.283-0.152=0.131
min0.910-1.557=-0.647
max1.618-1.921=-0.303

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.665=0.015
σ573.413-573.395=0.018
min153.966-153.964=0.002
max1300.799-1300.757=0.042
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean0.565-0.560=0.005
σ0.596-0.584=0.012
min0.264-0.266=-0.002
max1.459-1.436=0.023
policies=20
mean1539.881-1539.874=0.007
σ0.260-0.305=-0.045
min1539.724-1539.672=0.051
max1540.269-1540.328=-0.059
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean2.596-2.573=0.023
σ0.026-0.014=0.013
min2.571-2.554=0.017
max2.625-2.584=0.041
policies=200
mean15406.997-15407.037=-0.040
σ0.103-0.100=0.003
min15406.879-15406.913=-0.034
max15407.109-15407.150=-0.041
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1437.000=218.000
σ0.000
min1655.000-1437.000=218.000
max1655.000-1437.000=218.000
mean26.310-26.144=0.166
σ0.124-0.170=-0.045
min26.154-26.044=0.110
max26.421-26.397=0.024