Compare commits

Home / Compare 820b698d .. 8e5c27fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.369-0.369=-0.000
min53.876-53.867=0.009
max55.065-55.064=0.001
mean416.900-417.000=-0.100
σ0.316-0.000=0.316
min416.000-417.000=-1.000
max417.000
mean0.140-0.139=0.001
σ0.004-0.003=0.001
min0.133-0.136=-0.003
max0.146-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.007=-0.001
min43.314-43.313=0.000
max43.337-43.335=0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.120-0.124=-0.004
σ0.003-0.004=-0.001
min0.115-0.120=-0.005
max0.124-0.129=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.305=0.005
σ1.162-1.198=-0.036
min1005.741-1005.771=-0.030
max1011.177-1011.336=-0.159
mean1044.400-1047.550=-3.150
σ312.550-305.266=7.284
min577.000-587.000=-10.000
max1634.000-1638.000=-4.000
mean1.564-1.558=0.006
σ0.094-0.070=0.024
min1.473-1.492=-0.020
max1.833-1.746=0.087

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.408-0.396=0.012
σ0.136-0.103=0.033
min0.327-0.337=-0.010
max0.649-0.578=0.072
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.890-0.893=-0.003
σ0.088-0.086=0.002
min0.838-0.837=0.001
max1.047-1.045=0.002
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.544-0.545=-0.002
σ0.054-0.047=0.007
min0.512-0.504=0.008
max0.639-0.621=0.018
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.850-0.849=0.001
σ0.039-0.036=0.003
min0.825-0.825=-0.000
max0.919-0.912=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.001
σ0.035-0.032=0.003
min964.086-964.087=-0.001
max964.173-964.167=0.006
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.832-0.838=-0.007
σ0.043-0.027=0.016
min0.765-0.791=-0.026
max0.867-0.858=0.009
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.000
σ0.008-0.007=0.001
min884.703-884.705=-0.001
max884.723-884.721=0.002
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.683-0.706=-0.023
σ0.073-0.042=0.031
min0.595-0.663=-0.068
max0.742-0.759=-0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.722=-0.004
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean4.261-4.246=0.015
σ0.102-0.090=0.013
min4.103-4.117=-0.014
max4.732-4.611=0.121
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean4.211-4.244=-0.033
σ0.086-0.077=0.009
min4.065-4.132=-0.067
max4.467-4.525=-0.058
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.742-0.743=-0.000
σ0.020-0.027=-0.007
min0.719-0.533=0.187
max0.895-0.824=0.071
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.705-0.698=0.007
σ0.016-0.014=0.001
min0.671-0.670=0.002
max0.791-0.784=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-296.273=0.051
σ0.165-0.220=-0.055
min296.191-296.125=0.066
max296.751-296.875=-0.124
mean1899.000-1907.000=-8.000
σ0.000
min1899.000-1907.000=-8.000
max1899.000-1907.000=-8.000
mean0.603-0.597=0.005
σ0.016-0.024=-0.008
min0.574-0.563=0.011
max0.635-0.654=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.697=-0.004
σ0.038-0.035=0.003
min284.640-284.656=-0.015
max284.732-284.738=-0.006
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.398-0.396=0.001
σ0.009-0.011=-0.002
min0.389-0.384=0.005
max0.407-0.405=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1295.080=-0.009
σ0.107-0.109=-0.001
min1294.946-1294.961=-0.015
max1295.213-1295.214=-0.001
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean2.008-1.909=0.098
σ0.122-0.083=0.040
min1.833-1.816=0.016
max2.168-2.002=0.166
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.190=0.016
σ6.839-6.865=-0.026
min1535.958-1535.936=0.022
max1551.437-1551.466=-0.029
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean2.155-2.274=-0.120
σ0.139-0.247=-0.108
min2.043-2.027=0.016
max2.391-2.542=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.991=-0.010
σ0.052-0.056=-0.004
min1856.936-1856.925=0.011
max1857.058-1857.067=-0.009
mean1779.600-1775.200=4.400
σ125.532-131.336=-5.804
min1634.000-1638.000=-4.000
max1899.000-1907.000=-8.000
mean2.987-3.093=-0.107
σ0.099-0.423=-0.324
min2.832-2.763=0.069
max3.107-3.826=-0.719

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.241=-0.018
σ0.212-0.326=-0.113
min0.954-0.931=0.023
max1.511-1.717=-0.207

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.001
σ581.213-581.212=0.000
min157.179-157.178=0.001
max1319.604-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean0.543-0.540=0.004
σ0.566-0.556=0.010
min0.254-0.259=-0.004
max1.393-1.374=0.019
policies=20
mean1572.103-1572.088=0.015
σ0.355-0.342=0.013
min1571.863-1571.867=-0.004
max1572.630-1572.598=0.033
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean2.631-2.627=0.004
σ0.009-0.022=-0.013
min2.622-2.611=0.012
max2.639-2.658=-0.019
policies=200
mean15729.033-15728.995=0.038
σ0.047-0.189=-0.142
min15728.976-15728.834=0.142
max15729.077-15729.260=-0.183
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1638.000=-4.000
σ0.000
min1634.000-1638.000=-4.000
max1634.000-1638.000=-4.000
mean26.501-26.452=0.049
σ0.032-0.011=0.021
min26.459-26.440=0.019
max26.535-26.465=0.070