Compare commits

Home / Compare 2132e209 .. cb34ad14

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-54.015=-0.051
σ0.370-0.368=0.002
min53.819-53.874=-0.055
max55.016-55.062=-0.046
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.139-0.138=0.001
σ0.004-0.004=-0.000
min0.135-0.134=0.001
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.008-0.008=-0.001
min43.311-43.310=0.001
max43.337-43.341=-0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.121=0.002
σ0.004-0.006=-0.002
min0.119-0.115=0.003
max0.130-0.135=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.307=0.214
σ1.150-1.171=-0.021
min1005.948-1005.776=0.172
max1011.327-1011.211=0.115
mean1063.600-1052.850=10.750
σ319.707-319.902=-0.194
min551.000-595.000=-44.000
max1521.000-1622.000=-101.000
mean1.522-1.566=-0.043
σ0.051-0.087=-0.036
min1.460-1.484=-0.024
max1.607-1.854=-0.247

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.422-0.477=-0.055
σ0.139-0.173=-0.034
min0.330-0.340=-0.010
max0.667-0.673=-0.006
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.888-0.895=-0.007
σ0.101-0.137=-0.036
min0.819-0.823=-0.004
max1.066-1.139=-0.073
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.534-0.532=0.002
σ0.053-0.048=0.005
min0.494-0.500=-0.006
max0.624-0.614=0.010
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.842-0.841=0.001
σ0.044-0.033=0.011
min0.805-0.820=-0.015
max0.917-0.899=0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.114=0.715
σ0.028-0.038=-0.009
min964.806-964.089=0.716
max964.878-964.179=0.698
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.842-0.812=0.030
σ0.026-0.055=-0.029
min0.812-0.724=0.088
max0.874-0.864=0.009
name=cdr_enhanced_4k_loc.art
mean885.509-884.712=0.797
σ0.004-0.009=-0.004
min885.504-884.703=0.801
max885.514-884.725=0.789
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.694-0.701=-0.008
σ0.065-0.057=0.008
min0.589-0.604=-0.015
max0.738-0.738=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.720-7.719=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean4.232-4.239=-0.007
σ0.085-0.093=-0.008
min4.091-4.110=-0.019
max4.554-4.651=-0.097
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean4.188-4.210=-0.022
σ0.072-0.069=0.002
min4.082-4.089=-0.007
max4.463-4.446=0.017
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.747-0.732=0.015
σ0.018-0.020=-0.002
min0.716-0.629=0.087
max0.861-0.841=0.020
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.709-0.689=0.020
σ0.015-0.023=-0.008
min0.677-0.525=0.153
max0.759-0.766=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.345-296.119=0.226
σ0.280-0.254=0.026
min296.123-295.965=0.158
max297.095-296.817=0.279
mean2029.000-1900.000=129.000
σ0.000
min2029.000-1900.000=129.000
max2029.000-1900.000=129.000
mean0.568-0.579=-0.011
σ0.030-0.038=-0.007
min0.510-0.517=-0.006
max0.587-0.654=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.028-284.696=0.332
σ0.035-0.035=0.000
min284.980-284.651=0.329
max285.063-284.735=0.327
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.393-0.398=-0.004
σ0.007-0.013=-0.006
min0.387-0.382=0.005
max0.403-0.409=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.408-1295.074=0.334
σ0.104-0.104=-0.000
min1295.300-1294.958=0.342
max1295.531-1295.199=0.332
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean1.899-1.906=-0.007
σ0.151-0.120=0.030
min1.760-1.795=-0.036
max2.087-2.096=-0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.528-1539.194=0.333
σ6.841-6.867=-0.025
min1536.230-1535.876=0.354
max1551.762-1551.473=0.289
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean2.326-2.234=0.092
σ0.272-0.228=0.045
min2.043-2.053=-0.010
max2.703-2.598=0.105
iters=5
new-facts=6402
prior-facts=6402
mean1857.311-1856.984=0.326
σ0.064-0.054=0.010
min1857.258-1856.936=0.322
max1857.397-1857.065=0.333
mean1736.800-1768.200=-31.400
σ211.812-132.148=79.663
min1521.000-1622.000=-101.000
max2029.000-1900.000=129.000
mean2.866-3.039=-0.173
σ0.050-0.249=-0.198
min2.829-2.844=-0.016
max2.953-3.465=-0.512

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.513-1.269=0.244
σ0.270-0.343=-0.073
min1.193-0.941=0.253
max1.808-1.815=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-447.785=0.406
σ581.331-581.213=0.119
min157.524-157.175=0.348
max1320.188-1319.605=0.584
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean0.536-0.529=0.007
σ0.546-0.532=0.014
min0.261-0.259=0.001
max1.355-1.327=0.028
policies=20
mean1575.585-1572.104=3.481
σ0.382-0.360=0.023
min1575.331-1571.858=3.473
max1576.154-1572.638=3.515
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean2.680-2.634=0.047
σ0.058-0.021=0.037
min2.622-2.604=0.019
max2.756-2.650=0.106
policies=200
mean15763.744-15729.075=34.669
σ0.109-0.075=0.033
min15763.674-15729.026=34.648
max15763.906-15729.187=34.719
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1622.000=-101.000
σ0.000
min1521.000-1622.000=-101.000
max1521.000-1622.000=-101.000
mean26.539-26.505=0.034
σ0.016-0.046=-0.029
min26.525-26.460=0.065
max26.563-26.560=0.003