Compare commits

Home / Compare 118d6ee6 .. 48ee22ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.045=0.000
σ0.369-0.370=-0.000
min53.892-53.900=-0.008
max55.096-55.097=-0.001
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.139-0.140=-0.001
σ0.004-0.003=0.000
min0.135-0.137=-0.002
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.004-0.007=-0.004
min43.380-43.371=0.009
max43.392-43.396=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.122=-0.001
σ0.004-0.004=-0.000
min0.114-0.116=-0.002
max0.130-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=0.000
σ0.868-0.864=0.004
min1006.480-1006.508=-0.028
max1010.569-1010.554=0.016
mean1047.100-1052.700=-5.600
σ315.079-319.840=-4.761
min577.000-576.000=1.000
max1650.000-1620.000=30.000
mean1.557-1.563=-0.006
σ0.062-0.129=-0.067
min1.500-1.479=0.021
max1.727-2.084=-0.358

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.437-0.438=-0.002
σ0.191-0.182=0.009
min0.332-0.337=-0.004
max0.777-0.762=0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.906-0.913=-0.007
σ0.153-0.145=0.008
min0.822-0.825=-0.003
max1.178-1.169=0.008
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.535-0.544=-0.008
σ0.050-0.042=0.007
min0.497-0.512=-0.015
max0.616-0.615=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.839-0.850=-0.011
σ0.036-0.029=0.007
min0.803-0.822=-0.019
max0.896-0.895=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.000
σ0.025-0.025=-0.001
min964.802
max964.861-964.862=-0.001
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.823-0.803=0.019
σ0.031-0.019=0.012
min0.786-0.772=0.014
max0.856-0.821=0.034
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.005-0.005=0.000
min885.504-885.505=-0.001
max885.516-885.518=-0.002
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.701-0.707=-0.006
σ0.037-0.044=-0.007
min0.643-0.646=-0.003
max0.743-0.746=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean3.480-4.251=-0.770
σ0.105-0.088=0.017
min3.327-4.086=-0.759
max4.158-4.524=-0.366
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean3.779-4.256=-0.477
σ0.355-0.088=0.267
min3.310-4.096=-0.787
max4.323-4.660=-0.337
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.733-0.653=0.080
σ0.019-0.105=-0.087
min0.697-0.519=0.178
max0.849-0.887=-0.038
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.693-0.511=0.183
σ0.027-0.028=-0.001
min0.521-0.481=0.040
max0.793-0.752=0.041

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.651=0.042
σ0.248-0.231=0.017
min295.425-295.496=-0.071
max296.351-296.283=0.068
mean1888.000-1924.000=-36.000
σ0.000
min1888.000-1924.000=-36.000
max1888.000-1924.000=-36.000
mean0.565-0.586=-0.021
σ0.045-0.025=0.020
min0.497-0.538=-0.041
max0.614-0.636=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.413=-0.008
σ0.041-0.036=0.005
min285.360-285.371=-0.011
max285.452-285.455=-0.003
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.384-0.395=-0.011
σ0.005-0.007=-0.002
min0.378-0.388=-0.010
max0.391-0.404=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.796=-0.002
σ0.104-0.114=-0.010
min1295.681-1295.667=0.014
max1295.923-1295.931=-0.008
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean1.923-1.882=0.041
σ0.102-0.064=0.038
min1.810-1.824=-0.014
max2.034-1.978=0.056
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.924=-0.008
σ6.854-6.875=-0.021
min1536.648-1536.635=0.014
max1552.173-1552.218=-0.046
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean2.231-2.267=-0.036
σ0.301-0.255=0.046
min1.930-2.050=-0.120
max2.685-2.666=0.018
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.710=-0.001
σ0.054-0.053=0.001
min1857.648-1857.645=0.002
max1857.778-1857.775=0.003
mean1771.000-1779.800=-8.800
σ118.030-145.819=-27.789
min1650.000-1620.000=30.000
max1888.000-1924.000=-36.000
mean2.995-3.128=-0.133
σ0.101-0.310=-0.209
min2.860-2.857=0.003
max3.101-3.656=-0.555

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.385=0.036
σ0.290-0.200=0.090
min1.110-1.257=-0.147
max1.815-1.733=0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.000
σ580.934-580.934=-0.000
min155.272-155.271=0.001
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean0.525-0.556=-0.031
σ0.538-0.597=-0.059
min0.256-0.255=0.001
max1.332-1.451=-0.120
policies=20
mean1552.978-1552.990=-0.012
σ0.321-0.327=-0.005
min1552.755-1552.763=-0.008
max1553.455-1553.475=-0.020
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean2.579-2.583=-0.004
σ0.043-0.013=0.030
min2.551-2.573=-0.022
max2.641-2.601=0.040
policies=200
mean15537.863-15537.960=-0.097
σ0.133-0.096=0.037
min15537.773-15537.859=-0.086
max15538.060-15538.051=0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1620.000=30.000
σ0.000
min1650.000-1620.000=30.000
max1650.000-1620.000=30.000
mean26.074-26.286=-0.212
σ0.075-0.032=0.043
min25.963-26.248=-0.285
max26.122-26.317=-0.194