Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	53.964-54.015=-0.051
σ	0.368-0.371=-0.003
min	53.817-53.872=-0.056
max	55.012-55.070=-0.058

*mean*	416.000-420.000=-4.000
σ	0.000
min	416.000-420.000=-4.000
max	416.000-420.000=-4.000

*mean*	0.139-0.138=0.000
σ	0.004-0.003=0.000
min	0.136-0.135=0.001
max	0.146-0.144=0.002

cache=y

dps=1

iters=10

policies=100

*mean*	43.322-43.324=-0.001
σ	0.006-0.007=-0.000
min	43.313-43.314=-0.001
max	43.337-43.339=-0.002

*mean*	416.000-420.000=-4.000
σ	0.000
min	416.000-420.000=-4.000
max	416.000-420.000=-4.000

*mean*	0.123-0.122=0.001
σ	0.003-0.003=-0.000
min	0.119-0.119=-0.000
max	0.128-0.128=-0.000

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1006.515-1006.305=0.210
σ	1.183-1.175=0.008
min	1005.977-1005.768=0.209
max	1011.461-1011.226=0.235

*mean*	1062.300-1056.700=5.600
σ	321.589-304.927=16.662
min	547.000-603.000=-56.000
max	1528.000-1650.000=-122.000

*mean*	1.574-1.554=0.019
σ	0.085-0.080=0.005
min	1.496-1.446=0.049
max	1.825-1.772=0.054

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883-0.866=0.018
σ	0.003
min	0.882-0.864=0.018
max	0.887-0.869=0.018

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.420-0.410=0.010
σ	0.129-0.147=-0.019
min	0.349-0.329=0.019
max	0.649-0.672=-0.023

name=error_case.art

*mean*	2.339-2.337=0.001
σ	0.003
min	2.337-2.336=0.001
max	2.342-2.341=0.001

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.880-0.880=0.000
σ	0.088-0.104=-0.016
min	0.829-0.802=0.027
max	1.035-1.060=-0.024

name=heavy_item.art

*mean*	1.524-1.523=0.001
σ	0.002
min	1.522-1.522=0.001
max	1.526-1.526=0.001

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.546-0.535=0.011
σ	0.050-0.051=-0.001
min	0.488-0.498=-0.010
max	0.626-0.620=0.005

name=nested_use.art

*mean*	2.361-2.360=0.001
σ	0.002
min	2.360-2.359=0.001
max	2.364-2.363=0.001

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.845-0.836=0.009
σ	0.039-0.042=-0.003
min	0.804-0.803=0.001
max	0.904-0.901=0.003

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.830-964.116=0.715
σ	0.024-0.035=-0.011
min	964.812-964.086=0.726
max	964.869-964.173=0.696

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.814-0.800=0.014
σ	0.049-0.044=0.006
min	0.739-0.745=-0.006
max	0.862-0.861=0.002

name=cdr_enhanced_4k_loc.art

*mean*	885.510-884.712=0.798
σ	0.008-0.004=0.003
min	885.504-884.705=0.799
max	885.521-884.715=0.805

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.716-0.712=0.003
σ	0.013-0.037=-0.024
min	0.700-0.656=0.044
max	0.733-0.741=-0.009

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.716-7.714=0.002
σ	0.002-0.002=0.000
min	7.715-7.714=0.002
max	7.720-7.718=0.003

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	3.525-3.480=0.045
σ	0.086-0.088=-0.002
min	3.391-3.328=0.063
max	3.864-3.767=0.098

name=record_render_large_syntax_err.art

*mean*	7.665-7.663=0.002
σ	0.002-0.002=0.000
min	7.664-7.662=0.002
max	7.669-7.666=0.003

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	3.483-3.486=-0.003
σ	0.066-0.083=-0.017
min	3.276-3.367=-0.091
max	3.674-3.781=-0.107

name=record_render_success.art

*mean*	2.291-2.289=0.001
σ	0.002
min	2.290-2.289=0.001
max	2.294-2.292=0.001

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.537-0.730=-0.192
σ	0.027-0.019=0.008
min	0.514-0.697=-0.184
max	0.750-0.851=-0.101

name=record_render_syntax_err.art

*mean*	2.166-2.165=0.001
σ	0.002
min	2.165-2.164=0.001
max	2.169-2.168=0.001

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.508-0.691=-0.184
σ	0.016-0.014=0.002
min	0.402-0.658=-0.256
max	0.561-0.760=-0.200

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	296.447-296.352=0.095
σ	0.260-0.235=0.025
min	296.281-296.089=0.192
max	297.176-296.967=0.209

*mean*	2047.000-1909.000=138.000
σ	0.000
min	2047.000-1909.000=138.000
max	2047.000-1909.000=138.000

*mean*	0.548-0.584=-0.036
σ	0.030-0.051=-0.021
min	0.510-0.508=0.002
max	0.579-0.685=-0.107

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	285.027-284.701=0.325
σ	0.038-0.025=0.013
min	284.976-284.679=0.297
max	285.066-284.732=0.334

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.395-0.393=0.002
σ	0.008-0.006=0.002
min	0.386-0.389=-0.003
max	0.407-0.403=0.003

iters=5

new-facts=1

prior-facts=6402

*mean*	1295.444-1295.080=0.364
σ	0.063-0.111=-0.047
min	1295.364-1294.959=0.406
max	1295.500-1295.220=0.280

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	2.082-1.916=0.166
σ	0.092-0.087=0.004
min	2.003-1.820=0.184
max	2.215-2.025=0.190

iters=5

new-facts=6402

prior-facts=1

*mean*	1539.526-1539.184=0.342
σ	6.846-6.863=-0.017
min	1536.266-1535.936=0.330
max	1551.768-1551.457=0.311

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	2.281-2.269=0.012
σ	0.214-0.234=-0.020
min	2.063-2.043=0.019
max	2.587-2.563=0.024

iters=5

new-facts=6402

prior-facts=6402

*mean*	1857.320-1856.991=0.328
σ	0.077-0.055=0.022
min	1857.211-1856.941=0.270
max	1857.408-1857.076=0.333

*mean*	1763.800-1778.000=-14.200
σ	210.997-128.410=82.587
min	1528.000-1650.000=-122.000
max	2047.000-1909.000=138.000

*mean*	3.021-3.164=-0.143
σ	0.070-0.260=-0.190
min	2.928-2.938=-0.010
max	3.112-3.541=-0.429

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.493-1.207=0.286
σ	0.279-0.323=-0.045
min	1.165-0.935=0.231
max	1.763-1.573=0.190

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	448.191-447.785=0.406
σ	581.332-581.212=0.120
min	157.521-157.177=0.344
max	1320.189-1319.603=0.586

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	0.537-0.542=-0.006
σ	0.550-0.559=-0.009
min	0.261-0.259=0.002
max	1.362-1.381=-0.020

policies=20

*mean*	1575.571-1572.088=3.483
σ	0.359-0.356=0.003
min	1575.333-1571.849=3.485
max	1576.105-1572.618=3.487

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	2.638-2.635=0.003
σ	0.018-0.022=-0.004
min	2.617-2.613=0.004
max	2.658-2.660=-0.001

policies=200

*mean*	15763.709-15729.039=34.670
σ	0.005-0.129=-0.124
min	15763.705-15728.886=34.819
max	15763.715-15729.202=34.513

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1528.000-1650.000=-122.000
σ	0.000
min	1528.000-1650.000=-122.000
max	1528.000-1650.000=-122.000

*mean*	26.597-26.597=-0.000
σ	0.052-0.034=0.018
min	26.543-26.547=-0.005
max	26.654-26.620=0.034