Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.618-53.706=0.912
σ	0.350-0.367=-0.017
min	54.487-53.565=0.922
max	55.613-54.751=0.862

*mean*	422.000-416.700=5.300
σ	0.000-0.483=-0.483
min	422.000-416.000=6.000
max	422.000-417.000=5.000

*mean*	0.141-0.140=0.001
σ	0.009-0.003=0.006
min	0.131-0.136=-0.005
max	0.159-0.146=0.013

cache=y

dps=1

iters=10

policies=100

*mean*	43.787-43.059=0.728
σ	0.009-0.006=0.002
min	43.775-43.048=0.727
max	43.804-43.067=0.737

*mean*	422.000-417.000=5.000
σ	0.000
min	422.000-417.000=5.000
max	422.000-417.000=5.000

*mean*	0.125-0.123=0.002
σ	0.007-0.004=0.003
min	0.120-0.118=0.002
max	0.144-0.129=0.015

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	12.885
σ	1.673
min	11.944
max	16.973

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.619

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	13.343
σ	1.625
min	12.531
max	17.344

op=table_records(), no indexes

*mean*	41.928
σ	0.001
min	41.928
max	41.929

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	13.618
σ	0.992
min	12.491
max	14.683

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.932

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	12.401
σ	2.205
min	10.289
max	15.161

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	8.817
σ	1.298
min	7.873
max	11.922

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	6.684
σ	1.119
min	6.004
max	9.403

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.669

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	5.639
σ	0.536
min	5.233
max	6.942

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	5.409
σ	0.534
min	5.066
max	6.704

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.593
σ	0.000
min	2524.593
max	2524.594

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	1106.450
σ	159.785
min	1043.068
max	1501.606

op=load_product(), with indexes

*mean*	8744.558
σ	0.033
min	8744.544
max	8744.639

*mean*	3794.750
σ	1606.742
min	1990.000
max	5949.000

*mean*	4649.167
σ	1504.717
min	3557.034
max	7361.410

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	88.702
σ	13.429
min	76.363
max	117.417

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	237.522
σ	386.855
min	85.718
max	1194.766

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.001
min	66.685
max	66.689

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	148.441
σ	16.114
min	120.791
max	165.812

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.834
σ	4.318
min	11655.305
max	11667.521

*mean*	4271.500
σ	1875.122
min	1990.000
max	7542.000

*mean*	6553.247
σ	1297.635
min	4985.947
max	8270.335

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.066
max	11560.069

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	5482.501
σ	1343.777
min	4411.811
max	7267.779

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.582
σ	0.026
min	172.558
max	172.624

*mean*	1990.000
σ	0.000
min	1990.000
max	1990.000

*mean*	350.621
σ	35.790
min	274.307
max	403.568

op=pointedIndexFromKvs

rows=400000

*mean*	357.362
σ	0.043
min	357.321
max	357.405

*mean*	1990.000
σ	0.000
min	1990.000
max	1990.000

*mean*	763.268
σ	64.684
min	611.603
max	809.514

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.182-1005.105=3.077
σ	0.927-0.888=0.039
min	1007.716-1004.637=3.079
max	1012.041-1008.782=3.260

*mean*	1058.450-1055.100=3.350
σ	316.802-321.597=-4.794
min	581.000-553.000=28.000
max	1528.000-1632.000=-104.000

*mean*	1.552-1.628=-0.076
σ	0.111-0.090=0.021
min	1.452-1.556=-0.103
max	1.905-1.879=0.027

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.884-0.883=0.001
σ	0.003-0.002=0.000
min	0.881
max	0.887-0.886=0.002

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.439-0.418=0.021
σ	0.132-0.135=-0.003
min	0.340-0.335=0.006
max	0.656-0.658=-0.002

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.901-0.878=0.023
σ	0.102-0.086=0.016
min	0.837-0.830=0.008
max	1.082-1.031=0.051

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.548-0.542=0.007
σ	0.041-0.057=-0.015
min	0.515-0.485=0.030
max	0.620-0.636=-0.016

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.840-0.840=-0.001
σ	0.050-0.039=0.010
min	0.799-0.808=-0.009
max	0.919-0.904=0.015

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.550-963.554=-0.004
σ	0.035-0.026=0.009
min	963.523-963.535=-0.012
max	963.611-963.599=0.012

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.828-0.827=0.001
σ	0.030-0.039=-0.009
min	0.790-0.773=0.017
max	0.859-0.860=-0.001

name=cdr_enhanced_4k_loc.art

*mean*	884.853-884.853=0.000
σ	0.006-0.008=-0.003
min	884.847
max	884.861-884.866=-0.006

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.743-0.713=0.030
σ	0.006-0.065=-0.060
min	0.735-0.596=0.139
max	0.750-0.746=0.004

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706-7.706=-0.000
σ	0.002-0.002=-0.000
min	7.705
max	7.709-7.712=-0.003

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	3.559-4.266=-0.707
σ	0.086-0.067=0.020
min	3.410-4.148=-0.737
max	3.882-4.538=-0.656

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	3.557-4.265=-0.708
σ	0.059-0.069=-0.010
min	3.440-4.144=-0.705
max	3.795-4.636=-0.841

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.761-0.745=0.016
σ	0.017-0.016=0.001
min	0.728-0.717=0.011
max	0.876-0.863=0.013

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.717-0.703=0.014
σ	0.019-0.016=0.003
min	0.627-0.678=-0.050
max	0.798-0.803=-0.006

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.427-294.342=3.085
σ	0.253-0.279=-0.026
min	297.198-294.065=3.133
max	298.107-295.075=3.032

*mean*	1990.000-1974.000=16.000
σ	0.000
min	1990.000-1974.000=16.000
max	1990.000-1974.000=16.000

*mean*	0.579-0.570=0.009
σ	0.029-0.067=-0.039
min	0.526-0.495=0.031
max	0.616-0.717=-0.101

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.773-281.493=8.280
σ	0.035-0.036=-0.001
min	289.726-281.453=8.273
max	289.810-281.529=8.281

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.396-0.379=0.017
σ	0.006-0.001=0.005
min	0.393-0.378=0.015
max	0.406-0.380=0.026

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.662-1291.479=8.183
σ	0.070-0.117=-0.046
min	1299.584-1291.352=8.232
max	1299.732-1291.646=8.086

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	2.097-1.928=0.168
σ	0.072-0.109=-0.036
min	2.007-1.788=0.219
max	2.177-2.046=0.132

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.589-1534.344=8.245
σ	4.031-4.031=0.000
min	1540.556-1532.322=8.234
max	1549.790-1541.543=8.248

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	2.191-2.349=-0.158
σ	0.158-0.263=-0.104
min	1.974-2.093=-0.119
max	2.375-2.705=-0.330

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.628-1853.374=8.254
σ	0.078-0.078=0.000
min	1861.507-1853.284=8.224
max	1861.704-1853.469=8.235

*mean*	1785.600-1802.800=-17.200
σ	210.469-168.869=41.600
min	1528.000-1632.000=-104.000
max	1990.000-1974.000=16.000

*mean*	3.270-3.253=0.018
σ	0.381-0.334=0.047
min	2.861-2.892=-0.030
max	3.681-3.656=0.025

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.595-1.424=0.170
σ	0.344-0.305=0.040
min	1.017-1.102=-0.084
max	1.861-1.873=-0.012

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.183-442.429=3.754
σ	577.140-577.063=0.077
min	157.610-153.895=3.715
max	1311.894-1308.024=3.870

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	0.541-0.521=0.021
σ	0.558-0.515=0.043
min	0.261-0.261=0.000
max	1.378-1.293=0.085

policies=20

*mean*	1576.404-1539.224=37.180
σ	0.353-0.321=0.032
min	1576.171-1538.999=37.172
max	1576.930-1539.700=37.230

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	2.629-2.573=0.055
σ	0.035-0.016=0.019
min	2.587-2.554=0.033
max	2.673-2.589=0.084

policies=200

*mean*	15772.305-15400.365=371.940
σ	0.137-0.085=0.052
min	15772.115-15400.270=371.845
max	15772.442-15400.467=371.975

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1528.000-1632.000=-104.000
σ	0.000
min	1528.000-1632.000=-104.000
max	1528.000-1632.000=-104.000

*mean*	26.416-25.961=0.455
σ	0.046-0.075=-0.029
min	26.363-25.862=0.501
max	26.474-26.035=0.439