Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.618-54.056=0.563
σ	0.349-0.368=-0.019
min	54.487-53.910=0.577
max	55.612-55.103=0.508

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.141-0.136=0.005
σ	0.004-0.004=-0.000
min	0.135-0.130=0.005
max	0.149-0.143=0.005

cache=y

dps=1

iters=10

policies=100

*mean*	43.785-43.394=0.390
σ	0.007-0.006=0.001
min	43.776-43.384=0.392
max	43.801-43.403=0.398

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.122-0.122=0.000
σ	0.005-0.003=0.001
min	0.117-0.118=-0.001
max	0.129-0.128=0.001

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4116.125
σ	1548.894
min	2045.000
max	6015.000

*mean*	12.306
σ	0.284
min	11.901
max	12.698

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4116.125
σ	1548.894
min	2045.000
max	6015.000

*mean*	12.400
σ	0.504
min	11.756
max	12.907

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	6015.000
σ	0.000
min	6015.000
max	6015.000

*mean*	13.189
σ	1.204
min	10.756
max	15.029

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4051.375
σ	1600.019
min	2045.000
max	6015.000

*mean*	12.985
σ	2.030
min	10.409
max	14.830

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4051.375
σ	1600.019
min	2045.000
max	6015.000

*mean*	8.502
σ	0.300
min	8.133
max	8.827

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.399
max	26.403

*mean*	4051.375
σ	1600.019
min	2045.000
max	6015.000

*mean*	6.290
σ	0.318
min	5.887
max	6.872

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4116.125
σ	1548.894
min	2045.000
max	6015.000

*mean*	5.547
σ	0.145
min	5.320
max	5.831

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4116.125
σ	1548.894
min	2045.000
max	6015.000

*mean*	5.384
σ	0.211
min	5.203
max	5.864

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.593
σ	0.000
min	2524.593
max	2524.594

*mean*	6015.000
σ	0.000
min	6015.000
max	6015.000

*mean*	1461.062
σ	698.734
min	1043.293
max	2997.734

op=load_product(), with indexes

*mean*	8744.558
σ	0.033
min	8744.544
max	8744.639

*mean*	3838.875
σ	1618.832
min	2045.000
max	6015.000

*mean*	4284.461
σ	1215.493
min	3554.399
max	7070.087

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.077
σ	0.002
min	62.076
max	62.080

*mean*	4116.125
σ	1548.894
min	2045.000
max	6015.000

*mean*	111.960
σ	85.979
min	70.787
max	323.242

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	6015.000
σ	0.000
min	6015.000
max	6015.000

*mean*	96.818
σ	9.873
min	82.405
max	108.623

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	6015.000
σ	0.000
min	6015.000
max	6015.000

*mean*	231.986
σ	246.908
min	125.311
max	842.110

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.832
σ	4.317
min	11655.305
max	11667.517

*mean*	4051.375
σ	1600.019
min	2045.000
max	6015.000

*mean*	5975.973
σ	1208.829
min	4949.738
max	8252.190

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.067
max	11560.069

*mean*	6015.000
σ	0.000
min	6015.000
max	6015.000

*mean*	6740.209
σ	1277.076
min	4427.158
max	7923.182

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.587
σ	0.025
min	172.558
max	172.630

*mean*	2045.000
σ	0.000
min	2045.000
max	2045.000

*mean*	354.107
σ	56.555
min	272.689
max	440.994

op=pointedIndexFromKvs

rows=400000

*mean*	357.368
σ	0.042
min	357.321
max	357.428

*mean*	2045.000
σ	0.000
min	2045.000
max	2045.000

*mean*	750.671
σ	81.466
min	572.157
max	814.535

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.181-1006.967=1.214
σ	0.899-0.856=0.043
min	1007.694-1006.463=1.231
max	1011.916-1010.493=1.423

*mean*	1038.950-1056.500=-17.550
σ	304.923-316.126=-11.204
min	547.000-567.000=-20.000
max	1468.000-1620.000=-152.000

*mean*	1.576-1.542=0.034
σ	0.121-0.070=0.051
min	1.492-1.467=0.025
max	2.022-1.784=0.238

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.884-0.883=0.001
σ	0.002-0.003=-0.000
min	0.881-0.882=-0.000
max	0.886-0.887=-0.001

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.434-0.416=0.018
σ	0.124-0.144=-0.019
min	0.330-0.320=0.010
max	0.628-0.669=-0.042

name=error_case.art

*mean*	2.335-2.339=-0.004
σ	0.003-0.003=0.000
min	2.332-2.337=-0.005
max	2.339-2.342=-0.004

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.872-0.893=-0.021
σ	0.101-0.091=0.010
min	0.800-0.836=-0.036
max	1.042-1.053=-0.011

name=heavy_item.art

*mean*	1.521-1.524=-0.002
σ	0.002
min	1.520-1.522=-0.002
max	1.524-1.526=-0.002

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.551-0.543=0.007
σ	0.042-0.047=-0.004
min	0.514-0.505=0.009
max	0.618-0.621=-0.003

name=nested_use.art

*mean*	2.355-2.361=-0.005
σ	0.002
min	2.355-2.360=-0.005
max	2.358-2.364=-0.005

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.854-0.851=0.003
σ	0.039-0.048=-0.009
min	0.827-0.817=0.011
max	0.922-0.936=-0.013

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.540-964.839=-1.299
σ	0.025-0.036=-0.010
min	963.524-964.811=-1.287
max	963.585-964.897=-1.312

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.836-0.833=0.003
σ	0.027-0.023=0.005
min	0.789-0.801=-0.012
max	0.857-0.857=0.000

name=cdr_enhanced_4k_loc.art

*mean*	884.854-885.512=-0.658
σ	0.008-0.006=0.001
min	884.847-885.504=-0.657
max	884.864-885.519=-0.655

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.717-0.729=-0.012
σ	0.026-0.034=-0.008
min	0.682-0.669=0.013
max	0.740-0.751=-0.011

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706-7.716=-0.010
σ	0.002-0.002=-0.000
min	7.705-7.715=-0.010
max	7.711-7.721=-0.010

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	4.244-4.204=0.040
σ	0.094-0.074=0.020
min	4.103-4.077=0.025
max	4.637-4.490=0.147

name=record_render_large_syntax_err.art

*mean*	7.655-7.665=-0.010
σ	0.002
min	7.654-7.664=-0.010
max	7.658-7.668=-0.010

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	4.211-4.217=-0.006
σ	0.080-0.063=0.017
min	4.071-4.087=-0.016
max	4.542-4.450=0.092

name=record_render_success.art

*mean*	2.288-2.291=-0.003
σ	0.002
min	2.287-2.290=-0.003
max	2.291-2.294=-0.003

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.745-0.754=-0.009
σ	0.018-0.025=-0.007
min	0.711-0.722=-0.011
max	0.859-0.908=-0.049

name=record_render_syntax_err.art

*mean*	2.163-2.166=-0.002
σ	0.002
min	2.163-2.165=-0.002
max	2.166-2.169=-0.002

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.568-0.709=-0.142
σ	0.094-0.014=0.079
min	0.491-0.678=-0.187
max	0.774-0.795=-0.021

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.650-295.554=2.096
σ	0.206-0.234=-0.028
min	297.490-295.379=2.111
max	298.210-296.193=2.017

*mean*	2045.000-2071.000=-26.000
σ	0.000
min	2045.000-2071.000=-26.000
max	2045.000-2071.000=-26.000

*mean*	0.557-0.542=0.015
σ	0.035-0.035=0.000
min	0.509-0.498=0.011
max	0.603-0.593=0.010

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.774-285.395=4.380
σ	0.032-0.037=-0.005
min	289.738-285.341=4.396
max	289.808-285.431=4.377

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.400-0.388=0.012
σ	0.007-0.009=-0.003
min	0.393-0.380=0.013
max	0.407-0.402=0.005

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.586-1295.758=3.828
σ	0.087-0.089=-0.002
min	1299.500-1295.652=3.848
max	1299.721-1295.869=3.852

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	1.855-1.851=0.004
σ	0.057-0.082=-0.025
min	1.802-1.759=0.042
max	1.925-1.953=-0.028

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.655-1539.913=2.742
σ	4.029-6.854=-2.825
min	1540.676-1536.571=4.105
max	1549.858-1552.166=-2.308

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	2.317-2.351=-0.034
σ	0.205-0.196=0.008
min	2.111-2.106=0.004
max	2.643-2.582=0.061

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.634-1857.691=3.942
σ	0.049-0.062=-0.014
min	1861.584-1857.616=3.968
max	1861.701-1857.759=3.942

*mean*	1722.200-1773.000=-50.800
σ	233.065-189.805=43.260
min	1468.000-1620.000=-152.000
max	2045.000-2071.000=-26.000

*mean*	2.898-2.897=0.002
σ	0.074-0.178=-0.104
min	2.821-2.666=0.155
max	2.990-3.153=-0.163

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.790-1.261=0.529
σ	0.108-0.369=-0.261
min	1.619-0.937=0.683
max	1.893-1.838=0.055

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.185-445.745=0.440
σ	577.140-581.009=-3.869
min	157.614-155.239=2.375
max	1311.895-1317.258=-5.364

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	0.542-0.541=0.001
σ	0.555-0.563=-0.008
min	0.263-0.258=0.006
max	1.374-1.386=-0.012

policies=20

*mean*	1576.428-1552.647=23.781
σ	0.357-0.329=0.028
min	1576.188-1552.421=23.767
max	1576.959-1553.135=23.823

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	2.630-2.586=0.045
σ	0.005-0.018=-0.013
min	2.624-2.564=0.061
max	2.636-2.603=0.033

policies=200

*mean*	15772.220-15534.639=237.582
σ	0.151-0.055=0.097
min	15772.106-15534.573=237.534
max	15772.442-15534.705=237.737

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1468.000-1620.000=-152.000
σ	0.000
min	1468.000-1620.000=-152.000
max	1468.000-1620.000=-152.000

*mean*	26.565-26.062=0.503
σ	0.095-0.135=-0.041
min	26.469-25.937=0.531
max	26.654-26.252=0.402