Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.617-54.049=0.568
σ	0.350-0.369=-0.019
min	54.479-53.907=0.572
max	55.613-55.098=0.515

*mean*	415.000-416.000=-1.000
σ	0.000
min	415.000-416.000=-1.000
max	415.000-416.000=-1.000

*mean*	0.138-0.138=0.000
σ	0.004-0.003=0.001
min	0.133-0.130=0.002
max	0.145-0.143=0.003

cache=y

dps=1

iters=10

policies=100

*mean*	43.787-43.342=0.445
σ	0.006-0.005=0.001
min	43.777-43.336=0.442
max	43.797-43.351=0.446

*mean*	415.000-416.000=-1.000
σ	0.000
min	415.000-416.000=-1.000
max	415.000-416.000=-1.000

*mean*	0.123-0.121=0.001
σ	0.004-0.004=-0.001
min	0.119-0.114=0.005
max	0.128-0.128=0.001

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.111
σ	1.725
min	12.147
max	17.353

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.024
σ	2.069
min	11.307
max	17.830

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	14.040
σ	1.006
min	12.718
max	15.523

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.203
σ	2.287
min	10.625
max	15.906

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	9.353
σ	1.717
min	7.966
max	12.438

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	7.084
σ	1.395
min	6.032
max	9.494

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	5.781
σ	0.477
min	5.549
max	6.949

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	5.550
σ	0.479
min	5.216
max	6.705

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.594
σ	0.000
min	2524.594
max	2524.594

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	1100.339
σ	157.411
min	1036.134
max	1489.719

op=load_product(), with indexes

*mean*	8744.559
σ	0.032
min	8744.544
max	8744.639

*mean*	3765.125
σ	1635.880
min	1894.000
max	5941.000

*mean*	4541.602
σ	1363.394
min	3506.098
max	6551.399

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	91.561
σ	17.623
min	72.337
max	127.552

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	232.528
σ	372.464
min	89.923
max	1154.198

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	151.555
σ	12.107
min	134.814
max	166.070

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.520

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	6522.964
σ	1086.255
min	4880.030
max	7906.077

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.066
max	11560.069

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	5423.100
σ	1340.516
min	4355.183
max	7460.910

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.582
σ	0.028
min	172.558
max	172.624

*mean*	1894.000
σ	0.000
min	1894.000
max	1894.000

*mean*	351.637
σ	33.493
min	294.516
max	398.454

op=pointedIndexFromKvs

rows=400000

*mean*	357.363
σ	0.040
min	357.321
max	357.414

*mean*	1894.000
σ	0.000
min	1894.000
max	1894.000

*mean*	782.314
σ	28.094
min	728.675
max	824.297

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.186-1017.196=-9.010
σ	0.880-1.164=-0.284
min	1007.687-1016.653=-8.966
max	1011.837-1022.073=-10.237

*mean*	1038.650-1050.050=-11.400
σ	305.109-319.093=-13.983
min	546.000-590.000=-44.000
max	1468.000-1609.000=-141.000

*mean*	1.532-1.572=-0.040
σ	0.115-0.101=0.014
min	1.357-1.478=-0.121
max	1.894-1.816=0.077

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.421
σ	0.151
min	0.335
max	0.689

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.940
σ	0.200
min	0.833
max	1.294

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.538
σ	0.050
min	0.497
max	0.624

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.869
σ	0.063
min	0.806
max	0.969

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.543
σ	0.024
min	963.524
max	963.584

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.857
σ	0.015
min	0.833
max	0.871

name=cdr_enhanced_4k_loc.art

*mean*	884.855
σ	0.006
min	884.847
max	884.862

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.742
σ	0.006
min	0.733
max	0.749

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.239
σ	0.079
min	4.123
max	4.559

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.228
σ	0.088
min	4.056
max	4.541

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.653
σ	0.104
min	0.515
max	0.836

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.508
σ	0.017
min	0.487
max	0.636

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.491-302.014=-4.523
σ	0.219-0.269=-0.050
min	297.289-301.856=-4.567
max	298.040-302.762=-4.722

*mean*	1894.000-2034.000=-140.000
σ	0.000
min	1894.000-2034.000=-140.000
max	1894.000-2034.000=-140.000

*mean*	0.588-0.568=0.019
σ	0.031-0.043=-0.012
min	0.517-0.500=0.017
max	0.626-0.608=0.018

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.772-303.780=-14.007
σ	0.032-0.062=-0.030
min	289.731-303.685=-13.954
max	289.805-303.841=-14.035

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	0.404-0.395=0.008
σ	0.013-0.009=0.004
min	0.397-0.390=0.008
max	0.427-0.411=0.016

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.646-1326.336=-26.690
σ	0.079-0.111=-0.033
min	1299.547-1326.201=-26.654
max	1299.714-1326.476=-26.762

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	2.033-1.889=0.143
σ	0.016-0.060=-0.044
min	2.012-1.829=0.183
max	2.055-1.959=0.096

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.615-1564.373=-21.758
σ	4.038-6.924=-2.886
min	1540.566-1561.057=-20.492
max	1549.828-1576.753=-26.925

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	2.237-2.274=-0.037
σ	0.165-0.249=-0.084
min	2.077-2.042=0.035
max	2.453-2.668=-0.215

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.628-1894.279=-32.651
σ	0.079-0.074=0.005
min	1861.508-1894.146=-32.638
max	1861.704-1894.317=-32.613

*mean*	1737.600-1761.400=-23.800
σ	173.001-179.823=-6.822
min	1488.000-1609.000=-121.000
max	1894.000-2034.000=-140.000

*mean*	3.162-2.926=0.236
σ	0.375-0.097=0.278
min	2.869-2.861=0.008
max	3.771-3.097=0.674

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.742-1.309=0.433
σ	0.173-0.275=-0.102
min	1.546-1.026=0.519
max	1.933-1.629=0.304

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.147-448.336=-2.188
σ	577.064-581.803=-4.739
min	157.614-157.432=0.181
max	1311.743-1321.040=-9.297

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	0.550-0.569=-0.020
σ	0.570-0.613=-0.042
min	0.262-0.262=-0.000
max	1.405-1.488=-0.083

policies=20

*mean*	1576.409-1574.567=1.842
σ	0.347-0.336=0.011
min	1576.173-1574.353=1.820
max	1576.925-1575.068=1.856

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	2.619-2.624=-0.005
σ	0.008-0.005=0.003
min	2.611-2.618=-0.006
max	2.627-2.628=-0.001

policies=200

*mean*	15772.107-15753.908=18.199
σ	0.139-0.123=0.016
min	15772.024-15753.768=18.256
max	15772.314-15754.014=18.301

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1468.000-1609.000=-141.000
σ	0.000
min	1468.000-1609.000=-141.000
max	1468.000-1609.000=-141.000

*mean*	26.367-26.646=-0.279
σ	0.048-0.208=-0.160
min	26.315-26.393=-0.079
max	26.428-26.859=-0.432