Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.617-53.836=0.781
σ	0.350-0.370=-0.020
min	54.479-53.692=0.787
max	55.613-54.888=0.725

*mean*	415.000-416.000=-1.000
σ	0.000
min	415.000-416.000=-1.000
max	415.000-416.000=-1.000

*mean*	0.138-0.139=-0.001
σ	0.004-0.004=-0.000
min	0.133-0.136=-0.003
max	0.145-0.146=-0.001

cache=y

dps=1

iters=10

policies=100

*mean*	43.787-43.208=0.579
σ	0.006-0.006=-0.001
min	43.777-43.197=0.580
max	43.797-43.222=0.575

*mean*	415.000-416.000=-1.000
σ	0.000
min	415.000-416.000=-1.000
max	415.000-416.000=-1.000

*mean*	0.123-0.121=0.002
σ	0.004-0.003=0.000
min	0.119-0.117=0.001
max	0.128-0.127=0.002

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.111
σ	1.725
min	12.147
max	17.353

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.024
σ	2.069
min	11.307
max	17.830

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	14.040
σ	1.006
min	12.718
max	15.523

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	13.203
σ	2.287
min	10.625
max	15.906

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	9.353
σ	1.717
min	7.966
max	12.438

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	7.084
σ	1.395
min	6.032
max	9.494

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	5.781
σ	0.477
min	5.549
max	6.949

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	5.550
σ	0.479
min	5.216
max	6.705

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.594
σ	0.000
min	2524.594
max	2524.594

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	1100.339
σ	157.411
min	1036.134
max	1489.719

op=load_product(), with indexes

*mean*	8744.559
σ	0.032
min	8744.544
max	8744.639

*mean*	3765.125
σ	1635.880
min	1894.000
max	5941.000

*mean*	4541.602
σ	1363.394
min	3506.098
max	6551.399

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	91.561
σ	17.623
min	72.337
max	127.552

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	232.528
σ	372.464
min	89.923
max	1154.198

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	151.555
σ	12.107
min	134.814
max	166.070

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.520

*mean*	4254.875
σ	1894.259
min	1894.000
max	7545.000

*mean*	6522.964
σ	1086.255
min	4880.030
max	7906.077

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.066
max	11560.069

*mean*	7545.000
σ	0.000
min	7545.000
max	7545.000

*mean*	5423.100
σ	1340.516
min	4355.183
max	7460.910

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.582
σ	0.028
min	172.558
max	172.624

*mean*	1894.000
σ	0.000
min	1894.000
max	1894.000

*mean*	351.637
σ	33.493
min	294.516
max	398.454

op=pointedIndexFromKvs

rows=400000

*mean*	357.363
σ	0.040
min	357.321
max	357.414

*mean*	1894.000
σ	0.000
min	1894.000
max	1894.000

*mean*	782.314
σ	28.094
min	728.675
max	824.297

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.186-1016.204=-8.018
σ	0.880-1.167=-0.287
min	1007.687-1015.651=-7.964
max	1011.837-1021.092=-9.255

*mean*	1038.650-1050.900=-12.250
σ	305.109-303.538=1.571
min	546.000-574.000=-28.000
max	1468.000-1452.000=16.000

*mean*	1.532-1.573=-0.041
σ	0.115-0.080=0.035
min	1.357-1.510=-0.153
max	1.894-1.780=0.114

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.421
σ	0.151
min	0.335
max	0.689

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.940
σ	0.200
min	0.833
max	1.294

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.538
σ	0.050
min	0.497
max	0.624

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.869
σ	0.063
min	0.806
max	0.969

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.543
σ	0.024
min	963.524
max	963.584

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.857
σ	0.015
min	0.833
max	0.871

name=cdr_enhanced_4k_loc.art

*mean*	884.855
σ	0.006
min	884.847
max	884.862

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.742
σ	0.006
min	0.733
max	0.749

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.239
σ	0.079
min	4.123
max	4.559

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.228
σ	0.088
min	4.056
max	4.541

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.653
σ	0.104
min	0.515
max	0.836

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.508
σ	0.017
min	0.487
max	0.636

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.491-301.478=-3.987
σ	0.219-0.210=0.009
min	297.289-301.230=-3.942
max	298.040-301.967=-3.927

*mean*	1894.000-2017.000=-123.000
σ	0.000
min	1894.000-2017.000=-123.000
max	1894.000-2017.000=-123.000

*mean*	0.588-0.543=0.045
σ	0.031-0.046=-0.015
min	0.517-0.496=0.021
max	0.626-0.607=0.019

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.772-301.482=-11.709
σ	0.032-0.042=-0.010
min	289.731-301.430=-11.699
max	289.805-301.526=-11.721

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	0.404-0.390=0.014
σ	0.013-0.002=0.011
min	0.397-0.388=0.009
max	0.427-0.392=0.035

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.646-1324.053=-24.408
σ	0.079-0.102=-0.023
min	1299.547-1323.923=-24.376
max	1299.714-1324.187=-24.472

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	2.033-1.960=0.073
σ	0.016-0.129=-0.113
min	2.012-1.833=0.179
max	2.055-2.135=-0.080

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.615-1562.102=-19.487
σ	4.038-6.918=-2.880
min	1540.566-1558.801=-18.235
max	1549.828-1574.472=-24.645

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	2.237-2.384=-0.147
σ	0.165-0.328=-0.163
min	2.077-2.057=0.020
max	2.453-2.784=-0.331

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.628-1891.967=-30.339
σ	0.079-0.069=0.011
min	1861.508-1891.846=-30.338
max	1861.704-1892.008=-30.304

*mean*	1737.600-1713.600=24.000
σ	173.001-221.093=-48.093
min	1488.000-1452.000=36.000
max	1894.000-2017.000=-123.000

*mean*	3.162-2.976=0.186
σ	0.375-0.146=0.229
min	2.869-2.843=0.026
max	3.771-3.137=0.634

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.742-1.715=0.027
σ	0.173-0.132=0.041
min	1.546-1.544=0.001
max	1.933-1.850=0.083

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.147-443.476=2.671
σ	577.064-574.225=2.839
min	157.614-156.358=1.256
max	1311.743-1304.814=6.929

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	0.550-0.528=0.021
σ	0.570-0.532=0.038
min	0.262-0.261=0.001
max	1.405-1.326=0.079

policies=20

*mean*	1576.409-1563.911=12.499
σ	0.347-0.345=0.001
min	1576.173-1563.680=12.493
max	1576.925-1564.425=12.500

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	2.619-2.626=-0.007
σ	0.008-0.004=0.003
min	2.611-2.622=-0.011
max	2.627-2.632=-0.005

policies=200

*mean*	15772.107-15646.920=125.187
σ	0.139-0.120=0.019
min	15772.024-15646.797=125.227
max	15772.314-15647.082=125.232

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1468.000-1452.000=16.000
σ	0.000
min	1468.000-1452.000=16.000
max	1468.000-1452.000=16.000

*mean*	26.367-26.655=-0.288
σ	0.048-0.216=-0.167
min	26.315-26.507=-0.192
max	26.428-26.969=-0.541