Compare commits

Home / Compare 7f74a907 .. e2b2b451

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.709=-0.005
σ0.370-0.365=0.005
min53.566-53.574=-0.008
max54.758-54.748=0.010
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.139=-0.000
σ0.004-0.004=0.000
min0.134-0.136=-0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.059-42.978=0.081
σ0.006-0.005=0.000
min43.053-42.967=0.086
max43.070-42.987=0.083
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.119-0.113=0.006
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.107-995.222=9.885
σ0.885-1.176=-0.291
min1004.639-994.688=9.951
max1008.774-1000.155=8.619
mean1052.500-1055.100=-2.600
σ320.512-312.180=8.332
min552.000-592.000=-40.000
max1631.000-1513.000=118.000
mean1.634-1.497=0.137
σ0.100-0.136=-0.036
min1.496-1.390=0.106
max1.879-2.019=-0.140

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.413
σ0.121
min0.327
max0.623
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.883
σ0.086
min0.823
max1.034
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.546
σ0.047
min0.515
max0.627
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.841
σ0.039
min0.809
max0.907

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552
σ0.025
min963.523
max963.584
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.819
σ0.029
min0.783
max0.850
name=cdr_enhanced_4k_loc.art
mean884.856
σ0.005
min884.847
max884.860
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.724
σ0.031
min0.673
max0.746

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.712
mean1631.000
σ0.000
min1631.000
max1631.000
mean4.229
σ0.081
min4.105
max4.543
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1631.000
σ0.000
min1631.000
max1631.000
mean4.214
σ0.071
min4.053
max4.491
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.751
σ0.018
min0.716
max0.856
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.712
σ0.015
min0.678
max0.768

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.260
σ0.270
min294.066
max294.977
mean2038.000
σ0.000
min2038.000
max2038.000
mean0.553
σ0.033
min0.501
max0.584

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.492-297.304=-15.812
σ0.034-0.013=0.021
min281.444-297.292=-15.848
max281.525-297.325=-15.800
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean0.387-0.392=-0.005
σ0.006-0.004=0.003
min0.378-0.389=-0.012
max0.394-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1291.478-1299.016=-7.538
σ0.110-0.056=0.054
min1291.355-1298.928=-7.574
max1291.606-1299.064=-7.458
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean1.921-2.081=-0.160
σ0.111-0.224=-0.113
min1.794-1.848=-0.054
max2.065-2.368=-0.303
iters=5
new-facts=6402
prior-facts=1
mean1534.331-1719.188=-184.856
σ4.059-6.894=-2.835
min1532.294-1716.007=-183.713
max1541.582-1731.517=-189.936
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean2.365-2.996=-0.631
σ0.343-0.283=0.060
min2.019-2.630=-0.611
max2.852-3.343=-0.491
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1981.921=-128.564
σ0.049-0.035=0.014
min1853.303-1981.860=-128.557
max1853.424-1981.947=-128.523
mean1782.400-1795.600=-13.200
σ177.765-229.598=-51.833
min1631.000-1534.000=97.000
max2038.000-2110.000=-72.000
mean2.878-3.351=-0.472
σ0.049-0.368=-0.319
min2.841-3.091=-0.250
max2.962-4.000=-1.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.368-1.576=-0.207
σ0.343-0.314=0.029
min1.110-1.154=-0.044
max1.936-1.818=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.426-440.450=1.976
σ577.065-573.024=4.041
min153.891-153.931=-0.040
max1308.024-1299.986=8.038
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean0.519-0.553=-0.035
σ0.518-0.594=-0.076
min0.258-0.255=0.002
max1.296-1.445=-0.149
policies=20
mean1539.196-1539.592=-0.396
σ0.319-0.305=0.014
min1538.976-1539.396=-0.420
max1539.669-1540.046=-0.376
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean2.569-2.571=-0.002
σ0.012-0.080=-0.067
min2.558-2.483=0.075
max2.587-2.677=-0.090
policies=200
mean15400.376-15404.127=-3.750
σ0.141-0.103=0.038
min15400.235-15404.012=-3.777
max15400.554-15404.247=-3.693
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1631.000-1513.000=118.000
σ0.000
min1631.000-1513.000=118.000
max1631.000-1513.000=118.000
mean26.080-26.050=0.030
σ0.132-0.135=-0.002
min25.980-25.897=0.083
max26.274-26.202=0.071