Compare commits

Home / Compare a94e667f .. 6ea29a8f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-53.971=0.043
σ0.371-0.369=0.002
min53.870-53.830=0.040
max55.069-55.021=0.048
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.138-0.139=-0.000
σ0.004-0.004=-0.001
min0.135-0.131=0.003
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.324-43.342=-0.018
σ0.009-0.007=0.002
min43.316-43.331=-0.015
max43.346-43.351=-0.005
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.120-0.120=0.000
σ0.001-0.005=-0.004
min0.119-0.113=0.006
max0.121-0.127=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1016.894=-10.587
σ1.177-1.188=-0.011
min1005.771-1016.338=-10.567
max1011.234-1021.874=-10.640
mean1054.100-1058.300=-4.200
σ307.264-316.292=-9.028
min587.000-561.000=26.000
max1646.000-1517.000=129.000
mean1.553-1.539=0.014
σ0.089-0.065=0.023
min1.469-1.398=0.071
max1.795-1.676=0.120

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.414
σ0.146
min0.324
max0.673
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.890
σ0.087
min0.832
max1.043
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.539
σ0.051
min0.499
max0.627
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.845
σ0.044
min0.810
max0.917

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.027
min964.094
max964.157
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.807
σ0.040
min0.764
max0.849
name=cdr_enhanced_4k_loc.art
mean884.712
σ0.006
min884.705
max884.721
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.723
σ0.019
min0.693
max0.741

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1646.000
σ0.000
min1646.000
max1646.000
mean4.236
σ0.093
min4.091
max4.656
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1646.000
σ0.000
min1646.000
max1646.000
mean4.217
σ0.072
min4.100
max4.498
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.643
σ0.107
min0.507
max0.851
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.511
σ0.028
min0.482
max0.675

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.277-301.857=-5.580
σ0.224-0.221=0.003
min296.119-301.716=-5.597
max296.894-302.472=-5.578
mean1906.000-1960.000=-54.000
σ0.000
min1906.000-1960.000=-54.000
max1906.000-1960.000=-54.000
mean0.590-0.580=0.010
σ0.043-0.035=0.008
min0.532-0.504=0.027
max0.700-0.606=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-303.526=-18.835
σ0.037-0.036=0.001
min284.643-303.479=-18.836
max284.732-303.571=-18.839
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean0.400-0.387=0.013
σ0.012-0.001=0.011
min0.386-0.386=0.000
max0.411-0.388=0.023
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1326.080=-31.000
σ0.114-0.133=-0.018
min1294.952-1325.903=-30.950
max1295.217-1326.232=-31.016
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean1.878-1.948=-0.069
σ0.079-0.112=-0.033
min1.788-1.838=-0.050
max1.982-2.136=-0.154
iters=5
new-facts=6402
prior-facts=1
mean1539.178-1564.107=-24.929
σ6.838-6.894=-0.056
min1535.897-1560.797=-24.900
max1551.407-1576.433=-25.026
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean2.280-2.278=0.002
σ0.244-0.175=0.069
min2.050-2.126=-0.076
max2.640-2.570=0.070
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1894.006=-37.020
σ0.058-0.069=-0.011
min1856.929-1893.890=-36.961
max1857.065-1894.065=-37.000
mean1775.000-1740.200=34.800
σ128.639-171.319=-42.680
min1646.000-1517.000=129.000
max1906.000-1960.000=-54.000
mean3.077-2.924=0.153
σ0.303-0.074=0.229
min2.855-2.825=0.031
max3.605-2.997=0.608

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.530=-0.357
σ0.327-0.279=0.048
min0.925-1.223=-0.298
max1.703-1.792=-0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-444.699=3.087
σ581.212-575.141=6.072
min157.179-157.125=0.054
max1319.605-1307.411=12.194
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean0.546-0.523=0.023
σ0.569-0.522=0.047
min0.261-0.258=0.002
max1.399-1.307=0.093
policies=20
mean1572.104-1571.544=0.560
σ0.355-0.345=0.011
min1571.865-1571.314=0.550
max1572.632-1572.057=0.575
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean2.641-2.622=0.019
σ0.016-0.016=-0.000
min2.620-2.606=0.014
max2.654-2.643=0.012
policies=200
mean15729.079-15723.355=5.724
σ0.066-0.087=-0.021
min15729.016-15723.298=5.718
max15729.159-15723.483=5.676
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1517.000=129.000
σ0.000
min1646.000-1517.000=129.000
max1646.000-1517.000=129.000
mean26.661-26.508=0.153
σ0.236-0.189=0.047
min26.455-26.300=0.155
max26.994-26.687=0.306