Compare commits

Home / Compare 9297151f .. e9fa2f14

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.107-53.746=0.360
σ0.369-0.366=0.003
min53.962-53.609=0.353
max55.156-54.788=0.368
mean418.700-414.000=4.700
σ0.483-0.000=0.483
min418.000-414.000=4.000
max419.000-414.000=5.000
mean0.139-0.138=0.001
σ0.004-0.004=0.001
min0.131-0.134=-0.003
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.053=0.341
σ0.007-0.006=0.001
min43.389-43.047=0.342
max43.411-43.065=0.346
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.123-0.119=0.004
σ0.003-0.004=-0.000
min0.119-0.114=0.005
max0.128-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.796-1014.526=-7.730
σ1.198-1.212=-0.013
min1006.231-1013.974=-7.743
max1011.823-1019.579=-7.756
mean1053.800-1065.650=-11.850
σ308.911-314.792=-5.880
min578.000-558.000=20.000
max1651.000-1669.000=-18.000
mean1.545-1.650=-0.105
σ0.076-0.110=-0.034
min1.467-1.528=-0.061
max1.791-1.955=-0.164

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.427
σ0.160
min0.342
max0.713
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.907
σ0.133
min0.819
max1.142
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.558
σ0.041
min0.529
max0.630
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.837
σ0.044
min0.800
max0.909

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.023
min964.095
max964.151
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.838
σ0.035
min0.792
max0.877
name=cdr_enhanced_4k_loc.art
mean884.714
σ0.001
min884.713
max884.715
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.666
σ0.070
min0.574
max0.724

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1651.000
σ0.000
min1651.000
max1651.000
mean4.244
σ0.091
min3.714
max4.581
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.668
mean1651.000
σ0.000
min1651.000
max1651.000
mean4.215
σ0.072
min4.103
max4.459
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.739
σ0.017
min0.706
max0.847
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1651.000
σ0.000
min1651.000
max1651.000
mean0.701
σ0.014
min0.674
max0.753

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.819-299.729=-2.911
σ0.220-0.217=0.002
min296.671-299.594=-2.923
max297.423-300.301=-2.877
mean1897.000-2012.000=-115.000
σ0.000
min1897.000-2012.000=-115.000
max1897.000-2012.000=-115.000
mean0.593-0.574=0.020
σ0.050-0.024=0.026
min0.529-0.533=-0.004
max0.715-0.598=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.488-296.632=-10.144
σ0.037-0.013=0.023
min286.439-296.617=-10.178
max286.526-296.652=-10.126
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean0.403-0.385=0.018
σ0.007-0.004=0.003
min0.397-0.382=0.016
max0.412-0.391=0.021
iters=5
new-facts=1
prior-facts=6402
mean1296.839-1318.893=-22.055
σ0.105-0.095=0.011
min1296.759-1318.843=-22.084
max1297.012-1319.062=-22.050
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean1.944-1.958=-0.014
σ0.170-0.110=0.061
min1.808-1.824=-0.016
max2.231-2.062=0.169
iters=5
new-facts=6402
prior-facts=1
mean1541.045-1557.263=-16.218
σ6.840-6.852=-0.011
min1537.871-1553.966=-16.095
max1553.280-1569.514=-16.234
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean2.341-2.341=-0.000
σ0.270-0.204=0.066
min2.129-2.069=0.060
max2.689-2.621=0.067
iters=5
new-facts=6402
prior-facts=6402
mean1858.788-1886.727=-27.939
σ0.057-0.026=0.031
min1858.730-1886.698=-27.967
max1858.862-1886.764=-27.902
mean1769.200-1792.800=-23.600
σ122.156-149.802=-27.646
min1651.000-1669.000=-18.000
max1897.000-2012.000=-115.000
mean3.075-2.911=0.164
σ0.255-0.045=0.209
min2.863-2.861=0.002
max3.506-2.964=0.542

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.087=0.044
σ0.240-0.196=0.044
min0.934-0.910=0.023
max1.490-1.357=0.133

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.415-441.303=7.112
σ581.253-573.440=7.814
min157.786-154.574=3.212
max1320.295-1301.463=18.832
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean0.565-0.551=0.014
σ0.607-0.575=0.031
min0.253-0.259=-0.006
max1.475-1.414=0.061
policies=20
mean1578.160-1545.970=32.190
σ0.356-0.314=0.042
min1577.920-1545.798=32.122
max1578.690-1546.441=32.249
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean2.643-2.603=0.040
σ0.022-0.013=0.009
min2.617-2.584=0.033
max2.665-2.616=0.049
policies=200
mean15789.493-15467.493=322.000
σ0.189-0.076=0.113
min15789.328-15467.386=321.942
max15789.764-15467.564=322.199
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1669.000=-18.000
σ0.000
min1651.000-1669.000=-18.000
max1651.000-1669.000=-18.000
mean26.692-26.262=0.430
σ0.074-0.074=-0.000
min26.626-26.199=0.427
max26.791-26.345=0.446