Compare commits

Home / Compare d6aa27c3 .. 808baf0d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.369-0.370=-0.002
min53.867-53.870=-0.002
max55.062-55.068=-0.006
mean414.700-415.000=-0.300
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.140-0.140=-0.001
σ0.004-0.004=0.000
min0.136-0.137=-0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=-0.000
σ0.006-0.005=0.001
min43.313-43.314=-0.002
max43.332-43.331=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.117-0.123=-0.006
σ0.003-0.004=-0.001
min0.114-0.119=-0.005
max0.121-0.129=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1011.001=-4.695
σ1.170-1.162=0.009
min1005.769-1010.435=-4.665
max1011.208-1015.868=-4.660
mean1054.200-1043.050=11.150
σ303.029-295.299=7.730
min595.000-570.000=25.000
max1451.000-1427.000=24.000
mean1.556-1.564=-0.009
σ0.080-0.080=0.001
min1.484-1.480=0.004
max1.747-1.762=-0.015

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.413
σ0.125
min0.340
max0.635
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.907
σ0.113
min0.839
max1.105
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.541
σ0.062
min0.484
max0.647
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.837
σ0.030
min0.814
max0.889

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097
σ0.025
min964.077
max964.138
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.829
σ0.023
min0.798
max0.853
name=cdr_enhanced_4k_loc.art
mean884.710
σ0.006
min884.703
max884.716
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.724
σ0.037
min0.659
max0.750

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1451.000
σ0.000
min1451.000
max1451.000
mean4.247
σ0.094
min4.088
max4.587
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1451.000
σ0.000
min1451.000
max1451.000
mean4.228
σ0.073
min4.072
max4.464
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.729
σ0.019
min0.697
max0.859
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1451.000
σ0.000
min1451.000
max1451.000
mean0.694
σ0.025
min0.497
max0.779

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.304-301.043=-4.738
σ0.230-0.224=0.005
min296.136-300.881=-4.745
max296.936-301.663=-4.727
mean1908.000-1940.000=-32.000
σ0.000
min1908.000-1940.000=-32.000
max1908.000-1940.000=-32.000
mean0.576-0.555=0.021
σ0.048-0.028=0.020
min0.514-0.502=0.012
max0.677-0.574=0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-299.451=-14.754
σ0.035-0.036=-0.001
min284.652-299.399=-14.746
max284.739-299.492=-14.754
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean0.397-0.388=0.009
σ0.010-0.006=0.004
min0.386-0.383=0.003
max0.405-0.399=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.089-1309.874=-14.785
σ0.064-0.086=-0.022
min1295.011-1309.764=-14.754
max1295.170-1309.997=-14.828
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean2.067-1.899=0.169
σ0.053-0.075=-0.022
min2.005-1.809=0.197
max2.140-2.006=0.135
iters=5
new-facts=6402
prior-facts=1
mean1539.174-1553.968=-14.794
σ6.859-6.845=0.013
min1535.937-1550.681=-14.744
max1551.439-1566.207=-14.767
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean2.206-2.257=-0.051
σ0.170-0.246=-0.076
min1.969-1.940=0.029
max2.377-2.612=-0.236
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1871.760=-14.780
σ0.080-0.048=0.031
min1856.865-1871.699=-14.834
max1857.067-1871.800=-14.733
mean1746.800-1722.400=24.400
σ175.252-157.149=18.103
min1498.000-1525.000=-27.000
max1908.000-1940.000=-32.000
mean3.126-2.929=0.198
σ0.253-0.091=0.162
min2.856-2.849=0.008
max3.497-3.066=0.431

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.815=-0.058
σ0.091-0.061=0.030
min1.609-1.749=-0.140
max1.851-1.892=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.790=-0.005
σ581.213-581.212=0.001
min157.176-157.183=-0.007
max1319.605-1319.608=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean0.550-0.547=0.003
σ0.579-0.572=0.007
min0.259-0.258=0.001
max1.418-1.405=0.014
policies=20
mean1572.099-1572.104=-0.005
σ0.355-0.338=0.017
min1571.857-1571.895=-0.038
max1572.626-1572.609=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean2.623-2.629=-0.006
σ0.015-0.013=0.002
min2.607-2.613=-0.005
max2.640-2.643=-0.003
policies=200
mean15729.041-15728.884=0.157
σ0.020-0.095=-0.075
min15729.015-15728.778=0.237
max15729.063-15728.993=0.070
mean9200.000
σ0.000
min9200.000
max9200.000
mean1451.000-1427.000=24.000
σ0.000
min1451.000-1427.000=24.000
max1451.000-1427.000=24.000
mean26.519-26.548=-0.029
σ0.049-0.191=-0.142
min26.461-26.418=0.042
max26.564-26.826=-0.262