Compare commits

Home / Compare 9a71e525 .. 319f2316

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.370-0.368=0.001
min53.913-53.912=0.000
max55.109-55.104=0.005
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.139-0.137=0.002
σ0.004-0.004=-0.000
min0.136-0.131=0.005
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.002
σ0.006-0.006=-0.000
min43.386-43.382=0.004
max43.406-43.406=0.000
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.121-0.120=0.001
σ0.003-0.004=-0.001
min0.118-0.114=0.004
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.954-1006.924=0.030
σ0.894-0.880=0.015
min1006.488-1006.435=0.053
max1010.677-1010.570=0.106
mean1050.300-1048.700=1.600
σ317.453-309.560=7.894
min548.000-576.000=-28.000
max1651.000-1640.000=11.000
mean1.547-1.531=0.016
σ0.095-0.082=0.013
min1.468-1.448=0.020
max1.782-1.785=-0.002

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.426-0.405=0.021
σ0.132-0.113=0.018
min0.354-0.338=0.016
max0.660-0.606=0.054
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.890-0.885=0.006
σ0.096-0.095=0.001
min0.836-0.819=0.017
max1.061-1.050=0.011
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.541-0.528=0.013
σ0.035-0.054=-0.020
min0.513-0.483=0.030
max0.598-0.616=-0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.848-0.841=0.007
σ0.038-0.036=0.001
min0.815-0.813=0.002
max0.912-0.902=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.032-0.034=-0.001
min964.809-964.811=-0.002
max964.891-964.895=-0.004
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.848-0.832=0.016
σ0.008-0.029=-0.022
min0.837-0.787=0.051
max0.857-0.856=0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.007-0.006=0.001
min885.504
max885.522-885.520=0.002
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.726-0.719=0.008
σ0.035-0.042=-0.007
min0.665-0.644=0.021
max0.747-0.744=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean4.222-4.267=-0.045
σ0.080-0.087=-0.006
min4.026-4.109=-0.083
max4.511-4.479=0.032
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean4.208-4.245=-0.037
σ0.080-0.079=0.001
min4.031-4.100=-0.069
max4.452-4.548=-0.096
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.748-0.742=0.006
σ0.034-0.018=0.016
min0.541-0.712=-0.171
max0.943-0.831=0.112
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.707-0.698=0.008
σ0.014-0.016=-0.002
min0.674-0.663=0.011
max0.788-0.775=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.597-295.470=0.126
σ0.222-0.227=-0.004
min295.436-295.315=0.121
max296.211-296.102=0.108
mean1908.000-1903.000=5.000
σ0.000
min1908.000-1903.000=5.000
max1908.000-1903.000=5.000
mean0.580-0.576=0.005
σ0.038-0.044=-0.006
min0.503-0.504=-0.001
max0.618-0.647=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.399-285.356=0.042
σ0.036-0.037=-0.000
min285.355-285.309=0.046
max285.441-285.393=0.048
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.391-0.388=0.003
σ0.008-0.006=0.001
min0.381-0.382=-0.001
max0.400-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.775-1295.744=0.031
σ0.107-0.113=-0.006
min1295.659-1295.629=0.031
max1295.898-1295.885=0.013
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean1.898-1.901=-0.003
σ0.079-0.074=0.005
min1.814-1.819=-0.005
max1.981-1.982=-0.000
iters=5
new-facts=6402
prior-facts=1
mean1539.945-1539.837=0.108
σ6.857-6.815=0.042
min1536.651-1536.591=0.060
max1552.206-1552.024=0.182
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean2.385-2.232=0.154
σ0.219-0.187=0.032
min2.056-2.047=0.009
max2.605-2.471=0.134
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.649=0.035
σ0.068-0.068=0.000
min1857.596-1857.571=0.026
max1857.771-1857.740=0.032
mean1778.800-1770.800=8.000
σ127.796-128.439=-0.644
min1651.000-1640.000=11.000
max1908.000-1903.000=5.000
mean3.022-3.082=-0.060
σ0.175-0.272=-0.097
min2.869-2.881=-0.012
max3.311-3.549=-0.239

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-1.236=-0.053
σ0.350-0.339=0.011
min0.937-0.941=-0.004
max1.776-1.806=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.488=0.219
σ580.934-580.640=0.294
min155.236-155.166=0.070
max1317.108-1316.449=0.660
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean0.520-0.548=-0.029
σ0.513-0.571=-0.058
min0.259-0.259=0.001
max1.289-1.405=-0.115
policies=20
mean1552.667-1551.934=0.733
σ0.344-0.326=0.018
min1552.434-1551.710=0.724
max1553.179-1552.419=0.760
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean2.611-2.584=0.027
σ0.012-0.010=0.003
min2.596-2.577=0.019
max2.626-2.598=0.028
policies=200
mean15534.621-15527.606=7.015
σ0.143-0.075=0.068
min15534.518-15527.509=7.008
max15534.832-15527.678=7.154
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1640.000=11.000
σ0.000
min1651.000-1640.000=11.000
max1651.000-1640.000=11.000
mean26.296-26.190=0.106
σ0.104-0.154=-0.050
min26.141-26.064=0.077
max26.364-26.407=-0.043