Compare commits

Home / Compare dc0a58f0 .. 5bbb1f96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.044=0.001
σ0.369-0.368=0.001
min53.906-53.902=0.005
max55.095-55.092=0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.135=0.003
σ0.005-0.005=-0.000
min0.132-0.129=0.003
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.007-0.007=-0.000
min43.374-43.376=-0.002
max43.399-43.399=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.000
min0.115-0.115=0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.980=0.001
σ0.864-0.871=-0.006
min1006.492-1006.491=0.002
max1010.551-1010.580=-0.029
mean1051.000-1043.650=7.350
σ310.314-314.008=-3.694
min575.000-574.000=1.000
max1647.000-1638.000=9.000
mean1.553-1.565=-0.012
σ0.070-0.087=-0.016
min1.475-1.481=-0.007
max1.752-1.841=-0.089

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.432-0.413=0.020
σ0.186-0.137=0.049
min0.334-0.330=0.004
max0.765-0.654=0.110
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.930-0.870=0.059
σ0.138-0.094=0.045
min0.820-0.806=0.014
max1.151-1.034=0.117
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.530-0.531=-0.001
σ0.044-0.048=-0.004
min0.494-0.499=-0.005
max0.603-0.615=-0.012
name=nested_use.art
mean2.361-2.362=-0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.821-0.845=-0.025
σ0.037-0.045=-0.008
min0.792-0.807=-0.015
max0.881-0.921=-0.040

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.836=-0.001
σ0.029-0.031=-0.002
min964.811-964.811=-0.000
max964.884-964.889=-0.005
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.810-0.804=0.006
σ0.049-0.043=0.006
min0.744-0.765=-0.021
max0.856-0.854=0.003
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.004-0.007=-0.003
min885.509-885.504=0.005
max885.519-885.521=-0.002
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.711-0.661=0.051
σ0.044-0.054=-0.010
min0.652-0.604=0.049
max0.746-0.734=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.001
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean4.198-4.205=-0.007
σ0.080-0.067=0.013
min4.054-4.076=-0.022
max4.586-4.401=0.184
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean4.228-4.226=0.003
σ0.079-0.103=-0.024
min4.087-4.050=0.038
max4.455-4.485=-0.030
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.735-0.745=-0.010
σ0.033-0.037=-0.004
min0.564-0.524=0.040
max0.903-0.924=-0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.693-0.700=-0.007
σ0.016-0.015=0.001
min0.667-0.673=-0.006
max0.792-0.763=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.611-295.483=0.128
σ0.236-0.249=-0.014
min295.397-295.335=0.061
max296.222-296.177=0.045
mean1975.000-2013.000=-38.000
σ0.000
min1975.000-2013.000=-38.000
max1975.000-2013.000=-38.000
mean0.568-0.564=0.004
σ0.031-0.040=-0.009
min0.497-0.517=-0.020
max0.599-0.609=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.411=0.000
σ0.037-0.039=-0.002
min285.361-285.359=0.003
max285.448-285.450=-0.002
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.387-0.386=0.001
σ0.009-0.007=0.003
min0.379-0.380=-0.001
max0.402-0.393=0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.797-1295.796=0.001
σ0.101-0.107=-0.006
min1295.677-1295.668=0.009
max1295.899-1295.924=-0.025
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean1.906-1.892=0.014
σ0.090-0.068=0.023
min1.813-1.829=-0.016
max2.040-1.986=0.054
iters=5
new-facts=6402
prior-facts=1
mean1539.932-1539.977=-0.045
σ6.858-6.833=0.025
min1536.629-1536.636=-0.008
max1552.196-1552.194=0.002
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean2.232-2.428=-0.196
σ0.187-0.243=-0.056
min2.056-2.023=0.032
max2.534-2.662=-0.129
iters=5
new-facts=6402
prior-facts=6402
mean1857.704-1857.703=0.001
σ0.060-0.060=0.000
min1857.634-1857.645=-0.011
max1857.792-1857.780=0.012
mean1782.800-1777.800=5.000
σ128.032-162.167=-34.135
min1647.000-1638.000=9.000
max1975.000-2013.000=-38.000
mean2.907-3.091=-0.184
σ0.100-0.276=-0.176
min2.773-2.842=-0.069
max3.025-3.518=-0.492

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.326-1.320=0.007
σ0.262-0.230=0.032
min1.102-1.105=-0.003
max1.776-1.710=0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.001
σ580.935-580.934=0.001
min155.272-155.271=0.000
max1317.143-1317.140=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean0.537-0.540=-0.004
σ0.558-0.565=-0.007
min0.256-0.255=0.002
max1.374-1.388=-0.015
policies=20
mean1552.980-1552.973=0.007
σ0.321-0.331=-0.010
min1552.766-1552.746=0.019
max1553.458-1553.464=-0.006
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean2.590-2.591=-0.001
σ0.018-0.015=0.003
min2.566-2.578=-0.011
max2.603-2.610=-0.007
policies=200
mean15537.951-15537.970=-0.019
σ0.209-0.129=0.080
min15537.735-15537.804=-0.069
max15538.216-15538.087=0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1638.000=9.000
σ0.000
min1647.000-1638.000=9.000
max1647.000-1638.000=9.000
mean26.149-26.134=0.015
σ0.121-0.129=-0.008
min26.036-26.026=0.011
max26.307-26.320=-0.013