Compare commits

Home / Compare 71568bdc .. 8fa514e1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.052-54.046=0.006
σ0.370-0.371=-0.000
min53.916-53.901=0.015
max55.105-55.100=0.005
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.159-0.139=0.019
σ0.006-0.005=0.001
min0.150-0.132=0.017
max0.168-0.148=0.020
cache=y
dps=1
iters=10
policies=100
mean43.389-43.384=0.006
σ0.007-0.007=0.000
min43.378-43.370=0.008
max43.404-43.394=0.011
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.140-0.123=0.017
σ0.010-0.004=0.006
min0.122-0.120=0.002
max0.155-0.130=0.025

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=0.000
σ0.907-0.880=0.027
min1006.481-1006.507=-0.026
max1010.751-1010.622=0.128
mean1051.000-1049.900=1.100
σ306.535-316.359=-9.824
min578.000
max1645.000-1652.000=-7.000
mean1.559-1.577=-0.018
σ0.066-0.129=-0.063
min1.485-1.474=0.012
max1.676-2.067=-0.391

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.421-0.409=0.012
σ0.151-0.136=0.015
min0.336-0.329=0.007
max0.689-0.649=0.041
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.889-0.880=0.009
σ0.085-0.084=0.001
min0.824-0.827=-0.004
max1.034-1.028=0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.540-0.544=-0.003
σ0.051-0.054=-0.003
min0.502-0.504=-0.002
max0.628-0.632=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.858-0.836=0.021
σ0.043-0.040=0.003
min0.823-0.800=0.024
max0.934-0.904=0.029

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.837=-0.005
σ0.025-0.031=-0.005
min964.802-964.810=-0.009
max964.863-964.888=-0.025
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.822-0.800=0.021
σ0.063-0.020=0.043
min0.709-0.766=-0.057
max0.852-0.815=0.037
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.006-0.006=0.000
min885.504-885.505=-0.001
max885.519-885.520=-0.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.666-0.696=-0.030
σ0.039-0.047=-0.008
min0.615-0.627=-0.012
max0.714-0.737=-0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.002
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.246-4.258=-0.013
σ0.082-0.097=-0.015
min4.061-4.091=-0.030
max4.522-4.662=-0.140
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.219-4.228=-0.009
σ0.071-0.101=-0.030
min4.106-4.081=0.025
max4.474-4.608=-0.134
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.739-0.740=-0.001
σ0.019-0.018=0.001
min0.707-0.708=-0.001
max0.858-0.840=0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.598-0.694=-0.096
σ0.102-0.015=0.087
min0.485-0.667=-0.183
max0.887-0.766=0.121

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.439-295.586=-0.147
σ0.279-0.219=0.060
min295.201-295.414=-0.213
max296.195-296.180=0.015
mean2027.000-1901.000=126.000
σ0.000
min2027.000-1901.000=126.000
max2027.000-1901.000=126.000
mean0.543-0.554=-0.011
σ0.039-0.053=-0.015
min0.500-0.497=0.004
max0.596-0.645=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.412=0.001
σ0.038-0.034=0.005
min285.361-285.367=-0.007
max285.452-285.447=0.005
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.396-0.395=0.001
σ0.005-0.012=-0.006
min0.391-0.382=0.009
max0.405-0.412=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.810-1295.796=0.014
σ0.118-0.104=0.014
min1295.682-1295.660=0.022
max1295.969-1295.906=0.062
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean1.894-2.011=-0.117
σ0.098-0.275=-0.177
min1.819-1.818=0.001
max2.049-2.485=-0.436
iters=5
new-facts=6402
prior-facts=1
mean1539.922-1539.954=-0.032
σ6.878-6.880=-0.002
min1536.644-1536.620=0.023
max1552.222-1552.255=-0.033
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.237-2.351=-0.114
σ0.218-0.184=0.034
min2.038-2.031=0.007
max2.550-2.479=0.071
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.712=-0.002
σ0.047-0.056=-0.009
min1857.655-1857.649=0.007
max1857.772-1857.778=-0.006
mean1777.800-1772.800=5.000
σ167.813-123.194=44.619
min1645.000-1652.000=-7.000
max2027.000-1901.000=126.000
mean2.901-3.112=-0.211
σ0.068-0.292=-0.224
min2.845-2.871=-0.026
max2.981-3.598=-0.617

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.373-1.314=0.060
σ0.218-0.307=-0.089
min1.113-1.094=0.019
max1.638-1.840=-0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.738-445.738=-0.000
σ580.935-580.934=0.000
min155.268-155.270=-0.002
max1317.140-1317.140=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.527-0.535=-0.008
σ0.531-0.540=-0.009
min0.257-0.264=-0.007
max1.324-1.345=-0.021
policies=20
mean1552.976-1552.976=-0.001
σ0.330-0.341=-0.010
min1552.750-1552.739=0.011
max1553.466-1553.482=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.599-2.601=-0.002
σ0.013-0.009=0.004
min2.586-2.594=-0.008
max2.618-2.614=0.004
policies=200
mean15537.928-15538.000=-0.072
σ0.269-0.168=0.101
min15537.584-15537.853=-0.268
max15538.207-15538.209=-0.002
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean26.280-26.293=-0.013
σ0.031-0.103=-0.072
min26.239-26.170=0.069
max26.310-26.380=-0.070