Compare commits

Home / Compare 76672abf .. 7b808d5f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.047=-0.002
σ0.368-0.369=-0.001
min53.898-53.904=-0.006
max55.091-55.096=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.385=-0.000
σ0.006-0.005=0.001
min43.375-43.378=-0.002
max43.393-43.394=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.119-0.120=-0.001
max0.127-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.979=-0.001
σ0.876-0.872=0.004
min1006.482-1006.481=0.001
max1010.610-1010.590=0.020
mean1053.800-1051.750=2.050
σ316.519-316.597=-0.078
min547.000-545.000=2.000
max1634.000-1632.000=2.000
mean1.550-1.533=0.017
σ0.089-0.076=0.013
min1.476-1.376=0.100
max1.795-1.740=0.055

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.426-0.419=0.007
σ0.154-0.139=0.015
min0.338-0.335=0.003
max0.696-0.666=0.030
name=error_case.art
mean2.339-2.339=-0.000
σ0.002-0.003=-0.000
min2.337-2.337=0.000
max2.342
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.938-0.910=0.028
σ0.211-0.072=0.138
min0.824-0.862=-0.038
max1.312-1.032=0.280
name=heavy_item.art
mean1.524-1.523=0.001
σ0.003-0.001=0.001
min1.522
max1.528-1.525=0.002
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.533-0.541=-0.008
σ0.050-0.050=0.001
min0.496-0.508=-0.013
max0.617-0.625=-0.007
name=nested_use.art
mean2.362-2.362=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.845-0.837=0.008
σ0.035-0.040=-0.005
min0.822-0.796=0.026
max0.905-0.897=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.830=0.005
σ0.026-0.025=0.001
min964.811-964.802=0.009
max964.879-964.863=0.016
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.824-0.825=-0.001
σ0.044-0.032=0.012
min0.769-0.796=-0.027
max0.862-0.864=-0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.005-0.004=0.002
min885.504-885.508=-0.004
max885.518-885.518=-0.000
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.711-0.729=-0.018
σ0.025-0.014=0.011
min0.677-0.705=-0.028
max0.747-0.743=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean4.288-4.235=0.054
σ0.093-0.090=0.003
min4.168-4.080=0.087
max4.669-4.490=0.179
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean4.287-4.234=0.053
σ0.086-0.083=0.002
min4.131-4.089=0.042
max4.620-4.472=0.148
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.742-0.753=-0.012
σ0.017-0.019=-0.002
min0.708-0.704=0.004
max0.850-0.831=0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.691-0.707=-0.016
σ0.021-0.024=-0.003
min0.652-0.562=0.090
max0.774-0.803=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.574-295.691=-0.117
σ0.228-0.192=0.036
min295.394-295.592=-0.198
max296.183-296.223=-0.039
mean1913.000-1909.000=4.000
σ0.000
min1913.000-1909.000=4.000
max1913.000-1909.000=4.000
mean0.584-0.583=0.000
σ0.034-0.051=-0.017
min0.501-0.498=0.003
max0.615-0.689=-0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.404=0.004
σ0.036-0.040=-0.004
min285.359-285.354=0.005
max285.446-285.447=-0.001
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.386-0.386=0.000
σ0.009-0.006=0.002
min0.381-0.381=-0.001
max0.401-0.394=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.797=-0.005
σ0.098-0.106=-0.008
min1295.679-1295.679=0.000
max1295.891-1295.914=-0.022
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean1.949-1.917=0.032
σ0.137-0.090=0.046
min1.812-1.826=-0.015
max2.131-2.009=0.122
iters=5
new-facts=6402
prior-facts=1
mean1538.655-1538.643=0.012
σ4.058-3.978=0.081
min1536.582-1536.626=-0.043
max1545.905-1545.748=0.156
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean2.283-2.284=-0.001
σ0.353-0.116=0.237
min2.028-2.137=-0.109
max2.891-2.445=0.446
iters=5
new-facts=6402
prior-facts=6402
mean1857.703-1857.704=-0.002
σ0.054-0.050=0.004
min1857.648-1857.653=-0.005
max1857.770-1857.768=0.002
mean1768.800-1779.000=-10.200
σ139.895-133.654=6.241
min1634.000-1632.000=2.000
max1913.000-1909.000=4.000
mean3.046-3.106=-0.060
σ0.126-0.283=-0.157
min2.862-2.865=-0.003
max3.146-3.590=-0.444

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.376=-0.079
σ0.342-0.206=0.136
min1.000-1.268=-0.269
max1.880-1.743=0.137

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.061-444.060=0.002
σ577.575-577.575=0.000
min155.273-155.271=0.001
max1310.424-1310.422=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean0.541-0.541=0.000
σ0.560-0.563=-0.004
min0.260-0.252=0.008
max1.381-1.386=-0.005
policies=20
mean1552.990-1552.971=0.019
σ0.324-0.323=0.000
min1552.767-1552.753=0.015
max1553.471-1553.451=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean2.590-2.591=-0.000
σ0.017-0.024=-0.007
min2.572-2.572=-0.000
max2.610-2.622=-0.011
policies=200
mean15538.053-15538.036=0.016
σ0.103-0.108=-0.004
min15537.958-15537.895=0.063
max15538.193-15538.156=0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1632.000=2.000
σ0.000
min1634.000-1632.000=2.000
max1634.000-1632.000=2.000
mean26.132-26.132=0.000
σ0.073-0.137=-0.063
min26.063-26.037=0.026
max26.236-26.333=-0.097