Compare commits

Home / Compare 90c61493 .. 5eca3fac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.965=-0.000
σ0.369-0.371=-0.002
min53.820-53.829=-0.009
max55.014-55.021=-0.007
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.139-0.140=-0.000
σ0.004-0.006=-0.002
min0.136-0.131=0.005
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.007-0.006=0.001
min43.311-43.313=-0.002
max43.331-43.337=-0.006
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.119-0.123=-0.003
σ0.005-0.005=0.000
min0.115-0.118=-0.003
max0.129-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.518=0.002
σ1.151-1.164=-0.013
min1005.950-1005.952=-0.002
max1011.331-1011.394=-0.063
mean1051.500-1049.450=2.050
σ305.299-305.834=-0.535
min594.000-591.000=3.000
max1645.000-1643.000=2.000
mean1.508-1.530=-0.022
σ0.052-0.058=-0.006
min1.448-1.462=-0.014
max1.618-1.641=-0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.415-0.424=-0.009
σ0.139-0.135=0.004
min0.333-0.342=-0.009
max0.661-0.663=-0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.881-0.886=-0.005
σ0.092-0.088=0.003
min0.817-0.827=-0.010
max1.038-1.041=-0.003
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.532-0.538=-0.006
σ0.044-0.052=-0.008
min0.486-0.499=-0.014
max0.600-0.625=-0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.858-0.847=0.011
σ0.039-0.049=-0.010
min0.829-0.809=0.020
max0.926-0.929=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.034-0.033=0.001
min964.810-964.811=-0.001
max964.896-964.894=0.002
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.807-0.829=-0.021
σ0.032-0.032=0.000
min0.768-0.794=-0.026
max0.851-0.863=-0.013
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.007=0.001
min885.506
max885.524-885.522=0.002
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.636-0.728=-0.092
σ0.131-0.028=0.103
min0.409-0.678=-0.268
max0.723-0.744=-0.022

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.644-4.327=-1.683
σ0.097-0.111=-0.013
min2.487-4.112=-1.625
max2.993-4.921=-1.928
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.641-4.270=-1.628
σ0.106-0.078=0.028
min2.479-4.149=-1.671
max2.965-4.598=-1.633
name=record_render_success.art
mean2.291-2.291=0.000
σ0.002-0.002=-0.000
min2.290
max2.294
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.303-0.650=-0.346
σ0.008-0.112=-0.104
min0.292-0.515=-0.223
max0.354-0.844=-0.490
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.285-0.497=-0.212
σ0.008-0.056=-0.049
min0.273-0.289=-0.016
max0.319-0.590=-0.271

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-296.575=-0.250
σ0.201-0.179=0.021
min296.141-296.413=-0.272
max296.864-297.042=-0.179
mean2027.000-1901.000=126.000
σ0.000
min2027.000-1901.000=126.000
max2027.000-1901.000=126.000
mean0.540-0.584=-0.043
σ0.029-0.046=-0.017
min0.506-0.508=-0.002
max0.591-0.689=-0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-285.030=0.002
σ0.039-0.036=0.003
min284.977-284.990=-0.013
max285.073-285.071=0.002
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.397-0.402=-0.005
σ0.006-0.010=-0.004
min0.389-0.387=0.002
max0.405-0.412=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.412-1295.414=-0.002
σ0.108-0.111=-0.003
min1295.287-1295.296=-0.010
max1295.532-1295.547=-0.015
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean1.907-1.910=-0.002
σ0.110-0.099=0.011
min1.818-1.806=0.012
max2.078-2.047=0.031
iters=5
new-facts=6402
prior-facts=1
mean1539.523-1539.553=-0.029
σ6.853-6.840=0.013
min1536.230-1536.280=-0.051
max1551.775-1551.783=-0.008
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.258-2.347=-0.089
σ0.239-0.230=0.009
min2.040-2.041=-0.001
max2.567-2.590=-0.023
iters=5
new-facts=6402
prior-facts=6402
mean1857.321-1857.329=-0.008
σ0.049-0.053=-0.005
min1857.268-1857.268=-0.001
max1857.392-1857.400=-0.009
mean1777.200-1770.800=6.400
σ168.435-125.850=42.585
min1645.000-1643.000=2.000
max2027.000-1901.000=126.000
mean2.872-3.144=-0.271
σ0.038-0.386=-0.347
min2.830-2.876=-0.046
max2.932-3.817=-0.885

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.221-1.198=0.023
σ0.339-0.342=-0.003
min0.934-0.943=-0.009
max1.788-1.763=0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.189=0.004
σ581.334-581.332=0.002
min157.521-157.520=0.001
max1320.193-1320.187=0.006
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean0.539-0.551=-0.013
σ0.542-0.563=-0.021
min0.264-0.263=0.001
max1.352-1.395=-0.044
policies=20
mean1575.575-1575.552=0.023
σ0.360-0.350=0.010
min1575.332-1575.316=0.017
max1576.110-1576.073=0.038
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean2.633-2.622=0.010
σ0.005-0.049=-0.044
min2.629-2.551=0.078
max2.640-2.654=-0.014
policies=200
mean15763.713-15763.599=0.114
σ0.030-0.093=-0.064
min15763.686-15763.516=0.170
max15763.755-15763.724=0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1643.000=2.000
σ0.000
min1645.000-1643.000=2.000
max1645.000-1643.000=2.000
mean26.558-26.628=-0.070
σ0.122-0.039=0.083
min26.465-26.592=-0.127
max26.735-26.665=0.070