Compare commits

Home / Compare 0399c071 .. c8c85765

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.963=0.002
σ0.370-0.370=0.000
min53.821-53.828=-0.007
max55.018-55.016=0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.138=0.002
σ0.004-0.006=-0.001
min0.136-0.130=0.007
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.007-0.007=0.001
min43.314-43.315=-0.002
max43.339-43.336=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.115-0.118=-0.003
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.511-1006.512=-0.001
σ1.181-1.240=-0.060
min1005.973-1005.980=-0.008
max1011.466-1011.707=-0.241
mean1053.050-1061.050=-8.000
σ307.190-319.585=-12.395
min587.000-548.000=39.000
max1645.000-1519.000=126.000
mean1.528-1.551=-0.022
σ0.078-0.165=-0.088
min1.455-1.361=0.094
max1.747-2.151=-0.403

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.419-0.458=-0.039
σ0.134-0.141=-0.007
min0.329-0.360=-0.031
max0.656-0.705=-0.049
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.891-0.886=0.006
σ0.091-0.108=-0.017
min0.834-0.807=0.027
max1.051-1.076=-0.025
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.539-0.525=0.013
σ0.054-0.044=0.010
min0.500-0.480=0.020
max0.631-0.592=0.040
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.846-0.850=-0.004
σ0.041-0.039=0.002
min0.807-0.823=-0.016
max0.912-0.918=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.830=0.008
σ0.031-0.039=-0.007
min964.811-964.806=0.006
max964.892-964.898=-0.006
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.826-0.795=0.031
σ0.038-0.089=-0.050
min0.771-0.651=0.120
max0.857-0.863=-0.007
name=cdr_enhanced_4k_loc.art
mean885.513-885.510=0.002
σ0.008-0.008=0.000
min885.504
max885.524-885.523=0.001
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.722-0.706=0.016
σ0.034-0.045=-0.011
min0.676-0.643=0.033
max0.757-0.743=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean4.236-3.795=0.440
σ0.087-0.343=-0.256
min4.071-3.392=0.679
max4.532-4.522=0.009
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean4.059-4.142=-0.084
σ0.320-0.247=0.074
min3.359-3.487=-0.128
max4.423-4.522=-0.099
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.744-0.757=-0.013
σ0.018-0.025=-0.007
min0.705-0.711=-0.006
max0.832-0.921=-0.089
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.703-0.647=0.056
σ0.015-0.091=-0.076
min0.670-0.488=0.183
max0.794-0.773=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.389-296.375=0.014
σ0.259-0.234=0.025
min296.063-296.248=-0.185
max296.782-297.029=-0.247
mean2027.000-2034.000=-7.000
σ0.000
min2027.000-2034.000=-7.000
max2027.000-2034.000=-7.000
mean0.550-0.557=-0.007
σ0.030-0.029=0.001
min0.513-0.510=0.003
max0.583-0.584=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.031-285.028=0.003
σ0.039-0.038=0.001
min284.982-284.978=0.005
max285.074-285.064=0.010
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.403-0.397=0.005
σ0.008-0.011=-0.003
min0.390-0.387=0.003
max0.411-0.415=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.417-1295.411=0.006
σ0.111-0.105=0.006
min1295.282-1295.300=-0.018
max1295.549-1295.539=0.011
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean1.875-1.913=-0.038
σ0.059-0.127=-0.068
min1.813-1.807=0.006
max1.952-2.072=-0.121
iters=5
new-facts=6402
prior-facts=1
mean1539.520-1539.513=0.007
σ6.864-6.854=0.010
min1536.259-1536.231=0.029
max1551.795-1551.769=0.026
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean2.230-2.242=-0.012
σ0.181-0.209=-0.028
min2.031-1.984=0.047
max2.441-2.475=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean1857.327-1857.313=0.014
σ0.049-0.069=-0.020
min1857.274-1857.231=0.044
max1857.394-1857.399=-0.005
mean1777.800-1752.600=25.200
σ168.073-209.139=-41.066
min1645.000-1519.000=126.000
max2027.000-2034.000=-7.000
mean2.916-2.968=-0.051
σ0.133-0.278=-0.144
min2.806-2.753=0.052
max3.130-3.445=-0.315

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.266-1.551=-0.285
σ0.281-0.280=0.001
min1.064-1.189=-0.125
max1.676-1.840=-0.163

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.191=-0.000
σ581.332-581.331=0.000
min157.523-157.524=-0.001
max1320.188-1320.188=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean0.558-0.531=0.026
σ0.571-0.541=0.031
min0.269-0.260=0.009
max1.415-1.342=0.073
policies=20
mean1575.574-1575.567=0.007
σ0.362-0.348=0.013
min1575.330-1575.330=-0.000
max1576.111-1576.084=0.027
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean2.645-2.619=0.026
σ0.017-0.014=0.003
min2.621-2.603=0.019
max2.658-2.636=0.022
policies=200
mean15763.746-15763.703=0.043
σ0.076-0.028=0.048
min15763.694-15763.665=0.028
max15763.856-15763.730=0.126
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1519.000=126.000
σ0.000
min1645.000-1519.000=126.000
max1645.000-1519.000=126.000
mean26.574-26.518=0.056
σ0.032-0.058=-0.026
min26.535-26.460=0.074
max26.609-26.570=0.039