Compare commits

Home / Compare e361841a .. f224de8c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.965=0.000
σ0.370-0.368=0.002
min53.822-53.822=-0.000
max55.018-55.012=0.007
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.140-0.138=0.002
σ0.004-0.005=-0.001
min0.136-0.131=0.005
max0.147-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.007=-0.000
min43.314-43.313=0.001
max43.337-43.336=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.118=0.003
σ0.004-0.004=0.000
min0.115-0.114=0.001
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.516=-0.000
σ1.211-1.174=0.038
min1005.949-1005.948=0.001
max1011.601-1011.420=0.182
mean1048.900-1036.800=12.100
σ310.089-309.988=0.101
min555.000-547.000=8.000
max1516.000-1503.000=13.000
mean1.518-1.545=-0.027
σ0.111-0.086=0.024
min1.350-1.452=-0.102
max1.933-1.801=0.132

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.427-0.414=0.014
σ0.137-0.138=-0.001
min0.348-0.338=0.010
max0.672-0.660=0.012
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.889-0.887=0.002
σ0.086-0.105=-0.020
min0.830-0.820=0.010
max1.040-1.071=-0.032
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.545-0.531=0.014
σ0.047-0.052=-0.005
min0.510-0.492=0.017
max0.622-0.619=0.003
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.855-0.849=0.006
σ0.047-0.047=0.001
min0.810-0.819=-0.009
max0.933-0.931=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.829=0.001
σ0.037-0.037=0.001
min964.807-964.802=0.005
max964.896-964.894=0.002
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.837-0.851=-0.014
σ0.020-0.011=0.009
min0.809-0.833=-0.025
max0.854-0.862=-0.008
name=cdr_enhanced_4k_loc.art
mean885.511-885.510=0.000
σ0.006-0.006=0.000
min885.504
max885.519-885.517=0.002
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.724-0.717=0.007
σ0.015-0.047=-0.032
min0.699-0.635=0.064
max0.737-0.744=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean3.623-3.496=0.127
σ0.300-0.073=0.227
min3.382-3.348=0.034
max4.587-3.775=0.813
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean4.205-3.494=0.711
σ0.081-0.069=0.012
min4.065-3.352=0.713
max4.457-3.683=0.774
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.741-0.734=0.006
σ0.018-0.016=0.002
min0.708-0.702=0.006
max0.854-0.824=0.030
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.698-0.697=0.001
σ0.016-0.022=-0.007
min0.661-0.542=0.119
max0.774-0.785=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.378-296.235=0.143
σ0.232-0.206=0.026
min296.153-296.117=0.036
max296.946-296.805=0.141
mean1909.000-1945.000=-36.000
σ0.000
min1909.000-1945.000=-36.000
max1909.000-1945.000=-36.000
mean0.585-0.573=0.012
σ0.043-0.028=0.015
min0.491-0.522=-0.032
max0.654-0.602=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-285.034=-0.002
σ0.037-0.034=0.002
min284.986-284.988=-0.003
max285.074-285.071=0.003
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.397-0.393=0.004
σ0.005-0.007=-0.001
min0.389-0.385=0.004
max0.402-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.413-1295.421=-0.008
σ0.117-0.111=0.006
min1295.296-1295.287=0.009
max1295.584-1295.531=0.054
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean1.900-1.986=-0.086
σ0.084-0.105=-0.021
min1.817-1.885=-0.067
max1.995-2.156=-0.162
iters=5
new-facts=6402
prior-facts=1
mean1539.528-1539.512=0.016
σ6.867-6.854=0.014
min1536.213-1536.213=0.000
max1551.807-1551.768=0.039
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean2.261-2.233=0.028
σ0.225-0.213=0.012
min2.080-2.057=0.023
max2.584-2.582=0.002
iters=5
new-facts=6402
prior-facts=6402
mean1857.324-1857.325=-0.001
σ0.062-0.066=-0.004
min1857.250-1857.261=-0.011
max1857.405-1857.416=-0.011
mean1749.400-1748.800=0.600
σ168.968-158.823=10.145
min1516.000-1509.000=7.000
max1909.000-1945.000=-36.000
mean3.106-2.863=0.242
σ0.346-0.153=0.193
min2.840-2.636=0.204
max3.705-3.059=0.646

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.540-1.597=-0.057
σ0.273-0.375=-0.102
min1.244-0.953=0.291
max1.788-1.852=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.190=0.002
σ581.332-581.332=-0.000
min157.524-157.522=0.002
max1320.189-1320.187=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean0.533-0.540=-0.007
σ0.541-0.552=-0.011
min0.262-0.260=0.002
max1.345-1.368=-0.023
policies=20
mean1575.575-1575.556=0.019
σ0.357-0.358=-0.002
min1575.336-1575.316=0.019
max1576.106-1576.089=0.016
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean2.629-2.643=-0.014
σ0.017-0.017=-0.000
min2.611-2.626=-0.015
max2.651-2.659=-0.008
policies=200
mean15763.674-15763.732=-0.058
σ0.151-0.142=0.009
min15763.544-15763.548=-0.004
max15763.847-15763.893=-0.045
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1503.000=13.000
σ0.000
min1516.000-1503.000=13.000
max1516.000-1503.000=13.000
mean26.501-26.493=0.009
σ0.040-0.034=0.006
min26.461-26.452=0.009
max26.556-26.534=0.021