Compare commits

Home / Compare cd758986 .. 60590533

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.059=-0.003
σ0.369-0.370=-0.000
min53.906-53.922=-0.017
max55.106-55.110=-0.004
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.139-0.155=-0.016
σ0.007-0.008=-0.002
min0.130-0.139=-0.008
max0.148-0.165=-0.017
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.007-0.005=0.001
min43.384-43.387=-0.003
max43.403-43.405=-0.001
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.121-0.122=-0.001
σ0.005-0.006=-0.001
min0.115-0.114=0.001
max0.129-0.134=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1006.984=-0.003
σ0.850-0.865=-0.015
min1006.475-1006.483=-0.008
max1010.482-1010.558=-0.076
mean1055.250-1048.950=6.300
σ307.466-307.583=-0.117
min580.000-573.000=7.000
max1653.000-1647.000=6.000
mean1.525-1.526=-0.001
σ0.054-0.070=-0.016
min1.462-1.465=-0.003
max1.657-1.757=-0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.416-0.408=0.008
σ0.139-0.136=0.003
min0.320-0.324=-0.004
max0.661-0.648=0.013
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.874-0.891=-0.017
σ0.091-0.083=0.007
min0.814-0.836=-0.022
max1.031-1.035=-0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.531-0.538=-0.007
σ0.043-0.056=-0.013
min0.492-0.483=0.009
max0.601-0.631=-0.030
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.846-0.837=0.008
σ0.037-0.038=-0.000
min0.811-0.808=0.002
max0.908-0.903=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.000
σ0.023-0.025=-0.002
min964.807-964.802=0.005
max964.860-964.862=-0.001
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.842-0.821=0.022
σ0.033-0.039=-0.006
min0.784-0.776=0.007
max0.861-0.866=-0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=-0.001
σ0.004-0.006=-0.001
min885.505-885.504=0.001
max885.516-885.518=-0.002
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.719-0.720=-0.001
σ0.038-0.031=0.008
min0.656-0.672=-0.016
max0.751-0.749=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.001
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean4.280-4.272=0.008
σ0.110-0.108=0.002
min4.069-4.087=-0.018
max4.824-4.628=0.196
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean4.233-4.258=-0.025
σ0.080-0.084=-0.004
min4.055-4.123=-0.068
max4.521-4.500=0.021
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.641-0.734=-0.092
σ0.102-0.021=0.082
min0.513-0.702=-0.189
max0.843-0.841=0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.502-0.691=-0.189
σ0.012-0.028=-0.016
min0.475-0.494=-0.019
max0.549-0.780=-0.231

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.713-295.412=0.301
σ0.220-0.240=-0.021
min295.573-295.240=0.333
max296.317-296.072=0.245
mean1933.000-1906.000=27.000
σ0.000
min1933.000-1906.000=27.000
max1933.000-1906.000=27.000
mean0.562-0.581=-0.020
σ0.036-0.055=-0.019
min0.506-0.501=0.005
max0.631-0.708=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.412=-0.001
σ0.034-0.033=0.001
min285.365-285.368=-0.004
max285.444-285.444=0.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.389-0.397=-0.008
σ0.009-0.015=-0.006
min0.380-0.381=-0.001
max0.399-0.422=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1295.797-1295.793=0.004
σ0.111-0.103=0.008
min1295.676-1295.675=0.000
max1295.927-1295.914=0.013
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean1.890-1.940=-0.050
σ0.081-0.142=-0.061
min1.798-1.814=-0.016
max1.969-2.153=-0.184
iters=5
new-facts=6402
prior-facts=1
mean1539.942-1539.939=0.003
σ6.887-6.885=0.002
min1536.646-1536.635=0.011
max1552.256-1552.251=0.006
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean2.383-2.352=0.031
σ0.191-0.204=-0.013
min2.180-2.033=0.147
max2.656-2.511=0.145
iters=5
new-facts=6402
prior-facts=6402
mean1857.716-1857.705=0.011
σ0.058-0.055=0.003
min1857.652-1857.646=0.006
max1857.778-1857.776=0.002
mean1786.400-1776.400=10.000
σ140.776-128.298=12.478
min1653.000-1647.000=6.000
max1933.000-1906.000=27.000
mean3.014-3.078=-0.064
σ0.119-0.310=-0.191
min2.887-2.867=0.020
max3.147-3.620=-0.473

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.401-1.381=0.020
σ0.285-0.311=-0.026
min1.120-1.101=0.019
max1.860-1.903=-0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.934=0.000
min155.272-155.272=0.001
max1317.143-1317.141=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean0.536-0.550=-0.014
σ0.550-0.588=-0.038
min0.257-0.256=0.001
max1.361-1.432=-0.071
policies=20
mean1552.990-1552.987=0.002
σ0.331-0.319=0.012
min1552.760-1552.764=-0.004
max1553.482-1553.461=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean2.587-2.578=0.009
σ0.009-0.019=-0.010
min2.577-2.553=0.024
max2.596-2.596=-0.001
policies=200
mean15537.969-15538.063=-0.094
σ0.120-0.063=0.057
min15537.839-15538.007=-0.167
max15538.101-15538.153=-0.051
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1647.000=6.000
σ0.000
min1653.000-1647.000=6.000
max1653.000-1647.000=6.000
mean26.102-26.149=-0.046
σ0.190-0.108=0.083
min25.968-26.010=-0.042
max26.379-26.270=0.110