Compare commits

Home / Compare 263d7302 .. b9c3d05b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.963=0.002
σ0.371-0.369=0.002
min53.821-53.815=0.005
max55.019-55.012=0.007
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.139-0.137=0.001
σ0.004-0.005=-0.001
min0.132-0.132=0.000
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.006=0.001
min43.311-43.316=-0.005
max43.335-43.334=0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.119-0.122=-0.003
σ0.004-0.004=-0.001
min0.115-0.118=-0.003
max0.128-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.516=-0.001
σ1.172-1.174=-0.003
min1005.976-1005.949=0.028
max1011.420-1011.434=-0.014
mean1048.200-1047.150=1.050
σ313.696-315.116=-1.420
min597.000-550.000=47.000
max1643.000-1527.000=116.000
mean1.564-1.557=0.007
σ0.087-0.058=0.028
min1.485-1.485=0.000
max1.811-1.684=0.128

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.418-0.433=-0.016
σ0.137-0.176=-0.039
min0.330-0.348=-0.018
max0.660-0.747=-0.087
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.875-0.911=-0.036
σ0.092-0.147=-0.055
min0.817-0.807=0.011
max1.037-1.168=-0.131
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.543-0.531=0.012
σ0.045-0.052=-0.007
min0.503-0.497=0.006
max0.618-0.622=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.841-0.855=-0.015
σ0.045-0.036=0.008
min0.795-0.828=-0.033
max0.912-0.919=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.835=0.003
σ0.032-0.032=0.000
min964.811-964.803=0.008
max964.893-964.888=0.005
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.839-0.829=0.010
σ0.025-0.024=0.001
min0.808-0.796=0.013
max0.859-0.856=0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.005-0.007=-0.003
min885.504
max885.516-885.521=-0.005
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.735-0.710=0.025
σ0.007-0.045=-0.038
min0.728-0.649=0.079
max0.746-0.743=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.722=0.001
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean3.539-4.161=-0.622
σ0.093-0.091=0.002
min3.403-4.010=-0.607
max4.056-4.433=-0.378
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean3.520-4.190=-0.670
σ0.065-0.073=-0.008
min3.401-4.046=-0.645
max3.716-4.425=-0.710
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.741-0.739=0.001
σ0.022-0.019=0.004
min0.661-0.703=-0.042
max0.852-0.856=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.543-0.704=-0.161
σ0.080-0.018=0.062
min0.478-0.675=-0.197
max0.785-0.811=-0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.262-296.298=-0.036
σ0.182-0.238=-0.057
min296.090-296.096=-0.006
max296.742-296.936=-0.195
mean1919.000-1911.000=8.000
σ0.000
min1919.000-1911.000=8.000
max1919.000-1911.000=8.000
mean0.561-0.578=-0.017
σ0.039-0.045=-0.006
min0.511-0.504=0.007
max0.629-0.685=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.029-285.029=0.000
σ0.039-0.037=0.002
min284.973-284.986=-0.013
max285.072-285.071=0.001
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.393-0.395=-0.001
σ0.008-0.007=0.001
min0.385-0.386=-0.001
max0.401-0.400=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.382-1295.424=-0.042
σ0.105-0.126=-0.020
min1295.299-1295.296=0.003
max1295.555-1295.597=-0.042
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean1.953-1.937=0.016
σ0.171-0.145=0.027
min1.820-1.757=0.063
max2.240-2.158=0.082
iters=5
new-facts=6402
prior-facts=1
mean1539.580-1539.525=0.055
σ6.783-6.855=-0.072
min1536.434-1536.209=0.225
max1551.712-1551.781=-0.069
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean2.316-2.309=0.007
σ0.242-0.212=0.030
min2.115-1.975=0.140
max2.729-2.555=0.174
iters=5
new-facts=6402
prior-facts=6402
mean1857.331-1857.319=0.012
σ0.062-0.068=-0.007
min1857.261-1857.234=0.027
max1857.408-1857.410=-0.002
mean1775.400-1751.400=24.000
σ138.567-167.549=-28.982
min1643.000-1527.000=116.000
max1919.000-1911.000=8.000
mean3.045-3.041=0.004
σ0.114-0.238=-0.125
min2.900-2.831=0.068
max3.152-3.446=-0.294

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.261-1.344=-0.083
σ0.254-0.316=-0.063
min0.924-0.961=-0.037
max1.629-1.770=-0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.191=-0.000
σ581.332-581.331=0.001
min157.523-157.524=-0.001
max1320.189-1320.188=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean0.538-0.549=-0.011
σ0.542-0.572=-0.030
min0.255-0.261=-0.006
max1.352-1.407=-0.055
policies=20
mean1575.563-1575.574=-0.011
σ0.373-0.359=0.015
min1575.314-1575.332=-0.018
max1576.118-1576.108=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean2.645-2.642=0.003
σ0.020-0.009=0.011
min2.625-2.635=-0.010
max2.672-2.656=0.016
policies=200
mean15763.636-15763.665=-0.029
σ0.117-0.082=0.035
min15763.486-15763.545=-0.059
max15763.746-15763.719=0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1527.000=116.000
σ0.000
min1643.000-1527.000=116.000
max1643.000-1527.000=116.000
mean26.616-26.561=0.055
σ0.151-0.020=0.131
min26.438-26.540=-0.102
max26.807-26.581=0.226