Compare commits

Home / Compare 85f6f9b7 .. dcf2ed8b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.000
σ0.370-0.371=-0.001
min53.876-53.867=0.009
max55.067-55.070=-0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.138-0.140=-0.002
σ0.004-0.005=-0.001
min0.132-0.134=-0.002
max0.145-0.149=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.008=-0.001
min43.309-43.308=0.001
max43.331-43.337=-0.006
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.122=-0.004
σ0.005-0.004=0.001
min0.112-0.118=-0.006
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.308=-0.002
σ1.167-1.162=0.006
min1005.753-1005.764=-0.011
max1011.189-1011.170=0.019
mean1051.800-1044.550=7.250
σ305.046-313.036=-7.991
min597.000-596.000=1.000
max1646.000-1639.000=7.000
mean1.559-1.572=-0.013
σ0.066-0.100=-0.033
min1.481-1.455=0.025
max1.688-1.833=-0.145

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866-0.866=0.000
σ0.002-0.003=-0.000
min0.864
max0.869
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.428-0.419=0.009
σ0.183-0.147=0.036
min0.332-0.339=-0.007
max0.755-0.680=0.074
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.913-0.874=0.039
σ0.187-0.106=0.081
min0.801-0.810=-0.009
max1.245-1.061=0.184
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.537-0.535=0.002
σ0.050-0.049=0.001
min0.487-0.494=-0.007
max0.617-0.619=-0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.841-0.836=0.005
σ0.043-0.035=0.007
min0.801-0.811=-0.010
max0.906-0.897=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.114=-0.001
σ0.019-0.034=-0.015
min964.095-964.087=0.008
max964.143-964.171=-0.028
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.830-0.838=-0.008
σ0.029-0.025=0.004
min0.797-0.808=-0.011
max0.853-0.860=-0.007
name=cdr_enhanced_4k_loc.art
mean884.713-884.711=0.002
σ0.001-0.008=-0.007
min884.712-884.703=0.009
max884.714-884.722=-0.008
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.698-0.708=-0.010
σ0.051-0.041=0.010
min0.634-0.641=-0.008
max0.741-0.743=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean4.284-4.250=0.035
σ0.089-0.095=-0.006
min4.142-4.084=0.058
max4.575-4.633=-0.057
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean4.250-4.243=0.007
σ0.072-0.082=-0.010
min4.128-4.115=0.013
max4.505-4.513=-0.008
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.736-0.735=0.001
σ0.021-0.020=0.001
min0.707-0.697=0.010
max0.849-0.869=-0.020
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.693-0.696=-0.003
σ0.014-0.017=-0.003
min0.668-0.669=-0.001
max0.772-0.791=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.147-296.235=-0.088
σ0.217-0.185=0.032
min296.019-296.061=-0.043
max296.719-296.705=0.014
mean1909.000-1907.000=2.000
σ0.000
min1909.000-1907.000=2.000
max1909.000-1907.000=2.000
mean0.580-0.583=-0.003
σ0.052-0.031=0.021
min0.513-0.531=-0.018
max0.701-0.629=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.703=-0.010
σ0.037-0.031=0.007
min284.645-284.672=-0.027
max284.730-284.740=-0.010
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.394-0.398=-0.004
σ0.010-0.011=-0.001
min0.382-0.385=-0.003
max0.402-0.409=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.087-1295.082=0.005
σ0.118-0.112=0.006
min1294.960-1294.954=0.006
max1295.238-1295.214=0.025
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean1.874-1.869=0.006
σ0.069-0.066=0.003
min1.821-1.807=0.014
max1.992-1.966=0.025
iters=5
new-facts=6402
prior-facts=1
mean1539.193-1539.210=-0.017
σ6.822-6.845=-0.023
min1535.947-1535.911=0.037
max1551.393-1551.450=-0.057
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean2.291-2.326=-0.035
σ0.262-0.213=0.049
min2.015-2.026=-0.011
max2.658-2.592=0.067
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.986=0.001
σ0.057-0.055=0.002
min1856.927-1856.941=-0.014
max1857.073-1857.072=0.001
mean1776.200-1772.600=3.600
σ129.953-130.494=-0.542
min1646.000-1639.000=7.000
max1909.000-1907.000=2.000
mean3.091-3.048=0.044
σ0.362-0.237=0.126
min2.834-2.857=-0.022
max3.727-3.453=0.274

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.226=-0.110
σ0.218-0.331=-0.113
min0.935-0.938=-0.004
max1.426-1.779=-0.354

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.002
σ581.212-581.213=-0.000
min157.174-157.176=-0.002
max1319.602-1319.605=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.532-0.545=-0.013
σ0.546-0.555=-0.010
min0.258-0.264=-0.006
max1.351-1.378=-0.027
policies=20
mean1572.082-1572.105=-0.023
σ0.343-0.356=-0.013
min1571.849-1571.868=-0.019
max1572.592-1572.635=-0.043
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean2.607-2.634=-0.028
σ0.002-0.008=-0.006
min2.604-2.627=-0.022
max2.609-2.646=-0.037
policies=200
mean15728.998-15729.064=-0.066
σ0.054-0.084=-0.030
min15728.929-15729.013=-0.085
max15729.042-15729.189=-0.147
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean26.526-26.495=0.031
σ0.104-0.024=0.080
min26.435-26.481=-0.046
max26.673-26.530=0.143