Compare commits

Home / Compare 5c07c46e .. bfbc4e3c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.001
σ0.369-0.368=0.002
min53.919-53.911=0.008
max55.107-55.103=0.004
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.139-0.138=0.001
σ0.004-0.004=0.000
min0.132-0.132=0.000
max0.146-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.007-0.006=0.001
min43.381-43.386=-0.006
max43.407-43.401=0.005
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.122-0.121=0.002
σ0.004-0.005=-0.001
min0.119-0.115=0.004
max0.129-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.032-1007.029=0.004
σ1.183-1.190=-0.007
min1006.450-1006.455=-0.005
max1011.980-1012.013=-0.034
mean1051.100-1049.500=1.600
σ307.825-314.367=-6.542
min576.000-594.000=-18.000
max1643.000-1652.000=-9.000
mean1.543-1.548=-0.005
σ0.053-0.066=-0.013
min1.477-1.466=0.011
max1.664-1.729=-0.065

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.417-0.423=-0.006
σ0.143-0.139=0.004
min0.334-0.341=-0.006
max0.670-0.668=0.002
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.931-0.919=0.012
σ0.191-0.193=-0.002
min0.827-0.815=0.012
max1.270-1.263=0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.544-0.538=0.006
σ0.041-0.050=-0.010
min0.502-0.486=0.016
max0.612-0.616=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.862-0.836=0.026
σ0.033-0.037=-0.005
min0.838-0.808=0.030
max0.919-0.901=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.025-0.035=-0.010
min964.817-964.809=0.008
max964.881-964.897=-0.016
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.833-0.804=0.030
σ0.031-0.057=-0.026
min0.790-0.707=0.083
max0.858-0.855=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=0.000
min885.506
max885.522-885.523=-0.001
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.714-0.704=0.010
σ0.026-0.040=-0.013
min0.684-0.663=0.021
max0.740-0.754=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean4.283-4.236=0.047
σ0.081-0.103=-0.023
min4.099-4.064=0.035
max4.578-4.775=-0.196
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean4.269-4.238=0.031
σ0.087-0.074=0.013
min4.094-4.088=0.006
max4.711-4.516=0.195
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.746-0.747=-0.000
σ0.019-0.018=0.002
min0.709-0.722=-0.013
max0.857-0.865=-0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.703-0.710=-0.007
σ0.016-0.014=0.001
min0.675-0.675=-0.000
max0.766-0.776=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.183-296.959=0.224
σ0.231-0.246=-0.015
min297.000-296.776=0.225
max297.815-297.626=0.190
mean1918.000-1907.000=11.000
σ0.000
min1918.000-1907.000=11.000
max1918.000-1907.000=11.000
mean0.598-0.579=0.019
σ0.009-0.033=-0.024
min0.586-0.527=0.059
max0.615-0.611=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.845-286.860=-0.015
σ0.038-0.030=0.008
min286.794-286.831=-0.037
max286.886-286.898=-0.012
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.397-0.411=-0.013
σ0.005-0.013=-0.008
min0.390-0.390=-0.000
max0.401-0.421=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.235-1297.233=0.003
σ0.114-0.105=0.008
min1297.104-1297.119=-0.015
max1297.364-1297.362=0.002
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean1.873-1.910=-0.037
σ0.091-0.110=-0.019
min1.785-1.803=-0.018
max2.008-2.048=-0.040
iters=5
new-facts=6402
prior-facts=1
mean1541.334-1541.374=-0.040
σ6.848-6.850=-0.002
min1538.078-1538.070=0.009
max1553.580-1553.623=-0.043
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean2.228-2.359=-0.131
σ0.158-0.182=-0.025
min2.029-2.041=-0.011
max2.421-2.494=-0.073
iters=5
new-facts=6402
prior-facts=6402
mean1859.141-1859.144=-0.003
σ0.054-0.054=0.000
min1859.096-1859.090=0.006
max1859.222-1859.223=-0.001
mean1785.800-1776.600=9.200
σ134.407-125.632=8.775
min1643.000-1652.000=-9.000
max1918.000-1907.000=11.000
mean3.140-3.042=0.098
σ0.356-0.215=0.141
min2.851-2.852=-0.001
max3.752-3.413=0.339

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.195=-0.029
σ0.273-0.369=-0.096
min0.925-0.937=-0.012
max1.623-1.813=-0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.867-448.866=0.001
σ581.371-581.372=-0.000
min158.180-158.178=0.002
max1320.924-1320.923=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean0.550-0.551=-0.001
σ0.576-0.575=0.001
min0.260-0.262=-0.002
max1.414-1.414=0.000
policies=20
mean1582.085-1582.065=0.020
σ0.355-0.346=0.009
min1581.846-1581.831=0.016
max1582.613-1582.580=0.033
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean2.640-2.618=0.022
σ0.006-0.010=-0.004
min2.635-2.603=0.032
max2.649-2.624=0.025
policies=200
mean15828.748-15828.784=-0.036
σ0.108-0.081=0.027
min15828.635-15828.665=-0.030
max15828.857-15828.848=0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1652.000=-9.000
σ0.000
min1643.000-1652.000=-9.000
max1643.000-1652.000=-9.000
mean26.631-26.578=0.053
σ0.063-0.042=0.021
min26.557-26.550=0.007
max26.701-26.640=0.062