Compare commits

Home / Compare 3dd87149 .. 9b083bad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.368-0.370=-0.002
min53.910-53.909=0.001
max55.101-55.108=-0.008
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.132-0.135=-0.004
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.398=-0.004
σ0.006-0.004=0.001
min43.384-43.392=-0.008
max43.405-43.406=-0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.139=-0.017
σ0.003-0.009=-0.006
min0.118-0.120=-0.002
max0.128-0.150=-0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.008-1007.007=0.001
σ1.176-1.204=-0.028
min1006.435-1006.451=-0.016
max1011.930-1012.051=-0.122
mean1045.350-1044.900=0.450
σ315.699-311.038=4.661
min569.000-572.000=-3.000
max1647.000-1640.000=7.000
mean1.538-1.569=-0.031
σ0.082-0.108=-0.026
min1.465-1.412=0.053
max1.740-1.836=-0.097

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.413-0.412=0.001
σ0.134-0.134=-0.000
min0.329-0.336=-0.007
max0.650-0.650=0.001
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.899-0.889=0.010
σ0.102-0.089=0.013
min0.834-0.822=0.012
max1.079-1.044=0.034
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.001
min1.522
max1.528-1.526=0.002
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.544-0.539=0.005
σ0.048-0.049=-0.001
min0.507-0.499=0.008
max0.622-0.623=-0.000
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.857-0.857=0.000
σ0.033-0.038=-0.005
min0.830-0.818=0.012
max0.912-0.919=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.001
σ0.020-0.033=-0.013
min964.821-964.812=0.009
max964.872-964.893=-0.021
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.844-0.846=-0.002
σ0.023-0.026=-0.003
min0.816-0.800=0.016
max0.862-0.864=-0.002
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.007=0.001
min885.504
max885.523-885.521=0.002
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.737-0.715=0.022
σ0.008-0.035=-0.027
min0.730-0.676=0.054
max0.748-0.745=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean3.484-4.189=-0.706
σ0.092-0.087=0.005
min3.352-4.062=-0.710
max3.772-4.518=-0.746
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean3.504-4.197=-0.693
σ0.093-0.085=0.008
min3.379-4.033=-0.654
max4.174-4.524=-0.349
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.541-0.730=-0.189
σ0.015-0.022=-0.007
min0.512-0.688=-0.176
max0.637-0.832=-0.195
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.509-0.697=-0.188
σ0.014-0.022=-0.009
min0.486-0.661=-0.175
max0.581-0.798=-0.217

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.920-296.837=0.083
σ0.257-0.219=0.038
min296.714-296.695=0.019
max297.612-297.417=0.195
mean1957.000-1911.000=46.000
σ0.000
min1957.000-1911.000=46.000
max1957.000-1911.000=46.000
mean0.545-0.593=-0.047
σ0.032-0.043=-0.012
min0.510-0.514=-0.004
max0.580-0.691=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.816=0.006
σ0.041-0.036=0.006
min286.765-286.770=-0.005
max286.865-286.856=0.009
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.396-0.394=0.002
σ0.011-0.007=0.004
min0.387-0.387=0.000
max0.413-0.403=0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.271-1297.151=0.120
σ0.096-0.065=0.032
min1297.157-1297.086=0.071
max1297.411-1297.239=0.172
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean2.285-1.893=0.392
σ0.081-0.096=-0.015
min2.154-1.822=0.332
max2.359-2.056=0.304
iters=5
new-facts=6402
prior-facts=1
mean1540.117-1540.166=-0.049
σ3.983-3.960=0.022
min1538.179-1538.271=-0.092
max1547.237-1547.247=-0.010
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean2.349-2.470=-0.120
σ0.091-0.229=-0.138
min2.237-2.157=0.080
max2.440-2.717=-0.277
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1859.124=-0.001
σ0.064-0.051=0.013
min1859.037-1859.069=-0.032
max1859.201-1859.194=0.008
mean1782.000-1775.400=6.600
σ114.728-133.392=-18.664
min1647.000-1640.000=7.000
max1957.000-1911.000=46.000
mean2.983-3.111=-0.128
σ0.179-0.376=-0.197
min2.833-2.863=-0.030
max3.258-3.774=-0.516

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.150-1.231=-0.081
σ0.276-0.353=-0.077
min0.938-0.915=0.023
max1.610-1.818=-0.208

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.159-447.160=-0.001
σ578.048-578.048=0.000
min158.130-158.135=-0.005
max1314.231-1314.231=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean0.568-0.541=0.027
σ0.603-0.555=0.047
min0.265-0.262=0.002
max1.472-1.374=0.098
policies=20
mean1581.611-1581.637=-0.026
σ0.358-0.377=-0.019
min1581.370-1581.386=-0.017
max1582.144-1582.199=-0.055
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean2.636-2.663=-0.027
σ0.020-0.037=-0.017
min2.609-2.636=-0.027
max2.654-2.716=-0.062
policies=200
mean15824.126-15824.188=-0.062
σ0.123-0.029=0.093
min15823.951-15824.147=-0.196
max15824.229-15824.212=0.017
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1640.000=7.000
σ0.000
min1647.000-1640.000=7.000
max1647.000-1640.000=7.000
mean26.659-26.692=-0.034
σ0.071-0.075=-0.004
min26.606-26.594=0.012
max26.761-26.776=-0.015