Compare commits

Home / Compare 11914be5 .. d237172e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.001
σ0.369-0.367=0.002
min53.906-53.915=-0.009
max55.105-55.099=0.006
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.139-0.139=-0.000
σ0.004-0.005=-0.000
min0.135-0.133=0.002
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.396-43.393=0.003
σ0.006-0.005=0.001
min43.386-43.388=-0.003
max43.406-43.405=0.002
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.126-0.121=0.005
σ0.012-0.004=0.009
min0.115-0.116=-0.001
max0.149-0.127=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1007.001=-0.018
σ0.851-1.229=-0.377
min1006.478-1006.462=0.017
max1010.485-1012.158=-1.673
mean1041.800-1053.850=-12.050
σ307.156-308.691=-1.535
min552.000-578.000=-26.000
max1658.000-1651.000=7.000
mean1.522-1.546=-0.023
σ0.092-0.101=-0.008
min1.448-1.463=-0.015
max1.778-1.841=-0.063

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.414-0.426=-0.012
σ0.129-0.154=-0.025
min0.328-0.341=-0.014
max0.642-0.700=-0.059
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.882-0.891=-0.009
σ0.089-0.109=-0.020
min0.813-0.828=-0.015
max1.036-1.084=-0.048
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.536-0.538=-0.002
σ0.054-0.052=0.002
min0.490-0.501=-0.010
max0.629-0.629=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.847-0.862=-0.014
σ0.039-0.039=-0.000
min0.823-0.831=-0.008
max0.916-0.929=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.839=-0.009
σ0.024-0.035=-0.011
min964.802-964.810=-0.008
max964.860-964.897=-0.037
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.829-0.824=0.005
σ0.019-0.037=-0.018
min0.811-0.775=0.036
max0.852-0.862=-0.010
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.006-0.007=-0.001
min885.504-885.505=-0.001
max885.518-885.522=-0.004
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.705-0.717=-0.012
σ0.038-0.030=0.009
min0.662-0.678=-0.017
max0.743-0.745=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean4.127-3.475=0.652
σ0.286-0.090=0.195
min3.433-3.349=0.084
max4.681-3.866=0.815
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean3.522-3.501=0.021
σ0.111-0.100=0.011
min3.346-3.362=-0.015
max4.293-4.002=0.291
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.744-0.752=-0.008
σ0.017-0.016=0.001
min0.706-0.713=-0.007
max0.849-0.835=0.014
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.704-0.709=-0.005
σ0.015-0.025=-0.010
min0.672-0.511=0.161
max0.777-0.772=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.504-297.202=-1.697
σ0.205-0.211=-0.006
min295.290-296.992=-1.702
max296.011-297.728=-1.717
mean1890.000-2031.000=-141.000
σ0.000
min1890.000-2031.000=-141.000
max1890.000-2031.000=-141.000
mean0.581-0.537=0.044
σ0.038-0.032=0.007
min0.520-0.505=0.015
max0.651-0.575=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-286.821=-1.408
σ0.033-0.038=-0.005
min285.370-286.771=-1.401
max285.447-286.859=-1.412
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.386-0.398=-0.012
σ0.007-0.006=0.001
min0.379-0.390=-0.011
max0.395-0.405=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.799-1297.244=-1.445
σ0.114-0.053=0.061
min1295.682-1297.185=-1.503
max1295.946-1297.300=-1.354
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean1.898-2.095=-0.197
σ0.084-0.080=0.004
min1.805-2.014=-0.209
max1.985-2.201=-0.216
iters=5
new-facts=6402
prior-facts=1
mean1539.919-1541.344=-1.425
σ6.878-6.817=0.061
min1536.674-1538.141=-1.467
max1552.219-1553.535=-1.316
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean2.248-2.278=-0.029
σ0.246-0.201=0.045
min2.054-2.140=-0.086
max2.562-2.600=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean1857.708-1859.104=-1.396
σ0.059-0.088=-0.029
min1857.644-1858.960=-1.316
max1857.792-1859.187=-1.396
mean1778.400-1783.400=-5.000
σ114.703-165.072=-50.369
min1658.000-1651.000=7.000
max1890.000-2031.000=-141.000
mean3.044-2.898=0.146
σ0.256-0.100=0.156
min2.837-2.799=0.038
max3.476-3.053=0.424

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.411-1.195=0.216
σ0.275-0.368=-0.093
min1.103-0.943=0.160
max1.827-1.815=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.738-448.822=-3.084
σ580.934-581.372=-0.438
min155.268-158.135=-2.867
max1317.138-1320.880=-3.741
mean96.250
σ8.500
min92.000
max109.000
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean0.521-0.568=-0.047
σ0.528-0.607=-0.079
min0.254-0.260=-0.007
max1.313-1.479=-0.166
policies=20
mean1552.974-1581.630=-28.656
σ0.328-0.361=-0.033
min1552.750-1581.392=-28.641
max1553.462-1582.168=-28.706
mean920.000
σ0.000
min920.000
max920.000
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean2.585-2.640=-0.055
σ0.006-0.006=-0.001
min2.582-2.632=-0.051
max2.593-2.646=-0.053
policies=200
mean15538.054-15824.161=-286.106
σ0.091-0.163=-0.072
min15537.965-15824.050=-286.085
max15538.182-15824.402=-286.221
mean9200.000
σ0.000
min9200.000
max9200.000
mean1658.000-1651.000=7.000
σ0.000
min1658.000-1651.000=7.000
max1658.000-1651.000=7.000
mean26.117-26.594=-0.477
σ0.132-0.094=0.038
min25.995-26.471=-0.476
max26.243-26.692=-0.450