Compare commits

Home / Compare f42cacd7 .. ff802fa6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.969-53.964=0.005
σ0.371-0.370=0.001
min53.836-53.822=0.014
max55.025-55.017=0.008
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.152-0.137=0.015
σ0.012-0.005=0.007
min0.137-0.130=0.007
max0.172-0.145=0.027
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.005-0.007=-0.002
min43.316-43.313=0.003
max43.334-43.336=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.122=-0.001
σ0.002-0.005=-0.003
min0.119-0.114=0.005
max0.125-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.516-1006.510=0.006
σ1.169-1.189=-0.019
min1005.948-1005.976=-0.028
max1011.412-1011.483=-0.071
mean1055.150-1035.450=19.700
σ315.496-310.951=4.546
min568.000-545.000=23.000
max1616.000-1504.000=112.000
mean1.537-1.548=-0.011
σ0.046-0.075=-0.029
min1.479-1.423=0.056
max1.651-1.776=-0.125

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.003-0.003=-0.000
min0.882
max0.887-0.889=-0.002
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.443-0.443=-0.000
σ0.191-0.187=0.004
min0.332-0.345=-0.014
max0.783-0.777=0.006
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.001
min2.337
max2.342
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.943-0.926=0.017
σ0.174-0.186=-0.011
min0.826-0.830=-0.004
max1.248-1.257=-0.009
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.536-0.536=0.000
σ0.051-0.046=0.004
min0.486-0.493=-0.007
max0.618-0.614=0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.863-0.847=0.016
σ0.037-0.044=-0.007
min0.819-0.812=0.007
max0.904-0.922=-0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.827=0.012
σ0.032-0.034=-0.001
min964.812-964.802=0.010
max964.893-964.886=0.007
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.838-0.801=0.038
σ0.019-0.026=-0.007
min0.818-0.766=0.052
max0.858-0.833=0.025
name=cdr_enhanced_4k_loc.art
mean885.511-885.510=0.002
σ0.007-0.005=0.002
min885.504
max885.520-885.515=0.005
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.699-0.703=-0.004
σ0.035-0.033=0.002
min0.666-0.667=-0.001
max0.740-0.735=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean4.206-4.223=-0.017
σ0.073-0.085=-0.013
min4.067-4.095=-0.028
max4.502-4.578=-0.076
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean4.201-4.221=-0.020
σ0.066-0.064=0.002
min4.059-4.085=-0.025
max4.457-4.409=0.048
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.746-0.739=0.007
σ0.019-0.020=-0.000
min0.710-0.705=0.005
max0.864-0.853=0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.706-0.696=0.011
σ0.015-0.014=0.001
min0.678-0.663=0.015
max0.782-0.749=0.033

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.349-296.398=-0.049
σ0.225-0.273=-0.047
min296.163-296.184=-0.021
max296.946-297.121=-0.174
mean2031.000-1920.000=111.000
σ0.000
min2031.000-1920.000=111.000
max2031.000-1920.000=111.000
mean0.557-0.582=-0.025
σ0.036-0.037=-0.001
min0.503-0.505=-0.002
max0.596-0.648=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.029-285.036=-0.007
σ0.038-0.023=0.015
min284.976-285.014=-0.038
max285.066-285.061=0.006
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.395-0.398=-0.003
σ0.009-0.007=0.001
min0.388-0.387=0.001
max0.409-0.406=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.426-1295.436=-0.010
σ0.118-0.077=0.041
min1295.296-1295.344=-0.048
max1295.585-1295.533=0.051
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean1.887-2.088=-0.200
σ0.094-0.081=0.012
min1.800-1.988=-0.188
max2.027-2.170=-0.143
iters=5
new-facts=6402
prior-facts=1
mean1539.517-1539.528=-0.011
σ6.828-6.840=-0.012
min1536.208-1536.297=-0.089
max1551.726-1551.759=-0.033
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean2.276-2.247=0.028
σ0.233-0.139=0.093
min2.053-2.101=-0.048
max2.624-2.418=0.206
iters=5
new-facts=6402
prior-facts=6402
mean1857.326-1857.317=0.009
σ0.054-0.079=-0.025
min1857.256-1857.205=0.050
max1857.399-1857.402=-0.004
mean1765.000-1747.000=18.000
σ180.837-181.676=-0.839
min1616.000-1504.000=112.000
max2031.000-1920.000=111.000
mean2.880-3.044=-0.164
σ0.064-0.144=-0.080
min2.824-2.872=-0.048
max2.959-3.199=-0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-1.632=-0.386
σ0.364-0.299=0.066
min0.939-1.235=-0.295
max1.864-1.898=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.193-448.194=-0.000
σ581.341-581.340=0.001
min157.519-157.522=-0.003
max1320.205-1320.203=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean0.538-0.546=-0.008
σ0.552-0.567=-0.015
min0.260-0.261=-0.001
max1.366-1.397=-0.031
policies=20
mean1575.556-1575.562=-0.006
σ0.365-0.372=-0.007
min1575.310-1575.312=-0.002
max1576.098-1576.115=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean2.645-2.659=-0.015
σ0.018-0.031=-0.013
min2.629-2.623=0.006
max2.662-2.699=-0.038
policies=200
mean15763.682-15763.671=0.011
σ0.194-0.058=0.137
min15763.528-15763.594=-0.066
max15763.964-15763.732=0.231
mean9200.000
σ0.000
min9200.000
max9200.000
mean1616.000-1504.000=112.000
σ0.000
min1616.000-1504.000=112.000
max1616.000-1504.000=112.000
mean26.607-26.697=-0.090
σ0.058-0.085=-0.028
min26.572-26.612=-0.040
max26.693-26.807=-0.115