Compare commits

Home / Compare fe82e004 .. 3f08e9bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.962=0.093
σ0.368-0.369=-0.001
min53.914-53.816=0.098
max55.102-55.011=0.091
mean417.900-416.000=1.900
σ0.316-0.000=0.316
min417.000-416.000=1.000
max418.000-416.000=2.000
mean0.139-0.141=-0.001
σ0.005-0.004=0.001
min0.132-0.136=-0.004
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.324=0.069
σ0.006-0.007=-0.001
min43.386-43.308=0.078
max43.404-43.335=0.069
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.123-0.121=0.002
σ0.005-0.005=-0.000
min0.116-0.115=0.001
max0.131-0.131=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1006.511=0.493
σ1.215-1.245=-0.030
min1006.460-1005.978=0.481
max1012.102-1011.730=0.373
mean1055.350-1050.450=4.900
σ307.959-303.994=3.965
min580.000-586.000=-6.000
max1647.000-1639.000=8.000
mean1.573-1.587=-0.014
σ0.081-0.139=-0.059
min1.497-1.482=0.015
max1.788-2.085=-0.297

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.433-0.428=0.006
σ0.138-0.136=0.001
min0.336-0.347=-0.011
max0.668-0.668=0.000
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.876-0.929=-0.053
σ0.104-0.094=0.010
min0.809-0.846=-0.037
max1.058-1.076=-0.018
name=heavy_item.art
mean1.524-1.524=0.001
σ0.002-0.002=0.000
min1.522
max1.528-1.526=0.001
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.523-0.537=-0.015
σ0.051-0.054=-0.003
min0.484-0.500=-0.016
max0.612-0.632=-0.020
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.001
min2.360
max2.365-2.364=0.001
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.839-0.853=-0.014
σ0.041-0.042=-0.000
min0.814-0.821=-0.008
max0.913-0.924=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.839=-0.003
σ0.033-0.034=-0.001
min964.811-964.811=0.000
max964.892-964.896=-0.004
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.827-0.834=-0.007
σ0.045-0.030=0.015
min0.753-0.794=-0.041
max0.859-0.861=-0.002
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.005-0.007=-0.003
min885.504
max885.516-885.522=-0.006
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.717-0.708=0.009
σ0.034-0.044=-0.011
min0.662-0.638=0.024
max0.745-0.743=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean4.271-3.490=0.781
σ0.099-0.080=0.018
min4.146-3.361=0.785
max4.791-3.873=0.918
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean4.251-3.484=0.767
σ0.074-0.072=0.002
min4.124-3.343=0.781
max4.511-3.766=0.745
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.729-0.742=-0.013
σ0.021-0.017=0.004
min0.678-0.707=-0.030
max0.850-0.837=0.013
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.694-0.689=0.005
σ0.018-0.041=-0.023
min0.652-0.510=0.143
max0.794-0.794=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.082-296.394=0.688
σ0.222-0.247=-0.025
min296.878-296.182=0.696
max297.632-297.058=0.574
mean1904.000-1913.000=-9.000
σ0.000
min1904.000-1913.000=-9.000
max1904.000-1913.000=-9.000
mean0.569-0.583=-0.015
σ0.028-0.053=-0.024
min0.520-0.505=0.015
max0.607-0.689=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-285.031=1.792
σ0.036-0.037=-0.001
min286.774-284.985=1.789
max286.861-285.073=1.788
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.394-0.396=-0.002
σ0.008-0.008=0.000
min0.386-0.386=-0.000
max0.404-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.266-1295.414=1.852
σ0.097-0.111=-0.014
min1297.128-1295.288=1.840
max1297.385-1295.550=1.835
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean2.249-1.985=0.264
σ0.116-0.123=-0.008
min2.169-1.814=0.355
max2.453-2.156=0.297
iters=5
new-facts=6402
prior-facts=1
mean1541.392-1539.574=1.818
σ6.775-6.807=-0.032
min1538.268-1536.320=1.948
max1553.510-1551.747=1.763
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean2.369-2.386=-0.017
σ0.263-0.240=0.024
min2.148-2.030=0.118
max2.767-2.673=0.093
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1857.315=1.801
σ0.066-0.057=0.009
min1859.027-1857.272=1.754
max1859.193-1857.400=1.794
mean1776.800-1773.600=3.200
σ126.308-135.188=-8.880
min1647.000-1639.000=8.000
max1904.000-1913.000=-9.000
mean3.101-3.054=0.046
σ0.274-0.385=-0.111
min2.854-2.642=0.212
max3.527-3.687=-0.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.265-1.214=0.051
σ0.260-0.317=-0.057
min0.964-0.932=0.032
max1.634-1.740=-0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.191=0.631
σ581.373-581.331=0.041
min158.134-157.525=0.609
max1320.881-1320.188=0.692
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean0.554-0.536=0.019
σ0.581-0.527=0.054
min0.264-0.270=-0.006
max1.425-1.326=0.099
policies=20
mean1581.632-1575.570=6.062
σ0.368-0.349=0.019
min1581.386-1575.333=6.053
max1582.180-1576.089=6.091
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean2.651-2.629=0.022
σ0.018-0.018=-0.001
min2.636-2.608=0.028
max2.676-2.652=0.025
policies=200
mean15824.059-15763.773=60.285
σ0.119-0.086=0.033
min15823.956-15763.694=60.262
max15824.222-15763.895=60.327
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1639.000=8.000
σ0.000
min1647.000-1639.000=8.000
max1647.000-1639.000=8.000
mean26.718-26.586=0.132
σ0.051-0.024=0.027
min26.670-26.551=0.119
max26.784-26.604=0.180