Compare commits

Home / Compare f24487aa .. fd7589a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.003
σ0.368-0.369=-0.001
min53.872-53.880=-0.008
max55.060-55.066=-0.007
mean420.000-418.000=2.000
σ0.000
min420.000-418.000=2.000
max420.000-418.000=2.000
mean0.137-0.140=-0.003
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.324-43.321=0.003
σ0.007-0.007=0.000
min43.316-43.312=0.004
max43.338-43.334=0.005
mean420.000-418.000=2.000
σ0.000
min420.000-418.000=2.000
max420.000-418.000=2.000
mean0.124-0.123=0.001
σ0.004-0.008=-0.004
min0.121-0.115=0.006
max0.130-0.141=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.307=0.004
σ1.170-1.186=-0.016
min1005.773-1005.777=-0.004
max1011.209-1011.277=-0.069
mean1049.400-1049.250=0.150
σ313.462-312.487=0.975
min600.000
max1643.000-1638.000=5.000
mean1.591-1.591=-0.000
σ0.079-0.097=-0.018
min1.515-1.504=0.011
max1.820-1.859=-0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.412-0.417=-0.004
σ0.129-0.139=-0.010
min0.340-0.325=0.015
max0.641-0.661=-0.020
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.874-0.890=-0.016
σ0.095-0.109=-0.014
min0.808-0.822=-0.015
max1.039-1.081=-0.042
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.538-0.543=-0.006
σ0.053-0.054=-0.001
min0.498-0.507=-0.009
max0.630-0.632=-0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.845-0.835=0.010
σ0.032-0.039=-0.007
min0.821-0.806=0.016
max0.901-0.896=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.114=0.000
σ0.035-0.032=0.003
min964.086-964.086=-0.001
max964.172-964.166=0.006
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.838-0.854=-0.016
σ0.038-0.006=0.031
min0.771-0.849=-0.078
max0.860-0.865=-0.005
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.007=0.000
min884.703
max884.721-884.721=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.722-0.732=-0.010
σ0.033-0.012=0.021
min0.663-0.710=-0.046
max0.741-0.739=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.719=0.002
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean4.241-4.224=0.017
σ0.081-0.073=0.008
min4.116-4.101=0.015
max4.583-4.477=0.105
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean4.255-4.230=0.026
σ0.081-0.087=-0.005
min4.071-4.103=-0.032
max4.516-4.605=-0.088
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.738-0.735=0.003
σ0.019-0.020=-0.000
min0.708-0.696=0.012
max0.856-0.846=0.010
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.700-0.690=0.010
σ0.016-0.016=-0.000
min0.672-0.658=0.014
max0.794-0.768=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.356-296.269=0.087
σ0.265-0.241=0.024
min296.185-296.060=0.125
max297.086-296.904=0.182
mean1908.000-1898.000=10.000
σ0.000
min1908.000-1898.000=10.000
max1908.000-1898.000=10.000
mean0.569-0.580=-0.011
σ0.054-0.045=0.008
min0.506-0.505=0.001
max0.680-0.670=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.699-284.693=0.006
σ0.031-0.036=-0.006
min284.670-284.653=0.017
max284.737-284.738=-0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.396-0.397=-0.001
σ0.009-0.009=0.000
min0.385-0.385=0.001
max0.405-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.079=-0.002
σ0.110-0.108=0.002
min1294.960-1294.960=0.000
max1295.214-1295.226=-0.012
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean1.901-1.932=-0.031
σ0.090-0.088=0.002
min1.805-1.830=-0.025
max2.005-2.040=-0.034
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.208=-0.021
σ6.840-6.852=-0.011
min1535.916-1535.921=-0.005
max1551.420-1551.461=-0.041
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.263-2.203=0.060
σ0.261-0.224=0.037
min2.031-2.029=0.002
max2.668-2.588=0.079
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.980=0.005
σ0.055-0.059=-0.004
min1856.930-1856.931=-0.001
max1857.059-1857.065=-0.005
mean1775.400-1779.800=-4.400
σ130.178-123.864=6.314
min1643.000-1638.000=5.000
max1908.000-1898.000=10.000
mean3.076-2.904=0.172
σ0.206-0.057=0.149
min2.850-2.853=-0.003
max3.366-2.994=0.371

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.168-1.207=-0.039
σ0.297-0.322=-0.025
min0.918-0.936=-0.018
max1.634-1.754=-0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.000
σ581.213-581.212=0.001
min157.176-157.177=-0.000
max1319.605-1319.604=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.536-0.530=0.007
σ0.553-0.533=0.020
min0.258-0.262=-0.004
max1.366-1.329=0.037
policies=20
mean1572.091-1572.104=-0.013
σ0.347-0.358=-0.011
min1571.859-1571.860=-0.001
max1572.608-1572.637=-0.029
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.628-2.632=-0.004
σ0.006-0.008=-0.002
min2.621-2.626=-0.005
max2.636-2.644=-0.008
policies=200
mean15729.037-15729.012=0.025
σ0.115-0.055=0.059
min15728.962-15728.967=-0.005
max15729.206-15729.080=0.126
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean26.557-26.542=0.015
σ0.055-0.074=-0.018
min26.505-26.464=0.041
max26.631-26.627=0.004