Compare commits

Home / Compare 3c0d55dd .. 82595119

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.368-0.368=-0.001
min53.908-53.916=-0.007
max55.101-55.103=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.139=-0.001
σ0.004-0.004=-0.001
min0.135-0.135=-0.000
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.005-0.007=-0.001
min43.388-43.385=0.003
max43.402-43.406=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.122=0.001
σ0.003-0.003=-0.000
min0.119-0.119=-0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.984=-0.004
σ0.864-0.855=0.009
min1006.480-1006.483=-0.003
max1010.553-1010.507=0.046
mean1044.800-1047.200=-2.400
σ313.998-314.016=-0.018
min576.000-577.000=-1.000
max1638.000-1645.000=-7.000
mean1.544-1.534=0.010
σ0.081-0.082=-0.001
min1.378-1.404=-0.026
max1.763-1.798=-0.035

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.416-0.430=-0.014
σ0.126-0.144=-0.018
min0.337-0.326=0.011
max0.637-0.684=-0.047
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.881-0.887=-0.006
σ0.088-0.091=-0.004
min0.818-0.812=0.006
max1.030-1.046=-0.016
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.001=0.000
min1.522
max1.525
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.540-0.545=-0.005
σ0.047-0.054=-0.007
min0.506-0.496=0.010
max0.621-0.632=-0.011
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.864-0.865=-0.001
σ0.032-0.033=-0.001
min0.829-0.843=-0.014
max0.915-0.924=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.832=-0.002
σ0.025-0.028=-0.002
min964.802-964.810=-0.008
max964.862-964.876=-0.013
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.816-0.808=0.008
σ0.041-0.048=-0.007
min0.779-0.748=0.031
max0.863-0.864=-0.001
name=cdr_enhanced_4k_loc.art
mean885.515-885.514=0.000
σ0.005-0.007=-0.002
min885.508-885.504=0.004
max885.520-885.520=-0.000
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.703-0.686=0.018
σ0.040-0.057=-0.017
min0.658-0.608=0.050
max0.748-0.758=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean4.200-4.233=-0.033
σ0.064-0.099=-0.035
min4.063-4.098=-0.035
max4.431-4.633=-0.202
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean4.204-4.236=-0.032
σ0.086-0.077=0.009
min4.076-4.113=-0.037
max4.518-4.536=-0.018
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.745-0.747=-0.002
σ0.019-0.019=0.000
min0.714-0.685=0.029
max0.846-0.851=-0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.696-0.706=-0.010
σ0.016-0.016=-0.001
min0.669-0.635=0.035
max0.785-0.764=0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.507-295.627=-0.120
σ0.188-0.258=-0.070
min295.366-295.377=-0.011
max296.027-296.311=-0.285
mean2025.000-1913.000=112.000
σ0.000
min2025.000-1913.000=112.000
max2025.000-1913.000=112.000
mean0.551-0.575=-0.024
σ0.029-0.053=-0.025
min0.520-0.513=0.006
max0.591-0.694=-0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.406=0.003
σ0.037-0.032=0.005
min285.361-285.365=-0.004
max285.448-285.441=0.007
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.391-0.391=-0.000
σ0.014-0.009=0.005
min0.381-0.381=0.000
max0.408-0.401=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.768-1295.795=-0.027
σ0.107-0.114=-0.007
min1295.677-1295.666=0.011
max1295.941-1295.947=-0.006
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean1.979-1.978=0.001
σ0.204-0.124=0.080
min1.800-1.843=-0.043
max2.288-2.132=0.156
iters=5
new-facts=6402
prior-facts=1
mean1539.998-1539.936=0.062
σ6.891-6.890=0.001
min1536.762-1536.634=0.128
max1552.322-1552.255=0.066
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean2.408-2.345=0.062
σ0.307-0.207=0.100
min2.105-2.102=0.004
max2.854-2.618=0.236
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.705=0.005
σ0.053-0.059=-0.006
min1857.644-1857.642=0.001
max1857.777-1857.785=-0.008
mean1772.800
σ170.120-134.715=35.404
min1638.000-1645.000=-7.000
max2025.000-1913.000=112.000
mean2.887-2.971=-0.083
σ0.054-0.212=-0.158
min2.837-2.677=0.160
max2.954-3.277=-0.322

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.344=0.024
σ0.295-0.221=0.074
min1.123-1.107=0.016
max1.882-1.702=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.002
σ580.935-580.934=0.001
min155.270-155.272=-0.002
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean0.551-0.534=0.017
σ0.575-0.549=0.025
min0.261-0.255=0.006
max1.413-1.358=0.054
policies=20
mean1552.991-1552.990=0.000
σ0.330-0.328=0.002
min1552.763-1552.767=-0.005
max1553.480-1553.478=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean2.586-2.590=-0.003
σ0.011-0.024=-0.013
min2.579-2.569=0.010
max2.603-2.620=-0.017
policies=200
mean15538.070-15537.931=0.139
σ0.111-0.082=0.029
min15537.948-15537.839=0.109
max15538.213-15538.012=0.202
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1645.000=-7.000
σ0.000
min1638.000-1645.000=-7.000
max1638.000-1645.000=-7.000
mean26.149-26.122=0.027
σ0.140-0.106=0.034
min26.021-26.029=-0.008
max26.349-26.272=0.077