Compare commits

Home / Compare ea4813b0 .. 489fdb11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.369-0.368=0.000
min53.908-53.910=-0.002
max55.103-55.103=-0.000
mean419.000-413.500=5.500
σ0.000-0.527=-0.527
min419.000-413.000=6.000
max419.000-414.000=5.000
mean0.138-0.137=0.001
σ0.004-0.004=-0.000
min0.132-0.131=0.000
max0.145-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.006=0.001
min43.386-43.388=-0.002
max43.402-43.402=-0.000
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.120-0.123=-0.003
σ0.004-0.003=0.001
min0.115-0.120=-0.005
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.978=0.001
σ0.925-0.871=0.055
min1006.507-1006.482=0.025
max1010.827-1010.581=0.247
mean1055.650-1047.650=8.000
σ306.148-307.736=-1.588
min576.000-553.000=23.000
max1457.000-1642.000=-185.000
mean1.568-1.546=0.022
σ0.135-0.072=0.063
min1.469-1.481=-0.012
max2.021-1.753=0.267

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.441-0.421=0.019
σ0.126-0.138=-0.012
min0.352-0.336=0.015
max0.659-0.666=-0.007
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.886-0.882=0.004
σ0.097-0.089=0.009
min0.826-0.814=0.012
max1.058-1.034=0.024
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.532-0.544=-0.012
σ0.051-0.043=0.008
min0.482-0.508=-0.025
max0.616-0.615=0.002
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.843-0.837=0.007
σ0.040-0.038=0.002
min0.816-0.800=0.017
max0.911-0.895=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.835=-0.013
σ0.026-0.031=-0.006
min964.802-964.807=-0.005
max964.864-964.888=-0.024
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.829-0.832=-0.003
σ0.032-0.048=-0.017
min0.795-0.750=0.046
max0.865-0.872=-0.007
name=cdr_enhanced_4k_loc.art
mean885.511-885.515=-0.004
σ0.006-0.005=0.002
min885.504-885.508=-0.004
max885.518-885.519=-0.000
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.736-0.698=0.038
σ0.008-0.042=-0.033
min0.723-0.643=0.080
max0.745-0.734=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean3.535-3.498=0.037
σ0.084-0.090=-0.006
min3.395-3.326=0.069
max3.894-4.069=-0.175
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean3.523-3.477=0.047
σ0.064-0.080=-0.016
min3.386-3.365=0.021
max3.734-3.762=-0.029
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.540-0.744=-0.204
σ0.015-0.027=-0.012
min0.520-0.570=-0.050
max0.638-0.856=-0.218
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.506-0.581=-0.075
σ0.016-0.099=-0.082
min0.475-0.487=-0.012
max0.569-0.788=-0.219

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.380=0.248
σ0.285-0.165=0.120
min295.466-295.277=0.190
max296.421-295.832=0.589
mean1905.000-1906.000=-1.000
σ0.000
min1905.000-1906.000=-1.000
max1905.000-1906.000=-1.000
mean0.583-0.574=0.009
σ0.046-0.041=0.005
min0.500-0.493=0.007
max0.645-0.627=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-285.413=-0.015
σ0.030-0.037=-0.007
min285.360-285.368=-0.008
max285.431-285.453=-0.023
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.403-0.387=0.016
σ0.005-0.007=-0.002
min0.396-0.380=0.016
max0.410-0.396=0.014
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1295.794=-0.029
σ0.069-0.114=-0.045
min1295.676-1295.663=0.013
max1295.838-1295.936=-0.097
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean1.913-1.988=-0.074
σ0.102-0.276=-0.174
min1.819-1.797=0.022
max2.048-2.467=-0.419
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1539.974=0.019
σ6.860-6.833=0.027
min1536.776-1536.707=0.069
max1552.261-1552.192=0.068
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean2.503-2.403=0.100
σ0.156-0.238=-0.081
min2.248-2.052=0.196
max2.645-2.635=0.010
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1857.706=-0.006
σ0.051-0.056=-0.005
min1857.654-1857.654=0.001
max1857.774-1857.784=-0.010
mean1744.600-1774.200=-29.600
σ171.144-130.550=40.594
min1505.000-1642.000=-137.000
max1905.000-1906.000=-1.000
mean3.058-3.056=0.002
σ0.264-0.272=-0.008
min2.869-2.842=0.027
max3.524-3.525=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.306=0.453
σ0.129-0.279=-0.150
min1.608-1.098=0.511
max1.917-1.779=0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.742=-0.001
σ580.934-580.937=-0.003
min155.272-155.270=0.002
max1317.142-1317.147=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean0.542-0.544=-0.002
σ0.558-0.561=-0.003
min0.262-0.262=0.000
max1.378-1.385=-0.007
policies=20
mean1552.986-1552.990=-0.004
σ0.317-0.325=-0.008
min1552.769-1552.768=0.001
max1553.457-1553.472=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean2.572-2.586=-0.014
σ0.017-0.009=0.008
min2.557-2.575=-0.018
max2.595-2.594=0.001
policies=200
mean15538.060-15537.740=0.319
σ0.060-0.469=-0.410
min15538.014-15537.052=0.962
max15538.147-15538.071=0.076
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1642.000=-185.000
σ0.000
min1457.000-1642.000=-185.000
max1457.000-1642.000=-185.000
mean26.140-26.183=-0.043
σ0.018-0.213=-0.195
min26.118-26.024=0.094
max26.161-26.497=-0.336