Compare commits

Home / Compare 365fbc09 .. cd758986

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.059-54.057=0.002
σ0.370-0.369=0.000
min53.922-53.913=0.010
max55.110-55.106=0.004
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.155-0.138=0.017
σ0.008-0.005=0.003
min0.139-0.130=0.009
max0.165-0.144=0.020
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.005-0.006=-0.001
min43.387-43.385=0.001
max43.405-43.405=-0.000
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.122-0.124=-0.002
σ0.006-0.004=0.002
min0.114-0.120=-0.006
max0.134-0.130=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1006.976=0.008
σ0.865-0.874=-0.009
min1006.483-1006.482=0.001
max1010.558-1010.602=-0.044
mean1048.950-1058.350=-9.400
σ307.583-319.933=-12.350
min573.000-582.000=-9.000
max1647.000-1626.000=21.000
mean1.526-1.549=-0.022
σ0.070-0.086=-0.016
min1.465-1.463=0.002
max1.757-1.863=-0.106

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.408-0.419=-0.011
σ0.136-0.148=-0.013
min0.324-0.331=-0.007
max0.648-0.683=-0.035
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.891-0.881=0.010
σ0.083-0.110=-0.027
min0.836-0.820=0.016
max1.035-1.076=-0.041
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.538-0.564=-0.027
σ0.056-0.065=-0.008
min0.483-0.503=-0.020
max0.631-0.635=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.837-0.846=-0.009
σ0.038-0.044=-0.006
min0.808-0.815=-0.007
max0.903-0.922=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.001
σ0.025-0.025=0.000
min964.802-964.803=-0.001
max964.862-964.863=-0.001
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.821-0.840=-0.020
σ0.039-0.015=0.024
min0.776-0.823=-0.047
max0.866-0.852=0.014
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.006-0.009=-0.003
min885.504
max885.518-885.524=-0.005
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.720-0.706=0.014
σ0.031-0.019=0.012
min0.672-0.688=-0.016
max0.749-0.731=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean4.272-4.253=0.019
σ0.108-0.101=0.007
min4.087-4.118=-0.031
max4.628-4.808=-0.179
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean4.258-3.531=0.727
σ0.084-0.144=-0.060
min4.123-3.373=0.750
max4.500-4.411=0.089
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.734-0.730=0.004
σ0.021-0.025=-0.005
min0.702-0.693=0.009
max0.841-0.892=-0.051
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.691-0.694=-0.003
σ0.028-0.015=0.013
min0.494-0.658=-0.165
max0.780-0.770=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.412-295.635=-0.223
σ0.240-0.256=-0.016
min295.240-295.465=-0.225
max296.072-296.340=-0.269
mean1906.000-2031.000=-125.000
σ0.000
min1906.000-2031.000=-125.000
max1906.000-2031.000=-125.000
mean0.581-0.524=0.058
σ0.055-0.035=0.020
min0.501-0.497=0.004
max0.708-0.575=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.411=0.001
σ0.033-0.031=0.002
min285.368-285.370=-0.001
max285.444-285.444=-0.000
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.397-0.403=-0.006
σ0.015-0.014=0.001
min0.381-0.383=-0.002
max0.422-0.423=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.766=0.028
σ0.103-0.117=-0.014
min1295.675-1295.677=-0.002
max1295.914-1295.961=-0.047
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean1.940-2.017=-0.077
σ0.142-0.198=-0.056
min1.814-1.832=-0.018
max2.153-2.318=-0.165
iters=5
new-facts=6402
prior-facts=1
mean1539.939-1540.011=-0.072
σ6.885-6.904=-0.019
min1536.635-1536.805=-0.170
max1552.251-1552.359=-0.109
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean2.352-2.431=-0.080
σ0.204-0.342=-0.138
min2.033-2.112=-0.079
max2.511-2.865=-0.355
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1857.707=-0.002
σ0.055-0.049=0.006
min1857.646-1857.652=-0.006
max1857.776-1857.771=0.005
mean1776.400-1771.200=5.200
σ128.298-176.844=-48.546
min1647.000-1626.000=21.000
max1906.000-2031.000=-125.000
mean3.078-2.859=0.219
σ0.310-0.122=0.188
min2.867-2.667=0.200
max3.620-2.972=0.648

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.381-1.378=0.003
σ0.311-0.248=0.063
min1.101-1.116=-0.015
max1.903-1.780=0.122

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.740=0.000
σ580.934-580.934=-0.000
min155.272-155.271=0.000
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean0.550-0.523=0.027
σ0.588-0.534=0.054
min0.256-0.255=0.001
max1.432-1.324=0.108
policies=20
mean1552.987-1552.985=0.002
σ0.319-0.327=-0.007
min1552.764-1552.755=0.010
max1553.461-1553.469=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean2.578-2.579=-0.001
σ0.019-0.020=-0.001
min2.553-2.557=-0.005
max2.596-2.601=-0.004
policies=200
mean15538.063-15538.058=0.005
σ0.063-0.117=-0.054
min15538.007-15537.961=0.046
max15538.153-15538.227=-0.074
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1626.000=21.000
σ0.000
min1647.000-1626.000=21.000
max1647.000-1626.000=21.000
mean26.149-26.198=-0.049
σ0.108-0.178=-0.071
min26.010-26.022=-0.012
max26.270-26.438=-0.168