Compare commits

Home / Compare 48491004 .. 63389201

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.000
σ0.371-0.371=-0.000
min53.913-53.916=-0.003
max55.110-55.110=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.130-0.135=-0.005
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.008=-0.002
min43.389-43.379=0.010
max43.408-43.410=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.119-0.121=-0.002
σ0.001-0.005=-0.004
min0.118-0.114=0.004
max0.120-0.129=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.024-1007.024=-0.000
σ1.194-1.174=0.019
min1006.452-1006.448=0.004
max1012.024-1011.937=0.087
mean1048.900-1054.800=-5.900
σ308.298-316.784=-8.486
min587.000-560.000=27.000
max1638.000-1619.000=19.000
mean1.545-1.530=0.015
σ0.084-0.051=0.033
min1.461-1.469=-0.008
max1.814-1.639=0.176

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.004-0.003=0.001
min0.882
max0.889-0.887=0.002
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.411-0.430=-0.019
σ0.147-0.140=0.007
min0.318-0.351=-0.032
max0.672-0.680=-0.009
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.857-0.887=-0.030
σ0.094-0.087=0.007
min0.798-0.827=-0.029
max1.020-1.040=-0.020
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.566-0.541=0.026
σ0.063-0.047=0.017
min0.509-0.506=0.003
max0.657-0.621=0.036
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.365-2.364=0.001
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.852-0.854=-0.002
σ0.057-0.036=0.022
min0.797-0.829=-0.032
max0.947-0.917=0.030

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.830=0.002
σ0.027-0.024=0.003
min964.802
max964.869-964.861=0.008
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.819-0.846=-0.027
σ0.049-0.032=0.018
min0.747-0.790=-0.044
max0.860-0.871=-0.012
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.006-0.009=-0.003
min885.504
max885.519-885.524=-0.005
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.715-0.717=-0.002
σ0.044-0.050=-0.007
min0.639-0.628=0.011
max0.742-0.750=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.722-7.722=0.001
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean4.223-4.266=-0.043
σ0.074-0.075=-0.001
min4.108-4.100=0.008
max4.546-4.574=-0.028
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean4.206-4.249=-0.043
σ0.066-0.083=-0.017
min4.097-4.082=0.015
max4.512-4.503=0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.745-0.743=0.002
σ0.017-0.028=-0.011
min0.711-0.701=0.010
max0.844-0.933=-0.089
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.704-0.699=0.005
σ0.025-0.031=-0.006
min0.511-0.505=0.006
max0.782-0.761=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.053-296.902=0.150
σ0.242-0.238=0.003
min296.886-296.772=0.114
max297.703-297.573=0.130
mean1927.000-2034.000=-107.000
σ0.000
min1927.000-2034.000=-107.000
max1927.000-2034.000=-107.000
mean0.595-0.577=0.017
σ0.026-0.034=-0.008
min0.533-0.506=0.027
max0.639-0.600=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.832-286.836=-0.005
σ0.038-0.039=-0.001
min286.784-286.782=0.002
max286.869-286.874=-0.004
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.397-0.396=0.001
σ0.006-0.007=-0.000
min0.391-0.389=0.002
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.222-1297.209=0.012
σ0.107-0.119=-0.011
min1297.108-1297.105=0.003
max1297.383-1297.399=-0.016
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean1.901-1.971=-0.069
σ0.090-0.231=-0.142
min1.810-1.791=0.018
max1.999-2.361=-0.362
iters=5
new-facts=6402
prior-facts=1
mean1541.366-1541.342=0.024
σ6.830-6.824=0.006
min1538.102-1538.112=-0.010
max1553.582-1553.547=0.035
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean2.124-2.198=-0.074
σ0.175-0.107=0.069
min1.957-2.114=-0.157
max2.412-2.368=0.044
iters=5
new-facts=6402
prior-facts=6402
mean1859.138-1859.139=-0.000
σ0.062-0.052=0.010
min1859.075-1859.075=-0.001
max1859.217-1859.204=0.013
mean1777.400-1778.200=-0.800
σ144.949-181.449=-36.500
min1638.000-1619.000=19.000
max1927.000-2034.000=-107.000
mean2.898-3.006=-0.108
σ0.116-0.294=-0.178
min2.789-2.849=-0.060
max3.095-3.529=-0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.347-1.365=-0.018
σ0.275-0.207=0.068
min1.107-1.106=0.002
max1.822-1.669=0.153

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.854-448.855=-0.001
σ581.373-581.372=0.000
min158.167-158.168=-0.001
max1320.913-1320.914=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean0.551-0.549=0.002
σ0.566-0.569=-0.004
min0.264-0.261=0.003
max1.399-1.403=-0.004
policies=20
mean1581.961-1581.963=-0.002
σ0.362-0.356=0.005
min1581.723-1581.722=0.001
max1582.499-1582.492=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean2.639-2.636=0.004
σ0.009-0.022=-0.013
min2.631-2.618=0.013
max2.650-2.667=-0.016
policies=200
mean15827.510-15827.617=-0.107
σ0.154-0.119=0.035
min15827.290-15827.536=-0.246
max15827.650-15827.791=-0.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1619.000=19.000
σ0.000
min1638.000-1619.000=19.000
max1638.000-1619.000=19.000
mean26.677-26.702=-0.025
σ0.147-0.108=0.039
min26.556-26.600=-0.044
max26.891-26.855=0.035