Compare commits

Home / Compare 8c2521bb .. 53bd6277

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.058=-0.001
σ0.368-0.370=-0.002
min53.914-53.924=-0.010
max55.104-55.110=-0.006
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.137-0.141=-0.004
σ0.006-0.003=0.002
min0.130-0.138=-0.008
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.396-43.395=0.001
σ0.006-0.006=-0.000
min43.386-43.386=0.000
max43.406-43.407=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.125-0.124=0.000
σ0.005-0.004=0.001
min0.120-0.120=-0.001
max0.135-0.130=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1006.918=0.043
σ0.867-0.894=-0.028
min1006.462-1006.455=0.007
max1010.547-1010.634=-0.087
mean1048.750-1052.100=-3.350
σ318.009-317.602=0.407
min546.000-549.000=-3.000
max1650.000-1652.000=-2.000
mean1.538-1.538=-0.001
σ0.095-0.082=0.014
min1.384-1.456=-0.072
max1.785-1.770=0.015

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.424-0.411=0.013
σ0.142-0.129=0.014
min0.339-0.327=0.012
max0.677-0.637=0.040
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.912-0.879=0.033
σ0.097-0.096=0.001
min0.848-0.817=0.030
max1.083-1.049=0.035
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.540-0.538=0.003
σ0.050-0.057=-0.007
min0.512-0.497=0.015
max0.630-0.639=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.863-0.843=0.020
σ0.036-0.046=-0.010
min0.838-0.811=0.027
max0.925-0.925=-0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.034-0.035=-0.001
min964.810-964.810=-0.000
max964.894-964.897=-0.003
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.807-0.855=-0.049
σ0.051-0.006=0.045
min0.739-0.848=-0.109
max0.854-0.864=-0.011
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.000
min885.505-885.504=0.001
max885.522-885.521=0.001
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.690-0.733=-0.044
σ0.045-0.006=0.039
min0.635-0.725=-0.090
max0.735-0.742=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.723=-0.004
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean4.238-4.200=0.038
σ0.099-0.115=-0.016
min3.803-4.058=-0.255
max4.552-5.051=-0.499
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean4.220-4.212=0.009
σ0.063-0.080=-0.017
min4.117-4.075=0.042
max4.468-4.480=-0.012
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.751-0.740=0.010
σ0.018-0.016=0.002
min0.723-0.706=0.017
max0.868-0.838=0.030
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.712-0.709=0.003
σ0.015-0.019=-0.004
min0.686-0.660=0.026
max0.786-0.792=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.492-295.429=0.062
σ0.264-0.218=0.046
min295.244-295.247=-0.003
max296.175-296.029=0.147
mean2018.000-1896.000=122.000
σ0.000
min2018.000-1896.000=122.000
max2018.000-1896.000=122.000
mean0.550-0.586=-0.036
σ0.041-0.022=0.019
min0.502-0.543=-0.041
max0.598-0.620=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.390-285.367=0.023
σ0.034-0.036=-0.002
min285.342-285.318=0.024
max285.424-285.402=0.022
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.391-0.391=0.001
σ0.005-0.008=-0.003
min0.383-0.382=0.001
max0.396-0.403=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.759-1295.743=0.016
σ0.086-0.108=-0.022
min1295.656-1295.627=0.029
max1295.870-1295.880=-0.010
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean1.847-1.898=-0.052
σ0.056-0.070=-0.014
min1.799-1.817=-0.018
max1.921-1.965=-0.044
iters=5
new-facts=6402
prior-facts=1
mean1539.896-1539.848=0.048
σ6.858-6.822=0.035
min1536.598-1536.599=-0.002
max1552.158-1552.048=0.110
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean2.289-2.236=0.053
σ0.182-0.198=-0.016
min2.135-2.034=0.101
max2.589-2.464=0.125
iters=5
new-facts=6402
prior-facts=6402
mean1857.688-1857.643=0.045
σ0.067-0.067=-0.000
min1857.610-1857.557=0.052
max1857.775-1857.737=0.038
mean1767.200-1780.600=-13.400
σ156.516-119.624=36.892
min1650.000-1652.000=-2.000
max2018.000-1896.000=122.000
mean2.913-2.985=-0.072
σ0.063-0.116=-0.052
min2.838-2.851=-0.013
max2.977-3.125=-0.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.210=0.014
σ0.328-0.329=-0.000
min0.946-0.931=0.016
max1.776-1.736=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.708-445.487=0.220
σ580.934-580.641=0.293
min155.239-155.162=0.077
max1317.108-1316.448=0.660
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean0.551-0.506=0.045
σ0.576-0.495=0.081
min0.259-0.254=0.005
max1.416-1.248=0.168
policies=20
mean1552.659-1551.928=0.730
σ0.327-0.336=-0.009
min1552.431-1551.701=0.731
max1553.144-1552.428=0.716
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean2.591-2.593=-0.002
σ0.001-0.008=-0.007
min2.590-2.586=0.004
max2.592-2.603=-0.011
policies=200
mean15534.652-15527.515=7.136
σ0.196-0.115=0.081
min15534.529-15527.347=7.182
max15534.944-15527.591=7.353
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1652.000=-2.000
σ0.000
min1650.000-1652.000=-2.000
max1650.000-1652.000=-2.000
mean26.245-26.105=0.140
σ0.114-0.113=0.001
min26.144-26.030=0.114
max26.384-26.270=0.114