Compare commits

Home / Compare 8ae317fd .. 85381971

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.001
σ0.370-0.368=0.002
min53.828-53.815=0.013
max55.016-55.011=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.138-0.138=0.000
σ0.006-0.005=0.001
min0.130-0.131=-0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.007=-0.001
min43.315-43.311=0.005
max43.336-43.335=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.118-0.114=0.004
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.512-1006.512=0.000
σ1.240-1.180=0.060
min1005.980-1005.948=0.032
max1011.707-1011.464=0.243
mean1061.050-1052.300=8.750
σ319.585-315.670=3.915
min548.000-564.000=-16.000
max1519.000-1614.000=-95.000
mean1.551-1.496=0.055
σ0.165-0.060=0.106
min1.361-1.340=0.020
max2.151-1.586=0.565

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.458-0.422=0.037
σ0.141-0.141=-0.000
min0.360-0.336=0.024
max0.705-0.672=0.033
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.886-0.900=-0.015
σ0.108-0.091=0.017
min0.807-0.839=-0.032
max1.076-1.058=0.018
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.525-0.546=-0.021
σ0.044-0.061=-0.017
min0.480-0.494=-0.014
max0.592-0.645=-0.054
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.850-0.861=-0.011
σ0.039-0.044=-0.005
min0.823-0.822=0.001
max0.918-0.933=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.839=-0.009
σ0.039-0.034=0.004
min964.806-964.811=-0.005
max964.898-964.896=0.002
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.795-0.767=0.028
σ0.089-0.086=0.003
min0.651-0.634=0.016
max0.863-0.851=0.013
name=cdr_enhanced_4k_loc.art
mean885.510-885.513=-0.003
σ0.008-0.006=0.002
min885.504-885.506=-0.001
max885.523-885.522=0.001
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.706-0.704=0.002
σ0.045-0.031=0.015
min0.643-0.680=-0.037
max0.743-0.753=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean3.795-3.568=0.228
σ0.343-0.103=0.239
min3.392-3.393=-0.002
max4.522-4.082=0.440
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.669
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean4.142-3.530=0.612
σ0.247-0.061=0.186
min3.487-3.377=0.109
max4.522-3.743=0.779
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.757-0.749=0.008
σ0.025-0.017=0.008
min0.711-0.715=-0.004
max0.921-0.837=0.084
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.647-0.702=-0.055
σ0.091-0.030=0.061
min0.488-0.521=-0.034
max0.773-0.792=-0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.375-296.449=-0.074
σ0.234-0.246=-0.011
min296.248-296.197=0.051
max297.029-297.093=-0.064
mean2034.000-2035.000=-1.000
σ0.000
min2034.000-2035.000=-1.000
max2034.000-2035.000=-1.000
mean0.557-0.549=0.008
σ0.029-0.029=-0.000
min0.510-0.504=0.006
max0.584-0.582=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.028-285.032=-0.004
σ0.038-0.037=0.001
min284.978-284.985=-0.007
max285.064-285.078=-0.013
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.397-0.392=0.006
σ0.011-0.005=0.006
min0.387-0.385=0.002
max0.415-0.397=0.019
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.407=0.004
σ0.105-0.106=-0.001
min1295.300-1295.290=0.010
max1295.539-1295.526=0.012
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean1.913-1.919=-0.005
σ0.127-0.110=0.017
min1.807-1.822=-0.016
max2.072-2.060=0.013
iters=5
new-facts=6402
prior-facts=1
mean1539.513-1539.529=-0.016
σ6.854-6.812=0.042
min1536.231-1536.269=-0.038
max1551.769-1551.709=0.061
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean2.242-2.313=-0.071
σ0.209-0.132=0.077
min1.984-2.182=-0.198
max2.475-2.532=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean1857.313-1857.317=-0.004
σ0.069-0.067=0.001
min1857.231-1857.235=-0.004
max1857.399-1857.403=-0.003
mean1752.600-1775.400=-22.800
σ209.139-182.796=26.344
min1519.000-1614.000=-95.000
max2034.000-2035.000=-1.000
mean2.968-3.107=-0.139
σ0.278-0.270=0.008
min2.753-2.862=-0.108
max3.445-3.523=-0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.217=0.334
σ0.280-0.321=-0.041
min1.189-0.936=0.253
max1.840-1.721=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.189=0.003
σ581.331-581.332=-0.001
min157.524-157.520=0.004
max1320.188-1320.187=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean0.531-0.570=-0.039
σ0.541-0.597=-0.056
min0.260-0.264=-0.004
max1.342-1.465=-0.123
policies=20
mean1575.567-1575.553=0.014
σ0.348-0.357=-0.009
min1575.330-1575.310=0.020
max1576.084-1576.083=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean2.619-2.631=-0.012
σ0.014-0.013=0.002
min2.603-2.615=-0.012
max2.636-2.644=-0.009
policies=200
mean15763.703-15763.688=0.015
σ0.028-0.046=-0.018
min15763.665-15763.625=0.041
max15763.730-15763.734=-0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1614.000=-95.000
σ0.000
min1519.000-1614.000=-95.000
max1519.000-1614.000=-95.000
mean26.518-26.545=-0.027
σ0.058-0.094=-0.036
min26.460-26.472=-0.012
max26.570-26.670=-0.101