Compare commits

Home / Compare 7638ece7 .. 11cb584c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.368-0.369=-0.001
min53.909-53.908=0.000
max55.102-55.106=-0.004
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.140-0.141=-0.001
σ0.003-0.005=-0.002
min0.136-0.134=0.002
max0.145-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.005-0.006=-0.000
min43.385-43.384=0.001
max43.401-43.404=-0.003
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.114-0.119=-0.005
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.980=-0.001
σ0.869-0.882=-0.014
min1006.501-1006.483=0.019
max1010.575-1010.638=-0.063
mean1046.650-1052.450=-5.800
σ314.988-307.788=7.200
min577.000-578.000=-1.000
max1645.000-1652.000=-7.000
mean1.538-1.513=0.025
σ0.100-0.079=0.021
min1.460-1.348=0.112
max1.893-1.685=0.209

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.003=-0.001
min0.882
max0.887
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.436-0.430=0.006
σ0.131-0.133=-0.002
min0.348-0.344=0.004
max0.661-0.666=-0.005
name=error_case.art
mean2.340-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.876-0.889=-0.013
σ0.082-0.079=0.003
min0.819-0.840=-0.021
max1.020-1.028=-0.009
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.529-0.533=-0.004
σ0.048-0.048=-0.000
min0.492-0.487=0.005
max0.612-0.612=-0.000
name=nested_use.art
mean2.362-2.361=0.001
σ0.003-0.002=0.001
min2.360
max2.366-2.364=0.002
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.837-0.850=-0.013
σ0.042-0.037=0.004
min0.796-0.816=-0.019
max0.903-0.914=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.833=-0.002
σ0.025-0.022=0.003
min964.803-964.811=-0.008
max964.862-964.861=0.001
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.860-0.837=0.024
σ0.004-0.020=-0.016
min0.855-0.818=0.037
max0.865-0.860=0.004
name=cdr_enhanced_4k_loc.art
mean885.515-885.511=0.004
σ0.008-0.005=0.003
min885.504
max885.525-885.516=0.009
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.715-0.668=0.047
σ0.030-0.027=0.003
min0.669-0.641=0.028
max0.747-0.708=0.039

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.001
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.230-4.255=-0.025
σ0.093-0.072=0.021
min4.086-4.129=-0.043
max4.727-4.506=0.221
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean4.239-4.260=-0.021
σ0.111-0.097=0.014
min3.630-4.106=-0.476
max4.558-4.688=-0.129
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.750-0.753=-0.002
σ0.018-0.017=0.002
min0.721-0.731=-0.010
max0.862-0.863=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.708-0.714=-0.007
σ0.015-0.015=0.000
min0.681-0.688=-0.007
max0.798-0.786=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.513-295.592=-0.079
σ0.237-0.225=0.012
min295.343-295.450=-0.108
max296.159-296.211=-0.052
mean1940.000-1900.000=40.000
σ0.000
min1940.000-1900.000=40.000
max1940.000-1900.000=40.000
mean0.568-0.575=-0.007
σ0.041-0.046=-0.004
min0.505-0.519=-0.013
max0.657-0.691=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.410=-0.003
σ0.034-0.038=-0.004
min285.364-285.359=0.005
max285.442-285.448=-0.006
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.388-0.387=0.001
σ0.009-0.005=0.004
min0.381-0.382=-0.002
max0.398-0.395=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.790=0.006
σ0.104-0.101=0.003
min1295.676-1295.674=0.001
max1295.921-1295.904=0.017
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean1.900-1.951=-0.051
σ0.089-0.165=-0.076
min1.812-1.831=-0.019
max2.016-2.226=-0.210
iters=5
new-facts=6402
prior-facts=1
mean1539.921-1539.935=-0.014
σ6.901-6.839=0.062
min1536.584-1536.652=-0.068
max1552.260-1552.165=0.095
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.343-2.323=0.020
σ0.271-0.222=0.050
min2.044-2.029=0.015
max2.685-2.608=0.077
iters=5
new-facts=6402
prior-facts=6402
mean1857.714-1857.701=0.013
σ0.066-0.053=0.013
min1857.642-1857.653=-0.011
max1857.800-1857.781=0.020
mean1788.000-1777.800=10.200
σ147.843-122.034=25.809
min1645.000-1652.000=-7.000
max1940.000-1900.000=40.000
mean2.947-3.100=-0.153
σ0.128-0.297=-0.169
min2.828-2.867=-0.039
max3.109-3.615=-0.505

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.362-1.412=-0.051
σ0.285-0.247=0.038
min1.116-1.264=-0.148
max1.855-1.848=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.003
σ580.934-580.934=0.000
min155.269-155.273=-0.004
max1317.140-1317.143=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.532-0.556=-0.024
σ0.547-0.594=-0.047
min0.257-0.257=-0.000
max1.353-1.448=-0.094
policies=20
mean1552.972-1552.991=-0.019
σ0.311-0.325=-0.014
min1552.756-1552.767=-0.011
max1553.434-1553.475=-0.040
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.567-2.584=-0.017
σ0.013-0.014=-0.001
min2.554-2.569=-0.015
max2.580-2.597=-0.017
policies=200
mean15537.980-15538.061=-0.082
σ0.087-0.040=0.047
min15537.856-15538.018=-0.162
max15538.059-15538.112=-0.053
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean26.065-26.146=-0.081
σ0.147-0.120=0.028
min25.881-26.063=-0.182
max26.238-26.318=-0.080