Compare commits

Home / Compare 518b2200 .. 38f48785

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.001
σ0.368-0.369=-0.001
min53.910-53.908=0.002
max55.101-55.106=-0.005
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.140-0.141=-0.001
σ0.004-0.005=-0.001
min0.136-0.134=0.003
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.001
σ0.007-0.006=0.001
min43.382-43.384=-0.001
max43.403-43.404=-0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.122-0.122=-0.000
σ0.004-0.004=-0.000
min0.118-0.119=-0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.980=0.001
σ0.861-0.882=-0.022
min1006.482-1006.483=-0.001
max1010.535-1010.638=-0.103
mean1051.600-1052.450=-0.850
σ310.935-307.788=3.147
min555.000-578.000=-23.000
max1649.000-1652.000=-3.000
mean1.547-1.513=0.034
σ0.071-0.079=-0.008
min1.482-1.348=0.133
max1.761-1.685=0.076

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.421-0.430=-0.009
σ0.142-0.133=0.009
min0.344-0.344=0.000
max0.674-0.666=0.008
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.875-0.889=-0.014
σ0.084-0.079=0.005
min0.815-0.840=-0.025
max1.022-1.028=-0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.533-0.533=-0.000
σ0.052-0.048=0.003
min0.477-0.487=-0.010
max0.617-0.612=0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.843-0.850=-0.007
σ0.039-0.037=0.002
min0.815-0.816=-0.001
max0.909-0.914=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.833=0.003
σ0.031-0.022=0.009
min964.811-964.811=-0.000
max964.889-964.861=0.029
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.804-0.837=-0.033
σ0.018-0.020=-0.002
min0.777-0.818=-0.040
max0.826-0.860=-0.034
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.002
σ0.004-0.005=-0.002
min885.508-885.504=0.003
max885.517-885.516=0.002
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.693-0.668=0.025
σ0.063-0.027=0.036
min0.588-0.641=-0.053
max0.748-0.708=0.041

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean4.197-4.255=-0.058
σ0.075-0.072=0.004
min4.029-4.129=-0.100
max4.505-4.506=-0.000
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean4.198-4.260=-0.062
σ0.073-0.097=-0.024
min4.059-4.106=-0.047
max4.421-4.688=-0.266
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.738-0.753=-0.014
σ0.019-0.017=0.003
min0.703-0.731=-0.027
max0.870-0.863=0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.696-0.714=-0.018
σ0.014-0.015=-0.001
min0.671-0.688=-0.017
max0.781-0.786=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.480-295.592=-0.112
σ0.259-0.225=0.034
min295.322-295.450=-0.128
max296.201-296.211=-0.010
mean2019.000-1900.000=119.000
σ0.000
min2019.000-1900.000=119.000
max2019.000-1900.000=119.000
mean0.532-0.575=-0.043
σ0.039-0.046=-0.007
min0.495-0.519=-0.023
max0.598-0.691=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.410=0.002
σ0.043-0.038=0.004
min285.354-285.359=-0.004
max285.455-285.448=0.007
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.388-0.387=0.001
σ0.008-0.005=0.003
min0.380-0.382=-0.003
max0.399-0.395=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.806-1295.790=0.017
σ0.112-0.101=0.011
min1295.677-1295.674=0.002
max1295.947-1295.904=0.042
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean1.876-1.951=-0.075
σ0.086-0.165=-0.079
min1.805-1.831=-0.026
max2.018-2.226=-0.208
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.935=-0.019
σ6.867-6.839=0.028
min1536.654-1536.652=0.002
max1552.197-1552.165=0.032
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean2.210-2.323=-0.113
σ0.180-0.222=-0.042
min2.037-2.029=0.008
max2.429-2.608=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean1857.708-1857.701=0.007
σ0.055-0.053=0.002
min1857.649-1857.653=-0.005
max1857.776-1857.781=-0.004
mean1776.000-1777.800=-1.800
σ162.779-122.034=40.745
min1649.000-1652.000=-3.000
max2019.000-1900.000=119.000
mean3.028-3.100=-0.072
σ0.332-0.297=0.036
min2.828-2.867=-0.039
max3.613-3.615=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.412=-0.098
σ0.320-0.247=0.073
min1.104-1.264=-0.160
max1.872-1.848=0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.934-580.934=-0.000
min155.272-155.273=-0.000
max1317.142-1317.143=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.526-0.556=-0.030
σ0.529-0.594=-0.065
min0.256-0.257=-0.001
max1.320-1.448=-0.128
policies=20
mean1552.986-1552.991=-0.005
σ0.323-0.325=-0.003
min1552.761-1552.767=-0.005
max1553.465-1553.475=-0.010
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean2.586-2.584=0.002
σ0.018-0.014=0.005
min2.568-2.569=-0.002
max2.604-2.597=0.007
policies=200
mean15537.947-15538.061=-0.115
σ0.070-0.040=0.030
min15537.875-15538.018=-0.142
max15538.014-15538.112=-0.098
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean26.096-26.146=-0.049
σ0.184-0.120=0.065
min25.939-26.063=-0.124
max26.363-26.318=0.045