Compare commits

Home / Compare dfd6b09e .. e84e15d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.056=-0.010
σ0.369-0.369=0.000
min53.892-53.911=-0.019
max55.096-55.106=-0.010
mean414.000-415.700=-1.700
σ0.000-0.483=-0.483
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.139-0.138=0.001
σ0.004-0.004=-0.000
min0.135-0.134=0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.394=-0.009
σ0.004-0.006=-0.003
min43.380-43.381=-0.001
max43.392-43.405=-0.014
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.123=-0.002
σ0.004-0.004=0.001
min0.114-0.120=-0.006
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.976=0.003
σ0.868-0.933=-0.066
min1006.480-1006.504=-0.024
max1010.569-1010.859=-0.290
mean1047.100-1044.450=2.650
σ315.079-304.153=10.926
min577.000-580.000=-3.000
max1650.000-1598.000=52.000
mean1.557-1.580=-0.023
σ0.062-0.141=-0.079
min1.500-1.488=0.011
max1.727-2.098=-0.371

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.437-0.419=0.017
σ0.191-0.139=0.051
min0.332-0.344=-0.012
max0.777-0.666=0.111
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.906-0.881=0.025
σ0.153-0.092=0.061
min0.822-0.819=0.003
max1.178-1.038=0.140
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.535-0.528=0.007
σ0.050-0.047=0.003
min0.497-0.491=0.006
max0.616-0.606=0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.839-0.852=-0.012
σ0.036-0.041=-0.004
min0.803-0.821=-0.018
max0.896-0.922=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.832=-0.001
σ0.025-0.040=-0.015
min964.802-964.806=-0.004
max964.861-964.901=-0.040
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.823-0.807=0.015
σ0.031-0.037=-0.005
min0.786-0.772=0.014
max0.856-0.859=-0.004
name=cdr_enhanced_4k_loc.art
mean885.513-885.511=0.002
σ0.005-0.008=-0.003
min885.504
max885.516-885.523=-0.007
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.701-0.709=-0.008
σ0.037-0.041=-0.004
min0.643-0.642=0.001
max0.743-0.741=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.002
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean3.480-4.271=-0.790
σ0.105-0.083=0.022
min3.327-4.099=-0.772
max4.158-4.591=-0.433
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean3.779-4.267=-0.488
σ0.355-0.081=0.274
min3.310-4.134=-0.824
max4.323-4.516=-0.193
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.733-0.742=-0.009
σ0.019-0.018=0.001
min0.697-0.712=-0.015
max0.849-0.841=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.693-0.663=0.030
σ0.027-0.086=-0.059
min0.521-0.489=0.033
max0.793-0.841=-0.049

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.526=0.167
σ0.248-0.279=-0.031
min295.425-295.344=0.081
max296.351-296.305=0.046
mean1888.000-2005.000=-117.000
σ0.000
min1888.000-2005.000=-117.000
max1888.000-2005.000=-117.000
mean0.565-0.532=0.034
σ0.045-0.035=0.010
min0.497-0.497=0.000
max0.614-0.587=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.411=-0.006
σ0.041-0.036=0.005
min285.360-285.359=0.001
max285.452-285.445=0.006
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.384-0.393=-0.009
σ0.005-0.007=-0.003
min0.378-0.385=-0.007
max0.391-0.404=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.789=0.005
σ0.104-0.096=0.008
min1295.681-1295.671=0.009
max1295.923-1295.887=0.036
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean1.923-1.863=0.060
σ0.102-0.085=0.017
min1.810-1.793=0.018
max2.034-1.968=0.067
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.923=-0.007
σ6.854-6.881=-0.027
min1536.648-1536.615=0.033
max1552.173-1552.227=-0.054
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean2.231-2.233=-0.002
σ0.301-0.190=0.111
min1.930-2.027=-0.097
max2.685-2.435=0.250
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.735=-0.026
σ0.054-0.067=-0.012
min1857.648-1857.656=-0.008
max1857.778-1857.801=-0.023
mean1771.000-1735.600=35.400
σ118.030-175.657=-57.627
min1650.000-1598.000=52.000
max1888.000-2005.000=-117.000
mean2.995-2.866=0.129
σ0.101-0.055=0.047
min2.860-2.826=0.033
max3.101-2.961=0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.543=-0.122
σ0.290-0.269=0.021
min1.110-1.264=-0.154
max1.815-1.841=-0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=-0.000
min155.272-155.272=-0.000
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean0.525-0.544=-0.019
σ0.538-0.561=-0.023
min0.256-0.262=-0.007
max1.332-1.386=-0.054
policies=20
mean1552.978-1552.988=-0.010
σ0.321-0.323=-0.002
min1552.755-1552.767=-0.011
max1553.455-1553.468=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean2.579-2.580=-0.001
σ0.043-0.017=0.026
min2.551-2.567=-0.016
max2.641-2.603=0.038
policies=200
mean15537.863-15537.945=-0.082
σ0.133-0.148=-0.015
min15537.773-15537.794=-0.022
max15538.060-15538.086=-0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1598.000=52.000
σ0.000
min1650.000-1598.000=52.000
max1650.000-1598.000=52.000
mean26.074-25.980=0.094
σ0.075-0.081=-0.006
min25.963-25.898=0.066
max26.122-26.085=0.038