Compare commits

Home / Compare 035d5934 .. 82c74ab2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.367-0.369=-0.003
min53.919-53.911=0.007
max55.098-55.106=-0.008
mean417.000-415.700=1.300
σ0.000-0.483=-0.483
min417.000-415.000=2.000
max417.000-416.000=1.000
mean0.139-0.138=0.001
σ0.004-0.004=0.000
min0.136-0.134=0.002
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.005-0.006=-0.001
min43.388-43.381=0.007
max43.403-43.405=-0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.123=-0.003
σ0.005-0.004=0.001
min0.113-0.120=-0.007
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.976=0.005
σ0.885-0.933=-0.049
min1006.507-1006.504=0.003
max1010.648-1010.859=-0.211
mean1049.350-1044.450=4.900
σ319.930-304.153=15.777
min574.000-580.000=-6.000
max1617.000-1598.000=19.000
mean1.565-1.580=-0.015
σ0.099-0.141=-0.042
min1.469-1.488=-0.020
max1.867-2.098=-0.231

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.421-0.419=0.002
σ0.146-0.139=0.007
min0.339-0.344=-0.005
max0.681-0.666=0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.881-0.881=0.000
σ0.091-0.092=-0.000
min0.822-0.819=0.003
max1.042-1.038=0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.538-0.528=0.010
σ0.047-0.047=0.000
min0.500-0.491=0.009
max0.619-0.606=0.013
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.856-0.852=0.005
σ0.042-0.041=0.001
min0.823-0.821=0.002
max0.928-0.922=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.832=0.003
σ0.031-0.040=-0.008
min964.805-964.806=-0.000
max964.888-964.901=-0.013
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.828-0.807=0.020
σ0.016-0.037=-0.020
min0.805-0.772=0.034
max0.852-0.859=-0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.511=0.002
σ0.005-0.008=-0.003
min885.504
max885.517-885.523=-0.006
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.698-0.709=-0.011
σ0.040-0.041=-0.001
min0.661-0.642=0.019
max0.742-0.741=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.002
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean3.529-4.271=-0.742
σ0.081-0.083=-0.002
min3.402-4.099=-0.697
max3.864-4.591=-0.727
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.670-7.668=0.003
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean3.481-4.267=-0.786
σ0.133-0.081=0.052
min3.249-4.134=-0.885
max4.239-4.516=-0.277
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.738-0.742=-0.004
σ0.019-0.018=0.001
min0.698-0.712=-0.014
max0.863-0.841=0.022
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.697-0.663=0.034
σ0.015-0.086=-0.071
min0.672-0.489=0.183
max0.776-0.841=-0.066

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.569-295.526=0.043
σ0.200-0.279=-0.079
min295.416-295.344=0.072
max296.079-296.305=-0.226
mean1895.000-2005.000=-110.000
σ0.000
min1895.000-2005.000=-110.000
max1895.000-2005.000=-110.000
mean0.570-0.532=0.039
σ0.036-0.035=0.002
min0.496-0.497=-0.001
max0.622-0.587=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.411=-0.001
σ0.034-0.036=-0.002
min285.364-285.359=0.006
max285.446-285.445=0.000
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.391-0.393=-0.002
σ0.011-0.007=0.004
min0.382-0.385=-0.003
max0.406-0.404=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.797-1295.789=0.008
σ0.111-0.096=0.015
min1295.677-1295.671=0.005
max1295.934-1295.887=0.047
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean1.931-1.863=0.068
σ0.114-0.085=0.030
min1.794-1.793=0.002
max2.025-1.968=0.057
iters=5
new-facts=6402
prior-facts=1
mean1539.922-1539.923=-0.001
σ6.902-6.881=0.022
min1536.602-1536.615=-0.013
max1552.263-1552.227=0.037
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean2.332-2.233=0.099
σ0.275-0.190=0.085
min2.028-2.027=0.001
max2.693-2.435=0.258
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.735=-0.033
σ0.051-0.067=-0.015
min1857.661-1857.656=0.005
max1857.774-1857.801=-0.027
mean1760.800-1735.600=25.200
σ131.134-175.657=-44.522
min1617.000-1598.000=19.000
max1895.000-2005.000=-110.000
mean3.101-2.866=0.235
σ0.348-0.055=0.293
min2.888-2.826=0.062
max3.719-2.961=0.758

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.322-1.543=-0.221
σ0.248-0.269=-0.021
min1.103-1.264=-0.161
max1.699-1.841=-0.142

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.272-155.272=-0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean0.548-0.544=0.004
σ0.584-0.561=0.023
min0.256-0.262=-0.007
max1.424-1.386=0.039
policies=20
mean1552.966-1552.988=-0.022
σ0.307-0.323=-0.016
min1552.757-1552.767=-0.010
max1553.423-1553.468=-0.045
mean920.000
σ0.000
min920.000
max920.000
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean2.566-2.580=-0.014
σ0.017-0.017=0.000
min2.548-2.567=-0.018
max2.586-2.603=-0.018
policies=200
mean15537.881-15537.945=-0.065
σ0.098-0.148=-0.051
min15537.743-15537.794=-0.051
max15537.957-15538.086=-0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1617.000-1598.000=19.000
σ0.000
min1617.000-1598.000=19.000
max1617.000-1598.000=19.000
mean26.147-25.980=0.167
σ0.275-0.081=0.195
min25.844-25.898=-0.054
max26.485-26.085=0.400