Compare commits

Home / Compare b5b15fcf .. a5499531

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.001
σ0.369-0.369=0.000
min53.913-53.906=0.007
max55.106-55.105=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.142-0.139=0.003
σ0.004-0.006=-0.002
min0.138-0.131=0.007
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=0.001
min43.376-43.386=-0.010
max43.403-43.408=-0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.123-0.121=0.001
σ0.003-0.005=-0.002
min0.120-0.115=0.005
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.974-1006.973=0.001
σ0.891-0.911=-0.020
min1006.480-1006.507=-0.027
max1010.675-1010.764=-0.089
mean1046.700-1050.450=-3.750
σ303.755-307.589=-3.833
min577.000
max1660.000-1650.000=10.000
mean1.534-1.546=-0.012
σ0.052-0.087=-0.035
min1.477-1.470=0.008
max1.623-1.813=-0.190

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.884=0.000
σ0.003-0.002=0.001
min0.882
max0.889-0.887=0.002
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.425-0.432=-0.007
σ0.129-0.118=0.011
min0.350-0.340=0.010
max0.653-0.630=0.023
name=error_case.art
mean2.339
σ0.003-0.002=0.001
min2.337
max2.344-2.342=0.002
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.878-0.878=-0.000
σ0.082-0.088=-0.007
min0.818-0.822=-0.004
max1.021-1.034=-0.014
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.542-0.533=0.010
σ0.054-0.049=0.005
min0.500-0.487=0.013
max0.632-0.615=0.017
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.365=-0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.844-0.854=-0.010
σ0.026-0.043=-0.017
min0.825-0.816=0.009
max0.889-0.922=-0.034

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.833=-0.000
σ0.026-0.030=-0.003
min964.806-964.802=0.004
max964.875-964.876=-0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.806-0.831=-0.025
σ0.049-0.023=0.026
min0.730-0.802=-0.071
max0.853-0.856=-0.003
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.006-0.006=0.000
min885.505
max885.520-885.520=0.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.714-0.667=0.047
σ0.056-0.061=-0.005
min0.617-0.600=0.017
max0.757-0.737=0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean4.234-4.248=-0.014
σ0.089-0.079=0.009
min4.079-4.099=-0.020
max4.659-4.532=0.126
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean4.224-4.243=-0.019
σ0.077-0.061=0.016
min4.060-4.123=-0.063
max4.521-4.502=0.020
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.745-0.748=-0.003
σ0.017-0.018=-0.001
min0.715-0.715=-0.000
max0.855-0.861=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.714-0.710=0.005
σ0.015-0.014=0.002
min0.680-0.681=-0.001
max0.787-0.780=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.722-295.577=0.145
σ0.277-0.228=0.049
min295.341-295.417=-0.076
max296.399-296.201=0.198
mean1923.000-2016.000=-93.000
σ0.000
min1923.000-2016.000=-93.000
max1923.000-2016.000=-93.000
mean0.569-0.540=0.029
σ0.045-0.028=0.017
min0.502-0.500=0.002
max0.655-0.574=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.416=-0.006
σ0.030-0.035=-0.005
min285.374-285.370=0.004
max285.441-285.451=-0.010
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.389-0.392=-0.003
σ0.010-0.008=0.002
min0.380-0.384=-0.004
max0.400-0.403=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.803=-0.008
σ0.106-0.104=0.001
min1295.674-1295.677=-0.003
max1295.919-1295.923=-0.004
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean1.898-1.916=-0.018
σ0.078-0.096=-0.018
min1.811-1.839=-0.028
max1.996-2.077=-0.081
iters=5
new-facts=6402
prior-facts=1
mean1539.928-1539.944=-0.016
σ6.894-6.864=0.031
min1536.634-1536.647=-0.014
max1552.255-1552.217=0.038
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean2.337-2.372=-0.035
σ0.212-0.119=0.093
min2.104-2.202=-0.098
max2.647-2.494=0.153
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.699=0.007
σ0.062-0.063=-0.002
min1857.634-1857.616=0.017
max1857.783-1857.777=0.006
mean1783.400-1785.400=-2.000
σ132.741-158.581=-25.839
min1660.000-1650.000=10.000
max1923.000-2016.000=-93.000
mean3.033-3.113=-0.079
σ0.134-0.261=-0.127
min2.856-2.878=-0.023
max3.163-3.510=-0.347

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.356-1.352=0.004
σ0.112-0.292=-0.180
min1.269-1.109=0.160
max1.539-1.793=-0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.002
σ580.934-580.934=0.000
min155.272-155.271=0.002
max1317.143-1317.140=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean0.557-0.541=0.016
σ0.595-0.569=0.026
min0.258-0.255=0.003
max1.450-1.394=0.056
policies=20
mean1552.987-1552.965=0.022
σ0.320-0.315=0.005
min1552.764-1552.747=0.017
max1553.462-1553.433=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean2.584-2.575=0.009
σ0.020-0.023=-0.003
min2.568-2.550=0.018
max2.612-2.603=0.009
policies=200
mean15538.074-15538.010=0.064
σ0.079-0.104=-0.024
min15537.974-15537.879=0.095
max15538.169-15538.132=0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1650.000=10.000
σ0.000
min1660.000-1650.000=10.000
max1660.000-1650.000=10.000
mean26.218-26.176=0.041
σ0.144-0.079=0.064
min26.083-26.115=-0.032
max26.402-26.287=0.115