Compare commits

Home / Compare dce23d94 .. ac8dee69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.014=0.041
σ0.369-0.369=0.000
min53.911-53.875=0.036
max55.106-55.065=0.041
mean415.700-417.000=-1.300
σ0.483-0.000=0.483
min415.000-417.000=-2.000
max416.000-417.000=-1.000
mean0.138-0.142=-0.003
σ0.004-0.010=-0.006
min0.134-0.135=-0.001
max0.146-0.168=-0.022
cache=y
dps=1
iters=10
policies=100
mean43.394-43.324=0.070
σ0.006-0.007=-0.000
min43.381-43.313=0.068
max43.405-43.336=0.069
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.123-0.130=-0.007
σ0.004-0.007=-0.004
min0.120-0.121=-0.001
max0.129-0.139=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.308=0.669
σ0.933-1.184=-0.250
min1006.504-1005.741=0.763
max1010.859-1011.271=-0.412
mean1044.450-1053.000=-8.550
σ304.153-315.233=-11.080
min580.000-581.000=-1.000
max1598.000-1652.000=-54.000
mean1.580-1.554=0.026
σ0.141-0.083=0.058
min1.488-1.483=0.006
max2.098-1.799=0.299

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.419-0.412=0.007
σ0.139-0.147=-0.008
min0.344-0.327=0.017
max0.666-0.671=-0.005
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.881-0.890=-0.009
σ0.092-0.102=-0.010
min0.819-0.822=-0.003
max1.038-1.069=-0.031
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.528-0.542=-0.014
σ0.047-0.059=-0.012
min0.491-0.496=-0.006
max0.606-0.641=-0.035
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.852-0.850=0.001
σ0.041-0.044=-0.003
min0.821-0.804=0.017
max0.922-0.922=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.114=0.718
σ0.040-0.033=0.006
min964.806-964.086=0.720
max964.901-964.168=0.733
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.807-0.808=-0.001
σ0.037-0.066=-0.029
min0.772-0.709=0.063
max0.859-0.880=-0.021
name=cdr_enhanced_4k_loc.art
mean885.511-884.712=0.799
σ0.008-0.007=0.001
min885.504-884.703=0.801
max885.523-884.721=0.802
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.709-0.730=-0.021
σ0.041-0.016=0.025
min0.642-0.706=-0.064
max0.741-0.747=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.722-7.718=0.004
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean4.271-4.262=0.008
σ0.083-0.087=-0.004
min4.099-4.115=-0.016
max4.591-4.574=0.017
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean4.267-4.282=-0.015
σ0.081-0.081=0.000
min4.134-4.153=-0.019
max4.516-4.623=-0.108
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.742-0.745=-0.002
σ0.018-0.019=-0.001
min0.712-0.710=0.002
max0.841-0.878=-0.037
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.663-0.701=-0.038
σ0.086-0.015=0.071
min0.489-0.672=-0.183
max0.841-0.765=0.077

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.526-296.066=-0.541
σ0.279-0.191=0.088
min295.344-295.817=-0.473
max296.305-296.551=-0.246
mean2005.000-2068.000=-63.000
σ0.000
min2005.000-2068.000=-63.000
max2005.000-2068.000=-63.000
mean0.532-0.542=-0.010
σ0.035-0.033=0.002
min0.497-0.505=-0.007
max0.587-0.580=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-284.697=0.714
σ0.036-0.039=-0.003
min285.359-284.645=0.714
max285.445-284.738=0.708
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.393-0.411=-0.018
σ0.007-0.011=-0.004
min0.385-0.403=-0.018
max0.404-0.430=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1295.789-1295.066=0.723
σ0.096-0.089=0.007
min1295.671-1294.953=0.718
max1295.887-1295.168=0.719
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean1.863-1.863=-0.000
σ0.085-0.089=-0.004
min1.793-1.796=-0.003
max1.968-1.992=-0.024
iters=5
new-facts=6402
prior-facts=1
mean1539.923-1539.212=0.711
σ6.881-6.875=0.006
min1536.615-1535.882=0.734
max1552.227-1551.507=0.719
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean2.233-2.239=-0.006
σ0.190-0.210=-0.020
min2.027-2.046=-0.019
max2.435-2.597=-0.162
iters=5
new-facts=6402
prior-facts=6402
mean1857.735-1856.990=0.746
σ0.067-0.055=0.012
min1857.656-1856.926=0.730
max1857.801-1857.065=0.736
mean1735.600-1794.800=-59.200
σ175.657-176.791=-1.135
min1598.000-1652.000=-54.000
max2005.000-2068.000=-63.000
mean2.866-2.845=0.022
σ0.055-0.057=-0.003
min2.826-2.778=0.049
max2.961-2.936=0.024

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.543-1.217=0.326
σ0.269-0.343=-0.074
min1.264-0.934=0.330
max1.841-1.795=0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-447.786=-2.045
σ580.934-581.212=-0.278
min155.272-157.179=-1.906
max1317.142-1319.605=-2.463
mean96.250
σ8.500
min92.000
max109.000
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean0.544-0.555=-0.011
σ0.561-0.587=-0.026
min0.262-0.261=0.002
max1.386-1.435=-0.050
policies=20
mean1552.988-1572.099=-19.111
σ0.323-0.349=-0.026
min1552.767-1571.866=-19.099
max1553.468-1572.619=-19.151
mean920.000
σ0.000
min920.000
max920.000
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean2.580-2.628=-0.048
σ0.017-0.009=0.008
min2.567-2.617=-0.050
max2.603-2.638=-0.035
policies=200
mean15537.945-15728.999=-191.054
σ0.148-0.076=0.072
min15537.794-15728.890=-191.095
max15538.086-15729.068=-190.982
mean9200.000
σ0.000
min9200.000
max9200.000
mean1598.000-1652.000=-54.000
σ0.000
min1598.000-1652.000=-54.000
max1598.000-1652.000=-54.000
mean25.980-26.565=-0.585
σ0.081-0.243=-0.162
min25.898-26.412=-0.515
max26.085-26.928=-0.843