Compare commits

Home / Compare 48a663cf .. 90b8c015

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.046=0.000
σ0.371-0.367=0.003
min53.893-53.903=-0.010
max55.100-55.090=0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.139=0.001
σ0.004-0.003=0.001
min0.136-0.136=0.000
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.006-0.006=0.001
min43.373-43.376=-0.003
max43.396-43.393=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.124-0.122=0.002
σ0.004-0.004=0.000
min0.121-0.117=0.003
max0.131-0.129=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.975-1006.976=-0.001
σ0.876-0.892=-0.016
min1006.482-1006.507=-0.025
max1010.603-1010.680=-0.078
mean1043.250-1052.900=-9.650
σ313.019-320.013=-6.994
min544.000-577.000=-33.000
max1626.000-1619.000=7.000
mean1.578-1.570=0.008
σ0.121-0.074=0.048
min1.464-1.497=-0.032
max1.908-1.837=0.072

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.436-0.451=-0.015
σ0.141-0.190=-0.048
min0.361-0.337=0.023
max0.688-0.789=-0.100
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.902-0.901=0.000
σ0.100-0.146=-0.047
min0.828-0.813=0.015
max1.074-1.162=-0.088
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.552-0.527=0.025
σ0.050-0.055=-0.005
min0.513-0.482=0.031
max0.635-0.621=0.014
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.871-0.840=0.032
σ0.051-0.047=0.005
min0.830-0.796=0.035
max0.956-0.918=0.038

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.025-0.031=-0.006
min964.803-964.802=0.001
max964.861-964.886=-0.025
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.824-0.835=-0.010
σ0.064-0.026=0.038
min0.710-0.794=-0.084
max0.857-0.856=0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.005-0.005=0.001
min885.504
max885.518-885.516=0.003
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.701-0.726=-0.024
σ0.033-0.017=0.016
min0.648-0.706=-0.058
max0.737-0.746=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean4.275-3.493=0.781
σ0.094-0.080=0.014
min4.131-3.334=0.797
max4.783-3.799=0.984
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean4.245-3.493=0.752
σ0.074-0.073=0.001
min4.120-3.339=0.782
max4.614-3.752=0.862
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.752-0.534=0.217
σ0.017-0.015=0.003
min0.723-0.507=0.216
max0.867-0.630=0.237
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.710-0.501=0.208
σ0.014-0.011=0.003
min0.681-0.475=0.206
max0.784-0.556=0.229

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.562-295.473=0.090
σ0.246-0.225=0.020
min295.367-295.268=0.100
max296.238-296.080=0.157
mean1924.000-2032.000=-108.000
σ0.000
min1924.000-2032.000=-108.000
max1924.000-2032.000=-108.000
mean0.589-0.540=0.050
σ0.034-0.033=0.001
min0.539-0.500=0.038
max0.673-0.577=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.414=-0.004
σ0.038-0.035=0.003
min285.363-285.367=-0.004
max285.449-285.451=-0.002
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.394-0.386=0.007
σ0.007-0.005=0.001
min0.388-0.381=0.008
max0.401-0.392=0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.799-1295.797=0.002
σ0.109-0.107=0.002
min1295.677-1295.678=-0.001
max1295.924-1295.920=0.005
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean1.905-1.915=-0.010
σ0.079-0.124=-0.044
min1.818-1.818=-0.000
max1.998-2.065=-0.068
iters=5
new-facts=6402
prior-facts=1
mean1538.662-1539.935=-1.273
σ4.017-6.848=-2.830
min1536.638-1536.675=-0.037
max1545.839-1552.179=-6.341
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean2.327-2.294=0.034
σ0.161-0.148=0.012
min2.093-2.110=-0.017
max2.452-2.471=-0.020
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.706=-0.004
σ0.060-0.053=0.006
min1857.631-1857.648=-0.016
max1857.780-1857.777=0.004
mean1770.000-1770.600=-0.600
σ149.419-177.464=-28.045
min1626.000-1619.000=7.000
max1924.000-2032.000=-108.000
mean3.052-3.091=-0.039
σ0.144-0.291=-0.147
min2.875-2.867=0.008
max3.220-3.542=-0.322

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.400-1.328=0.072
σ0.294-0.313=-0.019
min1.114-1.104=0.009
max1.895-1.866=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.059-445.741=-1.682
σ577.575-580.934=-3.359
min155.271-155.272=-0.002
max1310.422-1317.142=-6.721
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean0.540-0.535=0.005
σ0.555-0.552=0.003
min0.258-0.258=-0.001
max1.372-1.362=0.010
policies=20
mean1552.970-1552.993=-0.023
σ0.324-0.337=-0.013
min1552.746-1552.764=-0.018
max1553.450-1553.494=-0.044
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean2.586-2.598=-0.012
σ0.022-0.019=0.004
min2.571-2.582=-0.010
max2.619-2.625=-0.006
policies=200
mean15537.993-15538.039=-0.046
σ0.049-0.075=-0.026
min15537.924-15537.959=-0.035
max15538.041-15538.129=-0.088
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1619.000=7.000
σ0.000
min1626.000-1619.000=7.000
max1626.000-1619.000=7.000
mean26.254-26.198=0.056
σ0.109-0.092=0.017
min26.163-26.126=0.037
max26.409-26.331=0.077