Compare commits

Home / Compare d99da350 .. 685cd9bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.013=0.001
σ0.368-0.369=-0.001
min53.869-53.879=-0.010
max55.061-55.063=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.138-0.135=0.004
σ0.004-0.005=-0.000
min0.132-0.129=0.003
max0.144-0.142=0.001
cache=y
dps=1
iters=10
policies=100
mean43.325-43.321=0.004
σ0.005-0.007=-0.002
min43.319-43.312=0.006
max43.333-43.337=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.125-0.117=0.008
σ0.005-0.003=0.002
min0.119-0.115=0.005
max0.135-0.122=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.307=0.002
σ1.175-1.165=0.010
min1005.764-1005.774=-0.010
max1011.227-1011.178=0.049
mean1043.500-1048.400=-4.900
σ312.030-313.630=-1.600
min595.000-598.000=-3.000
max1633.000-1646.000=-13.000
mean1.554-1.561=-0.007
σ0.078-0.079=-0.001
min1.471-1.478=-0.007
max1.789-1.786=0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.407-0.416=-0.009
σ0.144-0.136=0.008
min0.323-0.329=-0.006
max0.661-0.657=0.004
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.906-0.895=0.011
σ0.103-0.114=-0.011
min0.805-0.828=-0.023
max1.056-1.097=-0.041
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.534-0.575=-0.041
σ0.044-0.074=-0.030
min0.490-0.497=-0.007
max0.603-0.673=-0.070
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.834-0.861=-0.027
σ0.039-0.045=-0.005
min0.793-0.822=-0.029
max0.897-0.930=-0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.003
σ0.035-0.023=0.012
min964.087-964.092=-0.006
max964.172-964.151=0.021
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.795-0.826=-0.031
σ0.033-0.031=0.003
min0.762-0.795=-0.033
max0.846-0.864=-0.017
name=cdr_enhanced_4k_loc.art
mean884.712-884.713=-0.001
σ0.008-0.006=0.001
min884.703-884.705=-0.001
max884.722-884.722=-0.000
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.714-0.720=-0.005
σ0.025-0.014=0.011
min0.683-0.704=-0.021
max0.745-0.738=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean4.272-3.504=0.768
σ0.079-0.086=-0.008
min4.140-3.368=0.772
max4.525-3.850=0.675
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean4.259-3.660=0.599
σ0.085-0.332=-0.247
min4.108-3.364=0.743
max4.573-4.666=-0.092
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.740-0.739=0.001
σ0.022-0.029=-0.008
min0.708-0.587=0.121
max0.871-0.880=-0.009
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.707-0.696=0.011
σ0.015-0.029=-0.014
min0.678-0.516=0.162
max0.777-0.785=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.314-296.284=0.031
σ0.239-0.257=-0.018
min296.131-296.071=0.060
max296.931-296.967=-0.036
mean1916.000-1905.000=11.000
σ0.000
min1916.000-1905.000=11.000
max1916.000-1905.000=11.000
mean0.581-0.564=0.017
σ0.042-0.043=-0.002
min0.524-0.502=0.023
max0.684-0.610=0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.698-284.676=0.022
σ0.029-0.040=-0.010
min284.665-284.639=0.026
max284.733-284.735=-0.002
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.397-0.404=-0.008
σ0.010-0.002=0.008
min0.386-0.402=-0.016
max0.407-0.408=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.075=0.000
σ0.107-0.102=0.005
min1294.962-1294.961=0.001
max1295.206-1295.198=0.008
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean1.917-1.926=-0.008
σ0.097-0.094=0.003
min1.817-1.818=-0.002
max2.050-2.034=0.016
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.187=-0.001
σ6.869-6.857=0.012
min1535.935-1535.917=0.018
max1551.469-1551.450=0.019
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean2.261-2.267=-0.006
σ0.252-0.261=-0.009
min2.016-2.060=-0.044
max2.554-2.683=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.991=-0.003
σ0.054-0.054=0.000
min1856.931-1856.938=-0.008
max1857.063-1857.068=-0.005
mean1773.200-1775.800=-2.600
σ138.700-128.280=10.420
min1633.000-1646.000=-13.000
max1916.000-1905.000=11.000
mean3.088-3.003=0.084
σ0.296-0.301=-0.005
min2.872-2.683=0.189
max3.599-3.486=0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.158=0.068
σ0.343-0.304=0.039
min0.932-0.925=0.007
max1.807-1.644=0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.784=0.002
σ581.211-581.213=-0.002
min157.178-157.174=0.005
max1319.602-1319.603=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean0.557-0.542=0.015
σ0.594-0.564=0.030
min0.260-0.259=0.001
max1.448-1.388=0.061
policies=20
mean1572.101-1572.086=0.015
σ0.349-0.355=-0.006
min1571.863-1571.850=0.013
max1572.620-1572.614=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean2.617-2.624=-0.007
σ0.020-0.013=0.007
min2.589-2.606=-0.017
max2.632-2.634=-0.002
policies=200
mean15729.012-15729.025=-0.014
σ0.053-0.074=-0.022
min15728.933-15728.930=0.003
max15729.047-15729.106=-0.059
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1646.000=-13.000
σ0.000
min1633.000-1646.000=-13.000
max1633.000-1646.000=-13.000
mean26.488-26.612=-0.124
σ0.111-0.176=-0.065
min26.373-26.474=-0.101
max26.637-26.855=-0.218