Compare commits

Home / Compare cabc27ee .. 15fc6290

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-54.015=-0.050
σ0.369-0.368=0.000
min53.819-53.880=-0.061
max55.014-55.063=-0.050
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.137-0.140=-0.003
σ0.004-0.005=-0.001
min0.131-0.131=0.001
max0.142-0.147=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.001
σ0.008-0.007=0.001
min43.309-43.313=-0.004
max43.332-43.335=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.122=-0.000
σ0.004-0.004=-0.000
min0.116-0.116=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.309=0.205
σ1.174-1.167=0.007
min1005.978-1005.742=0.236
max1011.434-1011.194=0.240
mean1053.950-1056.200=-2.250
σ321.218-318.261=2.957
min596.000-566.000=30.000
max1634.000
mean1.564-1.536=0.028
σ0.123-0.077=0.046
min1.458-1.455=0.003
max2.030-1.785=0.244

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.866=0.018
σ0.002-0.003=-0.000
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.421-0.425=-0.004
σ0.140-0.153=-0.014
min0.341-0.340=0.001
max0.668-0.698=-0.029
name=error_case.art
mean2.339-2.337=0.002
σ0.004-0.003=0.001
min2.337-2.336=0.001
max2.345-2.341=0.004
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.895-0.920=-0.025
σ0.094-0.153=-0.059
min0.828-0.834=-0.006
max1.056-1.192=-0.136
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.537-0.559=-0.023
σ0.065-0.058=0.006
min0.485-0.515=-0.030
max0.640-0.661=-0.020
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.852-0.864=-0.012
σ0.036-0.040=-0.004
min0.823-0.832=-0.010
max0.913-0.934=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.114=0.724
σ0.021-0.020=0.001
min964.819-964.099=0.719
max964.870-964.148=0.723
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.822-0.815=0.007
σ0.037-0.041=-0.004
min0.772-0.755=0.018
max0.857-0.851=0.006
name=cdr_enhanced_4k_loc.art
mean885.511-884.710=0.801
σ0.004-0.007=-0.003
min885.505-884.705=0.801
max885.515-884.722=0.793
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.689-0.701=-0.012
σ0.076-0.054=0.022
min0.565-0.616=-0.052
max0.741-0.740=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.719-7.718=0.002
mean1634.000
σ0.000
min1634.000
max1634.000
mean3.483-4.251=-0.767
σ0.083-0.074=0.009
min3.314-4.130=-0.816
max3.851-4.673=-0.821
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668
mean1634.000
σ0.000
min1634.000
max1634.000
mean3.479-4.222=-0.742
σ0.073-0.057=0.016
min3.343-4.086=-0.744
max3.684-4.384=-0.700
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002-0.002=0.000
min2.290-2.289=0.001
max2.295-2.292=0.003
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.746-0.737=0.009
σ0.022-0.020=0.002
min0.711-0.703=0.008
max0.844-0.863=-0.019
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.702-0.695=0.007
σ0.016-0.015=0.001
min0.666-0.668=-0.002
max0.776-0.775=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.502-296.336=0.166
σ0.151-0.156=-0.005
min296.356-296.163=0.193
max296.881-296.728=0.152
mean1891.000-1914.000=-23.000
σ0.000
min1891.000-1914.000=-23.000
max1891.000-1914.000=-23.000
mean0.587-0.571=0.015
σ0.037-0.061=-0.024
min0.512-0.498=0.014
max0.649-0.697=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.025-284.697=0.328
σ0.042-0.039=0.003
min284.984-284.644=0.340
max285.070-284.736=0.333
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.406-0.406=0.000
σ0.016-0.006=0.010
min0.386-0.401=-0.015
max0.424-0.415=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.418-1295.079=0.338
σ0.111-0.106=0.005
min1295.300-1294.958=0.341
max1295.555-1295.206=0.349
mean1634.000
σ0.000
min1634.000
max1634.000
mean1.916-1.906=0.010
σ0.104-0.087=0.017
min1.795-1.821=-0.027
max2.009-2.034=-0.025
iters=5
new-facts=6402
prior-facts=1
mean1538.335-1537.931=0.404
σ4.008-4.050=-0.042
min1536.376-1535.914=0.462
max1545.498-1545.169=0.329
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.396-2.278=0.119
σ0.285-0.272=0.012
min2.132-2.036=0.095
max2.815-2.673=0.142
iters=5
new-facts=6402
prior-facts=6402
mean1857.329-1856.986=0.344
σ0.064-0.055=0.010
min1857.264-1856.929=0.335
max1857.416-1857.068=0.348
mean1773.800-1770.800=3.000
σ122.019-138.518=-16.499
min1634.000
max1891.000-1914.000=-23.000
mean2.902-3.041=-0.139
σ0.099-0.302=-0.202
min2.775-2.793=-0.018
max3.040-3.559=-0.519

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.151-1.174=-0.023
σ0.210-0.258=-0.048
min0.943-0.928=0.015
max1.476-1.544=-0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.528-446.125=0.403
σ578.007-577.891=0.116
min157.523-157.176=0.347
max1313.538-1312.962=0.577
mean96.250
σ8.500
min92.000
max109.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.565-0.516=0.048
σ0.598-0.510=0.088
min0.261-0.261=-0.000
max1.461-1.281=0.180
policies=20
mean1575.555-1572.103=3.452
σ0.356-0.359=-0.004
min1575.314-1571.860=3.454
max1576.084-1572.638=3.446
mean920.000
σ0.000
min920.000
max920.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.632-2.629=0.003
σ0.016-0.002=0.014
min2.615-2.627=-0.011
max2.655-2.631=0.023
policies=200
mean15763.718-15728.991=34.727
σ0.091-0.117=-0.025
min15763.598-15728.895=34.703
max15763.820-15729.147=34.672
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean26.668-26.696=-0.028
σ0.101-0.303=-0.202
min26.579-26.489=0.089
max26.770-27.133=-0.363