Compare commits

Home / Compare 29ba7fcf .. 98bf656a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-54.016=-0.050
σ0.369-0.369=0.000
min53.821-53.871=-0.050
max55.015-55.065=-0.050
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.148-0.140=0.007
σ0.011-0.005=0.006
min0.138-0.135=0.002
max0.168-0.150=0.017
cache=y
dps=1
iters=10
policies=100
mean43.324-43.321=0.002
σ0.007-0.006=0.001
min43.315-43.312=0.003
max43.338-43.334=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.125-0.120=0.005
σ0.004-0.004=0.000
min0.121-0.115=0.006
max0.132-0.128=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.308=0.213
σ1.174-1.178=-0.004
min1005.967-1005.736=0.231
max1011.438-1011.239=0.198
mean1043.650-1047.050=-3.400
σ310.007-310.052=-0.046
min571.000-550.000=21.000
max1631.000-1511.000=120.000
mean1.567-1.526=0.042
σ0.071-0.065=0.007
min1.494-1.455=0.039
max1.802-1.711=0.091

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.411-0.400=0.011
σ0.126-0.136=-0.010
min0.341-0.322=0.019
max0.635-0.641=-0.006
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.883-0.892=-0.009
σ0.085-0.085=-0.000
min0.832-0.829=0.003
max1.033-1.041=-0.007
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.533-0.550=-0.017
σ0.051-0.050=0.001
min0.496-0.513=-0.018
max0.622-0.633=-0.011
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.835-0.854=-0.019
σ0.050-0.038=0.012
min0.798-0.817=-0.019
max0.921-0.919=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.102=0.736
σ0.034-0.036=-0.002
min964.809-964.077=0.731
max964.894-964.164=0.730
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.844-0.835=0.009
σ0.018-0.032=-0.015
min0.819-0.777=0.042
max0.860-0.854=0.007
name=cdr_enhanced_4k_loc.art
mean885.512-884.709=0.802
σ0.006-0.005=0.001
min885.504-884.703=0.801
max885.521-884.716=0.805
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.699-0.711=-0.012
σ0.034-0.029=0.005
min0.669-0.665=0.004
max0.739-0.738=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.721-7.720=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean4.226-4.174=0.052
σ0.105-0.079=0.026
min4.047-4.045=0.002
max4.711-4.424=0.287
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean4.179-4.197=-0.019
σ0.079-0.080=-0.002
min4.046-4.081=-0.035
max4.469-4.437=0.032
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.734-0.735=-0.001
σ0.017-0.018=-0.002
min0.708-0.701=0.007
max0.844-0.860=-0.016
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.586-0.695=-0.109
σ0.095-0.033=0.062
min0.479-0.498=-0.020
max0.757-0.776=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.450-296.311=0.139
σ0.237-0.215=0.023
min296.227-296.105=0.122
max297.064-296.882=0.181
mean2024.000-1912.000=112.000
σ0.000
min2024.000-1912.000=112.000
max2024.000-1912.000=112.000
mean0.551-0.584=-0.034
σ0.038-0.044=-0.006
min0.508-0.518=-0.010
max0.603-0.676=-0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.029-284.697=0.333
σ0.036-0.035=0.001
min284.984-284.654=0.331
max285.069-284.737=0.332
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.395-0.396=-0.002
σ0.008-0.009=-0.001
min0.386-0.385=0.001
max0.403-0.403=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.429-1295.078=0.351
σ0.062-0.110=-0.048
min1295.363-1294.963=0.400
max1295.493-1295.214=0.279
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean2.035-1.916=0.120
σ0.047-0.100=-0.054
min1.998-1.806=0.192
max2.108-2.004=0.104
iters=5
new-facts=6402
prior-facts=1
mean1539.555-1539.188=0.367
σ6.813-6.842=-0.029
min1536.323-1535.915=0.408
max1551.740-1551.424=0.316
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean2.321-2.262=0.059
σ0.181-0.253=-0.072
min2.108-2.027=0.082
max2.513-2.655=-0.142
iters=5
new-facts=6402
prior-facts=6402
mean1857.319-1856.977=0.342
σ0.079-0.072=0.007
min1857.197-1856.889=0.308
max1857.400-1857.068=0.331
mean1769.800-1745.400=24.400
σ172.545-173.304=-0.759
min1631.000-1511.000=120.000
max2024.000-1912.000=112.000
mean2.955-2.973=-0.018
σ0.071-0.140=-0.069
min2.855-2.854=0.001
max3.046-3.203=-0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.239-1.652=-0.413
σ0.358-0.205=0.153
min0.944-1.342=-0.398
max1.849-1.849=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.196-447.785=0.411
σ581.340-581.212=0.128
min157.524-157.177=0.347
max1320.206-1319.603=0.603
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean0.562-0.548=0.014
σ0.597-0.562=0.035
min0.262-0.263=-0.001
max1.458-1.392=0.066
policies=20
mean1575.582-1572.088=3.493
σ0.372-0.355=0.017
min1575.333-1571.851=3.483
max1576.135-1572.616=3.519
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean2.657-2.627=0.030
σ0.008-0.008=-0.000
min2.647-2.620=0.026
max2.665-2.639=0.026
policies=200
mean15763.743-15729.058=34.684
σ0.062-0.132=-0.070
min15763.698-15728.943=34.755
max15763.835-15729.242=34.592
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1511.000=120.000
σ0.000
min1631.000-1511.000=120.000
max1631.000-1511.000=120.000
mean26.756-26.479=0.276
σ0.064-0.055=0.009
min26.702-26.431=0.271
max26.839-26.532=0.307