Compare commits

Home / Compare 8e494d8a .. 0399c071

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.965=-0.002
σ0.370-0.370=-0.000
min53.828-53.824=0.003
max55.016-55.018=-0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.138-0.138=0.000
σ0.006-0.004=0.002
min0.130-0.131=-0.002
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.007=-0.000
min43.315-43.310=0.006
max43.336-43.336=0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.122=0.000
σ0.004-0.004=-0.000
min0.118-0.116=0.002
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.512-1006.519=-0.007
σ1.240-1.153=0.087
min1005.980-1005.948=0.032
max1011.707-1011.340=0.367
mean1061.050-1040.750=20.300
σ319.585-311.050=8.535
min548.000-550.000=-2.000
max1519.000-1509.000=10.000
mean1.551-1.514=0.037
σ0.165-0.047=0.118
min1.361-1.442=-0.082
max2.151-1.610=0.541

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.458-0.438=0.020
σ0.141-0.199=-0.058
min0.360-0.325=0.034
max0.705-0.792=-0.087
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.886-0.932=-0.047
σ0.108-0.177=-0.069
min0.807-0.838=-0.032
max1.076-1.248=-0.172
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.525-0.534=-0.008
σ0.044-0.044=-0.001
min0.480-0.492=-0.012
max0.592-0.605=-0.013
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.850-0.845=0.006
σ0.039-0.044=-0.005
min0.823-0.802=0.021
max0.918-0.918=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.830=0.000
σ0.039-0.038=0.001
min964.806-964.802=0.004
max964.898-964.896=0.002
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.795-0.823=-0.028
σ0.089-0.031=0.058
min0.651-0.787=-0.137
max0.863-0.859=0.004
name=cdr_enhanced_4k_loc.art
mean885.510-885.511=-0.000
σ0.008-0.006=0.003
min885.504
max885.523-885.517=0.006
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.706-0.711=-0.005
σ0.045-0.029=0.017
min0.643-0.668=-0.025
max0.743-0.746=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean3.795-3.868=-0.072
σ0.343-0.361=-0.018
min3.392-3.412=-0.020
max4.522-4.474=0.048
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean4.142-4.253=-0.111
σ0.247-0.113=0.134
min3.487-4.086=-0.600
max4.522-4.968=-0.447
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.757-0.675=0.081
σ0.025-0.103=-0.079
min0.711-0.511=0.200
max0.921-0.868=0.053
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.647-0.511=0.136
σ0.091-0.040=0.051
min0.488-0.476=0.011
max0.773-0.762=0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.375-296.308=0.067
σ0.234-0.236=-0.001
min296.248-296.148=0.100
max297.029-296.966=0.063
mean2034.000-2032.000=2.000
σ0.000
min2034.000-2032.000=2.000
max2034.000-2032.000=2.000
mean0.557-0.556=0.002
σ0.029-0.031=-0.003
min0.510-0.514=-0.003
max0.584-0.584=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.028-285.024=0.004
σ0.038-0.035=0.003
min284.978-284.979=-0.001
max285.064-285.061=0.003
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.397-0.398=-0.001
σ0.011-0.006=0.005
min0.387-0.391=-0.004
max0.415-0.407=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.413=-0.002
σ0.105-0.116=-0.011
min1295.300-1295.298=0.002
max1295.539-1295.558=-0.020
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean1.913-1.921=-0.007
σ0.127-0.120=0.007
min1.807-1.806=0.001
max2.072-2.070=0.003
iters=5
new-facts=6402
prior-facts=1
mean1539.513-1539.525=-0.012
σ6.854-6.844=0.010
min1536.231-1536.191=0.040
max1551.769-1551.761=0.008
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean2.242-2.289=-0.047
σ0.209-0.296=-0.087
min1.984-1.898=0.086
max2.475-2.585=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean1857.313-1857.309=0.003
σ0.069-0.062=0.007
min1857.231-1857.253=-0.022
max1857.399-1857.390=0.010
mean1752.600-1738.000=14.600
σ209.139-215.485=-6.346
min1519.000-1509.000=10.000
max2034.000-2032.000=2.000
mean2.968-2.860=0.108
σ0.278-0.095=0.183
min2.753-2.722=0.032
max3.445-2.954=0.491

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.615=-0.064
σ0.280-0.292=-0.012
min1.189-1.257=-0.068
max1.840-1.907=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.192=-0.000
σ581.331-581.331=0.000
min157.524-157.525=-0.001
max1320.188-1320.188=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean0.531-0.552=-0.021
σ0.541-0.558=-0.017
min0.260-0.268=-0.009
max1.342-1.389=-0.046
policies=20
mean1575.567-1575.562=0.006
σ0.348-0.345=0.003
min1575.330-1575.333=-0.003
max1576.084-1576.076=0.008
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean2.619-2.633=-0.015
σ0.014-0.014=0.000
min2.603-2.619=-0.016
max2.636-2.653=-0.017
policies=200
mean15763.703-15763.676=0.027
σ0.028-0.174=-0.146
min15763.665-15763.514=0.152
max15763.730-15763.917=-0.187
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1509.000=10.000
σ0.000
min1519.000-1509.000=10.000
max1519.000-1509.000=10.000
mean26.518-26.546=-0.028
σ0.058-0.020=0.038
min26.460-26.527=-0.067
max26.570-26.572=-0.002