Compare commits

Home / Compare f1f5793c .. 7d3465f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.369=0.001
min53.869-53.870=-0.000
max55.069-55.065=0.005
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.140-0.140=0.000
σ0.004-0.004=0.001
min0.136-0.137=-0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.008=-0.001
min43.308-43.309=-0.001
max43.333-43.338=-0.005
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.120-0.123=-0.003
σ0.001-0.004=-0.003
min0.118-0.119=-0.001
max0.122-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.306=0.006
σ1.159-1.182=-0.023
min1005.742-1005.767=-0.025
max1011.161-1011.260=-0.099
mean1045.350-1043.700=1.650
σ313.737-311.595=2.142
min595.000-596.000=-1.000
max1642.000-1631.000=11.000
mean1.537-1.575=-0.038
σ0.078-0.088=-0.010
min1.448-1.498=-0.050
max1.758-1.834=-0.076

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.391-0.406=-0.015
σ0.109-0.114=-0.006
min0.321-0.347=-0.026
max0.583-0.610=-0.027
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.882-0.889=-0.006
σ0.094-0.096=-0.003
min0.816-0.828=-0.012
max1.045-1.056=-0.011
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.540-0.550=-0.010
σ0.054-0.054=-0.000
min0.490-0.502=-0.012
max0.632-0.643=-0.011
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.834-0.850=-0.016
σ0.030-0.037=-0.007
min0.809-0.818=-0.010
max0.881-0.911=-0.030

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.034-0.034=-0.000
min964.086-964.086=-0.000
max964.171-964.172=-0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.839-0.809=0.031
σ0.032-0.066=-0.033
min0.789-0.736=0.054
max0.871-0.860=0.012
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.008-0.007=0.000
min884.703-884.705=-0.001
max884.723-884.722=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.721-0.706=0.015
σ0.011-0.044=-0.033
min0.708-0.648=0.059
max0.738-0.741=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean4.254-4.216=0.038
σ0.077-0.068=0.008
min4.124-4.105=0.019
max4.478-4.452=0.026
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.670=-0.004
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean4.238-4.204=0.035
σ0.153-0.064=0.089
min4.077-4.051=0.026
max5.452-4.375=1.077
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.758-0.677=0.081
σ0.041-0.098=-0.058
min0.542-0.514=0.028
max0.868-0.864=0.004
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.715-0.501=0.214
σ0.032-0.012=0.020
min0.654-0.476=0.177
max0.815-0.563=0.252

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.263-296.464=-0.201
σ0.253-0.220=0.033
min296.085-296.324=-0.239
max296.961-297.048=-0.087
mean1915.000-1916.000=-1.000
σ0.000
min1915.000-1916.000=-1.000
max1915.000-1916.000=-1.000
mean0.572-0.576=-0.003
σ0.038-0.039=-0.001
min0.516-0.517=-0.001
max0.630-0.659=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.697=-0.001
σ0.033-0.035=-0.003
min284.661-284.652=0.009
max284.737-284.738=-0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.402-0.398=0.004
σ0.017-0.010=0.007
min0.386-0.385=0.001
max0.428-0.407=0.020
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.081=-0.004
σ0.106-0.110=-0.003
min1294.953-1294.961=-0.008
max1295.203-1295.211=-0.008
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean1.943-1.931=0.011
σ0.124-0.096=0.028
min1.805-1.829=-0.024
max2.134-2.023=0.111
iters=5
new-facts=6402
prior-facts=1
mean1539.230-1539.191=0.039
σ6.844-6.855=-0.011
min1535.929-1535.925=0.004
max1551.467-1551.450=0.016
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean2.367-2.260=0.107
σ0.231-0.268=-0.038
min2.058-2.028=0.030
max2.687-2.658=0.028
iters=5
new-facts=6402
prior-facts=6402
mean1856.979-1856.987=-0.007
σ0.060-0.053=0.007
min1856.923-1856.930=-0.007
max1857.064-1857.061=0.003
mean1772.600-1771.400=1.200
σ137.136-140.030=-2.894
min1642.000-1631.000=11.000
max1915.000-1916.000=-1.000
mean3.068-3.101=-0.033
σ0.263-0.316=-0.053
min2.861-2.883=-0.022
max3.525-3.657=-0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.213=-0.023
σ0.360-0.273=0.087
min0.924-0.954=-0.030
max1.788-1.652=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.001
σ581.212-581.213=-0.000
min157.178-157.176=0.002
max1319.605
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.534-0.532=0.002
σ0.546-0.538=0.008
min0.257-0.261=-0.004
max1.353-1.339=0.014
policies=20
mean1572.102-1572.102=0.000
σ0.352-0.353=-0.000
min1571.864-1571.868=-0.004
max1572.626-1572.626=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean2.619-2.629=-0.010
σ0.022-0.018=0.004
min2.591-2.607=-0.016
max2.646-2.645=0.001
policies=200
mean15729.050-15729.078=-0.027
σ0.053-0.107=-0.054
min15728.977-15728.998=-0.021
max15729.103-15729.233=-0.130
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean26.511-26.545=-0.034
σ0.048-0.033=0.016
min26.477-26.513=-0.036
max26.582-26.581=0.001