Compare commits

Home / Compare 3efdbabb .. 491da21b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.001
σ0.370-0.369=0.001
min53.814-53.822=-0.007
max55.015-55.014=0.002
mean417.100-417.000=0.100
σ0.316-0.000=0.316
min417.000
max418.000-417.000=1.000
mean0.138-0.138=-0.001
σ0.006-0.005=0.001
min0.130-0.129=0.001
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.324-43.323=0.001
σ0.006-0.008=-0.002
min43.313-43.310=0.003
max43.334-43.338=-0.004
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.122-0.122=-0.001
σ0.004-0.004=0.000
min0.115-0.119=-0.003
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.518-1006.520=-0.002
σ1.152-1.144=0.008
min1005.945-1005.944=0.001
max1011.334-1011.295=0.040
mean1055.400-1057.350=-1.950
σ316.129-315.872=0.258
min568.000-570.000=-2.000
max1619.000-1622.000=-3.000
mean1.507-1.525=-0.018
σ0.052-0.043=0.009
min1.431-1.472=-0.041
max1.641-1.635=0.006

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887-0.887=0.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.443-0.434=0.010
σ0.134-0.176=-0.042
min0.350-0.332=0.018
max0.672-0.745=-0.074
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.881-0.928=-0.046
σ0.103-0.165=-0.063
min0.814-0.835=-0.021
max1.062-1.222=-0.161
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.522-0.543=-0.021
σ0.053-0.048=0.005
min0.486-0.508=-0.022
max0.616-0.625=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.843-0.850=-0.006
σ0.036-0.037=-0.002
min0.818-0.824=-0.006
max0.903-0.915=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.840=-0.002
σ0.036-0.035=0.001
min964.811-964.809=0.002
max964.899-964.898=0.002
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.835-0.831=0.004
σ0.033-0.022=0.012
min0.791-0.807=-0.015
max0.867-0.853=0.014
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=-0.000
σ0.005-0.006=-0.001
min885.504
max885.516-885.518=-0.002
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.713-0.716=-0.003
σ0.032-0.033=-0.001
min0.678-0.678=-0.001
max0.743-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.002
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean3.498-4.228=-0.730
σ0.141-0.091=0.051
min2.832-4.074=-1.242
max3.983-4.520=-0.537
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean3.515-4.211=-0.696
σ0.085-0.071=0.014
min3.369-4.053=-0.685
max3.751-4.394=-0.642
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.746-0.756=-0.010
σ0.017-0.020=-0.003
min0.720-0.721=-0.001
max0.837-0.868=-0.031
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.708-0.711=-0.003
σ0.021-0.017=0.005
min0.666-0.682=-0.016
max0.842-0.798=0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.283-296.546=-0.263
σ0.226-0.249=-0.022
min296.119-296.296=-0.176
max296.909-297.205=-0.296
mean1909.000-1911.000=-2.000
σ0.000
min1909.000-1911.000=-2.000
max1909.000-1911.000=-2.000
mean0.588-0.579=0.009
σ0.042-0.051=-0.009
min0.527-0.505=0.022
max0.686-0.689=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.033-285.026=0.008
σ0.038-0.037=0.001
min284.981-284.977=0.004
max285.071-285.062=0.009
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.396-0.393=0.003
σ0.009-0.007=0.001
min0.387-0.385=0.001
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.413=-0.002
σ0.108-0.110=-0.002
min1295.287-1295.297=-0.010
max1295.539-1295.546=-0.007
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean1.887-1.904=-0.017
σ0.085-0.096=-0.011
min1.799-1.805=-0.006
max1.998-2.026=-0.028
iters=5
new-facts=6402
prior-facts=1
mean1539.601-1539.517=0.084
σ6.818-6.846=-0.029
min1536.335-1536.217=0.117
max1551.793-1551.759=0.033
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean2.456-2.331=0.124
σ0.262-0.257=0.004
min2.022-2.036=-0.014
max2.654-2.623=0.031
iters=5
new-facts=6402
prior-facts=6402
mean1857.324-1857.313=0.011
σ0.057-0.065=-0.008
min1857.264-1857.233=0.031
max1857.406-1857.401=0.005
mean1771.000-1778.400=-7.400
σ137.069-136.992=0.077
min1619.000-1622.000=-3.000
max1909.000-1911.000=-2.000
mean3.113-3.041=0.072
σ0.368-0.180=0.188
min2.845-2.880=-0.034
max3.758-3.341=0.417

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.280-1.231=0.049
σ0.341-0.354=-0.012
min0.933-0.931=0.002
max1.817-1.827=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.193-448.196=-0.003
σ581.341-581.341=0.000
min157.521-157.524=-0.003
max1320.205-1320.207=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.559-0.554=0.005
σ0.595-0.586=0.009
min0.260-0.260=0.000
max1.452-1.433=0.019
policies=20
mean1575.558-1575.572=-0.013
σ0.365-0.356=0.008
min1575.308-1575.333=-0.024
max1576.100-1576.101=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean2.638-2.642=-0.004
σ0.006-0.039=-0.033
min2.632-2.612=0.021
max2.646-2.696=-0.050
policies=200
mean15763.560-15763.622=-0.062
σ0.082-0.272=-0.190
min15763.461-15763.236=0.226
max15763.647-15763.872=-0.226
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean26.726-26.577=0.149
σ0.095-0.091=0.004
min26.637-26.461=0.175
max26.849-26.678=0.171