Compare commits

Home / Compare a94e9238 .. 22e99345

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.000
σ0.369-0.369=-0.001
min53.908-53.914=-0.006
max55.103-55.105=-0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.138-0.141=-0.003
σ0.004-0.005=-0.001
min0.132-0.133=-0.001
max0.145-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394
σ0.006-0.005=0.002
min43.386-43.388=-0.003
max43.402-43.402=-0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.000
min0.115-0.119=-0.004
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1007.001=-0.022
σ0.925-1.217=-0.292
min1006.507-1006.462=0.044
max1010.827-1012.110=-1.283
mean1055.650-1038.650=17.000
σ306.148-298.547=7.601
min576.000-581.000=-5.000
max1457.000-1583.000=-126.000
mean1.568-1.586=-0.018
σ0.135-0.122=0.013
min1.469-1.492=-0.023
max2.021-1.857=0.164

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.441-0.418=0.023
σ0.126-0.126=-0.000
min0.352-0.341=0.011
max0.659-0.641=0.019
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.886-0.874=0.012
σ0.097-0.093=0.005
min0.826-0.808=0.017
max1.058-1.035=0.024
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.532-0.540=-0.008
σ0.051-0.048=0.004
min0.482-0.503=-0.020
max0.616-0.621=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.843-0.846=-0.002
σ0.040-0.032=0.009
min0.816-0.811=0.005
max0.911-0.897=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.831=-0.009
σ0.026-0.029=-0.004
min964.802-964.803=-0.001
max964.864-964.878=-0.014
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.829-0.828=0.001
σ0.032-0.037=-0.005
min0.795-0.783=0.012
max0.865-0.856=0.009
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=-0.000
σ0.006-0.006=0.000
min885.504
max885.518-885.519=-0.001
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.736-0.705=0.031
σ0.008-0.027=-0.019
min0.723-0.675=0.048
max0.745-0.742=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean3.535-4.185=-0.650
σ0.084-0.083=0.001
min3.395-4.067=-0.672
max3.894-4.547=-0.653
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean3.523-4.158=-0.635
σ0.064-0.068=-0.004
min3.386-4.027=-0.641
max3.734-4.406=-0.672
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.540-0.734=-0.194
σ0.015-0.019=-0.004
min0.520-0.700=-0.180
max0.638-0.856=-0.217
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.506-0.695=-0.189
σ0.016-0.017=-0.001
min0.475-0.661=-0.186
max0.569-0.798=-0.229

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-296.840=-1.212
σ0.285-0.230=0.056
min295.466-296.672=-1.205
max296.421-297.448=-1.027
mean1905.000-1949.000=-44.000
σ0.000
min1905.000-1949.000=-44.000
max1905.000-1949.000=-44.000
mean0.583-0.586=-0.003
σ0.046-0.038=0.008
min0.500-0.535=-0.035
max0.645-0.671=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-286.822=-1.424
σ0.030-0.039=-0.009
min285.360-286.775=-1.415
max285.431-286.863=-1.432
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.403-0.393=0.010
σ0.005-0.006=-0.001
min0.396-0.389=0.007
max0.410-0.403=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1297.179=-1.414
σ0.069-0.069=-0.000
min1295.676-1297.096=-1.420
max1295.838-1297.275=-1.436
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean1.913-1.904=0.009
σ0.102-0.085=0.017
min1.819-1.815=0.004
max2.048-2.013=0.034
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1541.333=-1.341
σ6.860-6.816=0.044
min1536.776-1538.108=-1.332
max1552.261-1553.522=-1.261
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean2.503-2.193=0.310
σ0.156-0.080=0.076
min2.248-2.120=0.128
max2.645-2.318=0.327
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1859.123=-1.422
σ0.051-0.058=-0.008
min1857.654-1859.060=-1.406
max1857.774-1859.189=-1.414
mean1744.600-1772.600=-28.000
σ171.144-174.965=-3.821
min1505.000-1583.000=-78.000
max1905.000-1949.000=-44.000
mean3.058-2.924=0.134
σ0.264-0.100=0.164
min2.869-2.833=0.036
max3.524-3.067=0.457

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.403=0.357
σ0.129-0.360=-0.231
min1.608-1.068=0.540
max1.917-1.799=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-448.821=-3.080
σ580.934-581.372=-0.438
min155.272-158.133=-2.860
max1317.142-1320.879=-3.737
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean0.542-0.553=-0.011
σ0.558-0.581=-0.023
min0.262-0.260=0.002
max1.378-1.424=-0.046
policies=20
mean1552.986-1581.641=-28.655
σ0.317-0.388=-0.071
min1552.769-1581.381=-28.612
max1553.457-1582.219=-28.762
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean2.572-2.679=-0.108
σ0.017-0.034=-0.017
min2.557-2.655=-0.098
max2.595-2.729=-0.134
policies=200
mean15538.060-15824.248=-286.188
σ0.060-0.093=-0.033
min15538.014-15824.177=-286.162
max15538.147-15824.384=-286.237
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1583.000=-126.000
σ0.000
min1457.000-1583.000=-126.000
max1457.000-1583.000=-126.000
mean26.140-26.651=-0.511
σ0.018-0.080=-0.062
min26.118-26.595=-0.478
max26.161-26.770=-0.609