Compare commits

Home / Compare 61512480 .. 4608e30a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.058-54.053=0.004
σ0.369-0.369=-0.000
min53.918-53.914=0.003
max55.107-55.103=0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.137=0.002
σ0.006-0.005=0.001
min0.132-0.131=0.001
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.396-43.393=0.003
σ0.006-0.005=0.001
min43.387-43.385=0.002
max43.405-43.401=0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.000
min0.116-0.114=0.002
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.927-1007.003=-0.076
σ0.924-1.241=-0.317
min1006.458-1006.463=-0.006
max1010.763-1012.213=-1.450
mean1049.750-1054.650=-4.900
σ307.869-304.799=3.071
min575.000-593.000=-18.000
max1642.000-1454.000=188.000
mean1.562-1.583=-0.021
σ0.122-0.129=-0.007
min1.467-1.490=-0.023
max2.017-2.033=-0.015

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.380-0.434=-0.054
σ0.082-0.155=-0.072
min0.332-0.343=-0.011
max0.525-0.706=-0.181
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.001
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.899-0.933=-0.033
σ0.117-0.108=0.009
min0.798-0.824=-0.026
max1.095-1.089=0.005
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.001
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.531-0.534=-0.003
σ0.053-0.043=0.010
min0.490-0.500=-0.010
max0.624-0.608=0.016
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.835-0.851=-0.016
σ0.043-0.036=0.008
min0.809-0.826=-0.017
max0.912-0.912=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.822=0.017
σ0.034-0.024=0.010
min964.810-964.802=0.008
max964.896-964.860=0.036
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.822-0.797=0.024
σ0.053-0.093=-0.040
min0.728-0.664=0.064
max0.857-0.866=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.005=0.002
min885.506-885.504=0.001
max885.523-885.517=0.006
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.728-0.711=0.016
σ0.008-0.037=-0.029
min0.714-0.654=0.060
max0.735-0.755=-0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean4.214-4.316=-0.101
σ0.075-0.077=-0.002
min4.060-4.170=-0.110
max4.549-4.657=-0.108
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean4.209-4.300=-0.091
σ0.083-0.082=0.001
min4.045-4.128=-0.082
max4.482-4.632=-0.150
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.730-0.750=-0.020
σ0.020-0.019=0.001
min0.697-0.718=-0.020
max0.853-0.864=-0.012
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.694-0.711=-0.017
σ0.031-0.015=0.016
min0.505-0.677=-0.172
max0.878-0.770=0.109

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.537-297.068=-1.530
σ0.216-0.266=-0.050
min295.254-296.829=-1.576
max295.951-297.769=-1.818
mean2025.000-1946.000=79.000
σ0.000
min2025.000-1946.000=79.000
max2025.000-1946.000=79.000
mean0.575-0.584=-0.009
σ0.027-0.034=-0.008
min0.509-0.516=-0.007
max0.599-0.616=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.363-286.816=-1.453
σ0.034-0.042=-0.008
min285.316-286.770=-1.453
max285.398-286.866=-1.469
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.390-0.405=-0.015
σ0.008-0.007=0.001
min0.381-0.397=-0.016
max0.396-0.411=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1295.744-1297.268=-1.524
σ0.110-0.103=0.007
min1295.624-1297.148=-1.524
max1295.871-1297.406=-1.534
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean1.944-2.227=-0.284
σ0.111-0.044=0.067
min1.827-2.189=-0.363
max2.058-2.297=-0.239
iters=5
new-facts=6402
prior-facts=1
mean1539.862-1541.378=-1.516
σ6.859-6.868=-0.009
min1536.612-1538.193=-1.581
max1552.128-1553.662=-1.534
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean2.203-2.248=-0.045
σ0.196-0.210=-0.015
min2.029-2.072=-0.043
max2.476-2.588=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean1857.650-1859.124=-1.474
σ0.068-0.068=0.001
min1857.562-1859.034=-1.472
max1857.726-1859.201=-1.475
mean1783.000-1745.600=37.400
σ165.449-213.463=-48.013
min1642.000-1454.000=188.000
max2025.000-1946.000=79.000
mean3.038-2.922=0.116
σ0.210-0.164=0.047
min2.835-2.678=0.157
max3.313-3.126=0.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.179-1.702=-0.523
σ0.254-0.183=0.071
min0.937-1.411=-0.474
max1.586-1.880=-0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.637-448.968=-3.331
σ580.933-581.665=-0.731
min155.169-158.134=-2.966
max1317.037-1321.465=-4.428
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean0.524-0.558=-0.034
σ0.532-0.582=-0.051
min0.257-0.267=-0.010
max1.322-1.432=-0.110
policies=20
mean1551.947-1581.626=-29.679
σ0.327-0.357=-0.030
min1551.727-1581.386=-29.659
max1552.432-1582.157=-29.724
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean2.591-2.632=-0.042
σ0.021-0.012=0.009
min2.565-2.616=-0.050
max2.616-2.644=-0.027
policies=200
mean15527.599-15824.134=-296.535
σ0.093-0.181=-0.087
min15527.460-15824.013=-296.553
max15527.658-15824.401=-296.743
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1454.000=188.000
σ0.000
min1642.000-1454.000=188.000
max1642.000-1454.000=188.000
mean26.164-26.621=-0.458
σ0.104-0.088=0.016
min26.099-26.554=-0.455
max26.317-26.751=-0.434