Compare commits

Home / Compare 7d75ff82 .. 8c2521bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.058-54.054=0.004
σ0.370-0.370=-0.000
min53.924-53.909=0.015
max55.110-55.108=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.141-0.140=0.001
σ0.003-0.005=-0.002
min0.138-0.132=0.006
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.002
σ0.006-0.007=-0.001
min43.386-43.384=0.002
max43.407-43.407=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.124-0.121=0.003
σ0.004-0.004=-0.001
min0.120-0.115=0.005
max0.130-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.918-1007.005=-0.087
σ0.894-1.200=-0.306
min1006.455-1006.443=0.012
max1010.634-1012.039=-1.405
mean1052.100-1050.200=1.900
σ317.602-309.011=8.591
min549.000-574.000=-25.000
max1652.000-1647.000=5.000
mean1.538-1.557=-0.018
σ0.082-0.080=0.001
min1.456-1.481=-0.025
max1.770-1.777=-0.007

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.411-0.419=-0.008
σ0.129-0.137=-0.009
min0.327-0.332=-0.006
max0.637-0.661=-0.024
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.879-0.865=0.014
σ0.096-0.099=-0.002
min0.817-0.802=0.015
max1.049-1.039=0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.538-0.522=0.016
σ0.057-0.050=0.008
min0.497-0.486=0.011
max0.639-0.607=0.032
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.843-0.838=0.005
σ0.046-0.040=0.007
min0.811-0.795=0.016
max0.925-0.901=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.000
σ0.035-0.035=0.000
min964.810-964.811=-0.001
max964.897-964.897=-0.000
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.855-0.842=0.014
σ0.006-0.031=-0.025
min0.848-0.788=0.060
max0.864-0.865=-0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=-0.000
min885.504
max885.521-885.523=-0.002
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.733-0.726=0.008
σ0.006-0.030=-0.023
min0.725-0.675=0.050
max0.742-0.753=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.720=0.003
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean4.200-4.208=-0.008
σ0.115-0.090=0.026
min4.058-4.046=0.011
max5.051-4.575=0.476
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean4.212-4.215=-0.003
σ0.080-0.092=-0.013
min4.075-4.030=0.045
max4.480-4.599=-0.119
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.740-0.739=0.001
σ0.016-0.018=-0.001
min0.706-0.700=0.006
max0.838-0.848=-0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.709-0.694=0.015
σ0.019-0.016=0.003
min0.660-0.665=-0.004
max0.792-0.785=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.429-296.833=-1.404
σ0.218-0.221=-0.003
min295.247-296.701=-1.454
max296.029-297.428=-1.399
mean1896.000-1902.000=-6.000
σ0.000
min1896.000-1902.000=-6.000
max1896.000-1902.000=-6.000
mean0.586-0.587=-0.001
σ0.022-0.054=-0.032
min0.543-0.509=0.034
max0.620-0.702=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.367-286.820=-1.453
σ0.036-0.037=-0.000
min285.318-286.770=-1.452
max285.402-286.857=-1.455
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.391-0.393=-0.002
σ0.008-0.006=0.002
min0.382-0.386=-0.005
max0.403-0.400=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.743-1297.271=-1.528
σ0.108-0.091=0.018
min1295.627-1297.158=-1.531
max1295.880-1297.397=-1.517
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean1.898-2.269=-0.371
σ0.070-0.159=-0.089
min1.817-2.139=-0.322
max1.965-2.544=-0.579
iters=5
new-facts=6402
prior-facts=1
mean1539.848-1541.344=-1.496
σ6.822-6.841=-0.019
min1536.599-1538.091=-1.492
max1552.048-1553.578=-1.530
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean2.236-2.242=-0.006
σ0.198-0.170=0.028
min2.034-2.130=-0.096
max2.464-2.544=-0.080
iters=5
new-facts=6402
prior-facts=6402
mean1857.643-1859.119=-1.476
σ0.067-0.066=0.001
min1857.557-1859.030=-1.473
max1857.737-1859.196=-1.459
mean1780.600-1777.400=3.200
σ119.624-125.801=-6.177
min1652.000-1647.000=5.000
max1896.000-1902.000=-6.000
mean2.985-3.123=-0.139
σ0.116-0.285=-0.170
min2.851-2.833=0.017
max3.125-3.550=-0.425

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.210-1.194=0.016
σ0.329-0.318=0.010
min0.931-0.930=0.001
max1.736-1.612=0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.487-448.822=-3.334
σ580.641-581.372=-0.731
min155.162-158.134=-2.972
max1316.448-1320.879=-4.431
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean0.506-0.562=-0.057
σ0.495-0.598=-0.103
min0.254-0.261=-0.007
max1.248-1.459=-0.211
policies=20
mean1551.928-1581.629=-29.701
σ0.336-0.360=-0.023
min1551.701-1581.386=-29.685
max1552.428-1582.163=-29.736
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean2.593-2.638=-0.045
σ0.008-0.014=-0.006
min2.586-2.630=-0.044
max2.603-2.659=-0.056
policies=200
mean15527.515-15824.126=-296.611
σ0.115-0.166=-0.051
min15527.347-15824.024=-296.677
max15527.591-15824.373=-296.782
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1647.000=5.000
σ0.000
min1652.000-1647.000=5.000
max1652.000-1647.000=5.000
mean26.105-26.630=-0.525
σ0.113-0.038=0.075
min26.030-26.603=-0.574
max26.270-26.686=-0.417