Compare commits

Home / Compare d1ce7908 .. a5c5c947

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.368-0.369=-0.001
min53.914-53.907=0.006
max55.104-55.104=0.000
mean417.000
σ0.000
min417.000
max417.000
mean0.137-0.139=-0.002
σ0.006-0.004=0.002
min0.130-0.132=-0.002
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.396-43.394=0.002
σ0.006-0.008=-0.002
min43.386-43.381=0.005
max43.406-43.410=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.125-0.123=0.002
σ0.005-0.004=0.001
min0.120-0.119=0.001
max0.135-0.130=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1007.006=-0.045
σ0.867-1.190=-0.323
min1006.462-1006.432=0.030
max1010.547-1011.992=-1.445
mean1048.750-1051.500=-2.750
σ318.009-307.736=10.273
min546.000-577.000=-31.000
max1650.000-1643.000=7.000
mean1.538-1.543=-0.005
σ0.095-0.094=0.001
min1.384-1.454=-0.069
max1.785-1.803=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.424-0.431=-0.007
σ0.142-0.156=-0.013
min0.339-0.342=-0.003
max0.677-0.708=-0.032
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.912-0.938=-0.026
σ0.097-0.204=-0.106
min0.848-0.826=0.021
max1.083-1.302=-0.218
name=heavy_item.art
mean1.524-1.524=-0.001
σ0.002-0.003=-0.001
min1.522
max1.526-1.528=-0.001
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.540-0.542=-0.002
σ0.050-0.048=0.002
min0.512-0.503=0.010
max0.630-0.620=0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.863-0.856=0.007
σ0.036-0.040=-0.004
min0.838-0.819=0.019
max0.925-0.924=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.034-0.019=0.015
min964.810-964.822=-0.012
max964.894-964.870=0.025
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.807-0.850=-0.043
σ0.051-0.015=0.036
min0.739-0.827=-0.088
max0.854-0.866=-0.012
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.000
min885.505-885.504=0.001
max885.522-885.521=0.002
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.690-0.700=-0.010
σ0.045-0.059=-0.014
min0.635-0.622=0.013
max0.735-0.746=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean4.238-4.232=0.006
σ0.099-0.088=0.010
min3.803-4.087=-0.284
max4.552-4.660=-0.107
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean4.220-4.222=-0.001
σ0.063-0.071=-0.008
min4.117-4.096=0.021
max4.468-4.503=-0.035
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.751-0.749=0.001
σ0.018-0.017=0.001
min0.723-0.717=0.005
max0.868-0.840=0.027
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.712-0.708=0.003
σ0.015-0.014=0.001
min0.686-0.681=0.005
max0.786-0.774=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.492-296.944=-1.453
σ0.264-0.191=0.073
min295.244-296.796=-1.551
max296.175-297.457=-1.281
mean2018.000-1924.000=94.000
σ0.000
min2018.000-1924.000=94.000
max2018.000-1924.000=94.000
mean0.550-0.563=-0.013
σ0.041-0.046=-0.006
min0.502-0.501=0.001
max0.598-0.627=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.390-286.825=-1.435
σ0.034-0.041=-0.007
min285.342-286.772=-1.430
max285.424-286.877=-1.453
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.391-0.398=-0.007
σ0.005-0.015=-0.009
min0.383-0.387=-0.004
max0.396-0.423=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1295.759-1297.256=-1.497
σ0.086-0.061=0.025
min1295.656-1297.184=-1.529
max1295.870-1297.310=-1.440
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean1.847-2.122=-0.276
σ0.056-0.121=-0.065
min1.799-1.993=-0.193
max1.921-2.304=-0.382
iters=5
new-facts=6402
prior-facts=1
mean1539.896-1541.303=-1.407
σ6.858-6.870=-0.012
min1536.598-1538.022=-1.424
max1552.158-1553.588=-1.430
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.289-2.227=0.062
σ0.182-0.210=-0.028
min2.135-1.999=0.136
max2.589-2.566=0.023
iters=5
new-facts=6402
prior-facts=6402
mean1857.688-1859.109=-1.421
σ0.067-0.081=-0.013
min1857.610-1858.986=-1.376
max1857.775-1859.183=-1.408
mean1767.200-1783.800=-16.600
σ156.516-140.002=16.513
min1650.000-1643.000=7.000
max2018.000-1924.000=94.000
mean2.913-3.188=-0.275
σ0.063-0.265=-0.202
min2.838-2.867=-0.029
max2.977-3.539=-0.563

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.143=0.080
σ0.328-0.221=0.107
min0.946-0.909=0.037
max1.776-1.472=0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.708-448.822=-3.115
σ580.934-581.372=-0.438
min155.239-158.135=-2.896
max1317.108-1320.880=-3.772
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.551-0.571=-0.020
σ0.576-0.600=-0.024
min0.259-0.255=0.004
max1.416-1.472=-0.056
policies=20
mean1552.659-1581.628=-28.970
σ0.327-0.359=-0.032
min1552.431-1581.384=-28.953
max1553.144-1582.161=-29.018
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.591-2.646=-0.055
σ0.001-0.042=-0.041
min2.590-2.606=-0.016
max2.592-2.704=-0.112
policies=200
mean15534.652-15824.240=-289.588
σ0.196-0.092=0.104
min15534.529-15824.160=-289.632
max15534.944-15824.371=-289.427
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean26.245-26.582=-0.337
σ0.114-0.049=0.065
min26.144-26.514=-0.370
max26.384-26.629=-0.245