Compare commits

Home / Compare eaeaefe5 .. 86f50d8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.963=0.091
σ0.368-0.370=-0.002
min53.910-53.818=0.092
max55.101-55.015=0.086
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.141-0.135=0.006
σ0.004-0.005=-0.001
min0.135-0.129=0.006
max0.148-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.005=0.001
min43.385-43.316=0.070
max43.402-43.334=0.068
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.122-0.122=0.000
σ0.004-0.003=0.001
min0.116-0.118=-0.002
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.515=0.491
σ1.199-1.175=0.024
min1006.439-1005.952=0.487
max1012.035-1011.432=0.603
mean1055.300-1049.400=5.900
σ309.411-312.677=-3.266
min579.000-550.000=29.000
max1653.000-1514.000=139.000
mean1.534-1.532=0.001
σ0.081-0.077=0.004
min1.452-1.414=0.038
max1.771-1.777=-0.006

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.416-0.428=-0.012
σ0.125-0.177=-0.052
min0.342-0.335=0.008
max0.636-0.743=-0.107
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.877-0.902=-0.025
σ0.092-0.150=-0.058
min0.820-0.818=0.002
max1.035-1.169=-0.134
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.540-0.531=0.008
σ0.049-0.055=-0.006
min0.504-0.496=0.008
max0.620-0.627=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.836-0.838=-0.002
σ0.047-0.035=0.012
min0.796-0.812=-0.015
max0.910-0.896=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.832=0.007
σ0.023-0.021=0.001
min964.818-964.811=0.007
max964.876-964.860=0.016
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.826-0.807=0.020
σ0.038-0.040=-0.002
min0.781-0.741=0.040
max0.873-0.848=0.025
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.007=-0.000
min885.504
max885.521-885.521=0.000
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.695-0.701=-0.005
σ0.051-0.042=0.009
min0.633-0.633=0.001
max0.742-0.736=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean3.552-4.218=-0.666
σ0.088-0.073=0.015
min3.369-4.115=-0.747
max3.831-4.621=-0.791
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean3.549-4.215=-0.665
σ0.070-0.067=0.003
min3.421-4.073=-0.651
max3.812-4.424=-0.612
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.539-0.751=-0.212
σ0.013-0.018=-0.005
min0.515-0.712=-0.197
max0.614-0.862=-0.248
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.512-0.708=-0.195
σ0.011-0.015=-0.004
min0.485-0.675=-0.189
max0.559-0.795=-0.237

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.841-296.383=0.458
σ0.248-0.269=-0.021
min296.661-296.122=0.539
max297.503-297.100=0.403
mean1902.000-1913.000=-11.000
σ0.000
min1902.000-1913.000=-11.000
max1902.000-1913.000=-11.000
mean0.601-0.575=0.026
σ0.032-0.037=-0.006
min0.568-0.484=0.084
max0.682-0.610=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-285.032=1.792
σ0.034-0.037=-0.003
min286.782-284.980=1.802
max286.867-285.066=1.801
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.401-0.396=0.005
σ0.013-0.008=0.005
min0.390-0.388=0.002
max0.419-0.407=0.012
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1295.411=1.814
σ0.074-0.113=-0.039
min1297.143-1295.286=1.857
max1297.327-1295.543=1.784
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean2.079-1.907=0.172
σ0.065-0.057=0.008
min2.014-1.850=0.164
max2.174-1.968=0.207
iters=5
new-facts=6402
prior-facts=1
mean1541.396-1539.530=1.866
σ6.823-6.811=0.011
min1538.199-1536.235=1.965
max1553.598-1551.709=1.888
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean2.397-2.282=0.115
σ0.175-0.221=-0.046
min2.139-2.065=0.074
max2.542-2.635=-0.093
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1857.318=1.799
σ0.063-0.077=-0.014
min1859.040-1857.221=1.820
max1859.193-1857.411=1.782
mean1773.000-1753.800=19.200
σ123.219-173.884=-50.665
min1653.000-1514.000=139.000
max1902.000-1913.000=-11.000
mean3.080-3.058=0.022
σ0.264-0.250=0.014
min2.789-2.798=-0.009
max3.420-3.426=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.427=-0.243
σ0.352-0.338=0.014
min0.926-0.965=-0.039
max1.763-1.719=0.044

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.191=0.629
σ581.372-581.331=0.040
min158.133-157.524=0.609
max1320.877-1320.188=0.689
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean0.537-0.556=-0.019
σ0.551-0.590=-0.039
min0.259-0.259=0.001
max1.364-1.441=-0.077
policies=20
mean1581.609-1575.568=6.041
σ0.357-0.347=0.009
min1581.369-1575.332=6.037
max1582.140-1576.084=6.055
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean2.633-2.619=0.014
σ0.013-0.015=-0.001
min2.620-2.606=0.014
max2.650-2.636=0.014
policies=200
mean15824.211-15763.638=60.573
σ0.147-0.083=0.065
min15824.075-15763.551=60.524
max15824.416-15763.719=60.697
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1514.000=139.000
σ0.000
min1653.000-1514.000=139.000
max1653.000-1514.000=139.000
mean26.600-26.476=0.123
σ0.039-0.040=-0.000
min26.557-26.442=0.115
max26.645-26.515=0.130