Compare commits

Home / Compare 97c01f6f .. e9493e03

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.053=0.001
σ0.368-0.370=-0.002
min53.916-53.903=0.012
max55.103-55.107=-0.004
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.139-0.139=-0.000
σ0.004-0.005=-0.001
min0.135-0.132=0.003
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.392=0.001
σ0.007-0.006=0.001
min43.385-43.383=0.002
max43.406-43.404=0.002
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.122-0.122=-0.000
σ0.003-0.004=-0.000
min0.119-0.119=-0.000
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1007.005=-0.022
σ0.855-1.191=-0.336
min1006.483-1006.437=0.046
max1010.507-1011.992=-1.486
mean1047.200-1055.850=-8.650
σ314.016-309.024=4.993
min577.000-580.000=-3.000
max1645.000-1653.000=-8.000
mean1.534-1.537=-0.003
σ0.082-0.075=0.007
min1.404-1.449=-0.045
max1.798-1.739=0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.430-0.428=0.002
σ0.144-0.143=0.001
min0.326-0.331=-0.005
max0.684-0.680=0.004
name=error_case.art
mean2.340-2.339=0.002
σ0.003-0.003=0.000
min2.337
max2.343-2.342=0.001
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.887-0.897=-0.010
σ0.091-0.082=0.009
min0.812-0.841=-0.029
max1.046-1.041=0.005
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.545-0.543=0.002
σ0.054-0.051=0.003
min0.496-0.492=0.004
max0.632-0.626=0.007
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.865-0.851=0.014
σ0.033-0.041=-0.008
min0.843-0.828=0.016
max0.924-0.925=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.840=-0.008
σ0.028-0.035=-0.007
min964.810-964.811=-0.001
max964.876-964.896=-0.021
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.808-0.839=-0.031
σ0.048-0.020=0.028
min0.748-0.812=-0.063
max0.864-0.863=0.001
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.007-0.007=-0.001
min885.504-885.506=-0.001
max885.520-885.523=-0.003
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.686-0.721=-0.035
σ0.057-0.038=0.020
min0.608-0.654=-0.045
max0.758-0.743=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean4.233-3.519=0.714
σ0.099-0.077=0.021
min4.098-3.407=0.691
max4.633-3.866=0.767
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean4.236-3.525=0.711
σ0.077-0.076=0.002
min4.113-3.396=0.717
max4.536-3.824=0.712
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.747-0.753=-0.006
σ0.019-0.018=0.001
min0.685-0.724=-0.039
max0.851-0.868=-0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.706-0.719=-0.013
σ0.016-0.015=0.001
min0.635-0.681=-0.046
max0.764-0.808=-0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-296.851=-1.224
σ0.258-0.221=0.037
min295.377-296.642=-1.265
max296.311-297.436=-1.125
mean1913.000-2017.000=-104.000
σ0.000
min1913.000-2017.000=-104.000
max1913.000-2017.000=-104.000
mean0.575-0.559=0.016
σ0.053-0.026=0.027
min0.513-0.512=0.002
max0.694-0.578=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-286.825=-1.419
σ0.032-0.037=-0.006
min285.365-286.784=-1.420
max285.441-286.866=-1.425
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.391-0.397=-0.005
σ0.009-0.007=0.002
min0.381-0.389=-0.008
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1297.186=-1.391
σ0.114-0.130=-0.016
min1295.666-1297.094=-1.428
max1295.947-1297.404=-1.457
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean1.978-1.917=0.061
σ0.124-0.185=-0.062
min1.843-1.808=0.035
max2.132-2.238=-0.106
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1541.370=-1.434
σ6.890-6.790=0.100
min1536.634-1538.173=-1.539
max1552.255-1553.513=-1.258
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean2.345-2.338=0.007
σ0.207-0.185=0.021
min2.102-2.133=-0.032
max2.618-2.615=0.003
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1859.114=-1.409
σ0.059-0.057=0.003
min1857.642-1859.039=-1.396
max1857.785-1859.178=-1.393
mean1772.800-1773.000=-0.200
σ134.715-158.273=-23.558
min1645.000-1653.000=-8.000
max1913.000-2017.000=-104.000
mean2.971-2.911=0.060
σ0.212-0.128=0.085
min2.677-2.832=-0.155
max3.277-3.138=0.139

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.227=0.117
σ0.221-0.384=-0.163
min1.107-0.931=0.176
max1.702-1.786=-0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-448.820=-3.078
σ580.934-581.372=-0.438
min155.272-158.132=-2.860
max1317.142-1320.878=-3.735
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean0.534-0.555=-0.021
σ0.549-0.579=-0.030
min0.255-0.261=-0.006
max1.358-1.424=-0.066
policies=20
mean1552.990-1581.609=-28.619
σ0.328-0.356=-0.028
min1552.767-1581.372=-28.604
max1553.478-1582.138=-28.661
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean2.590-2.628=-0.038
σ0.024-0.010=0.014
min2.569-2.614=-0.046
max2.620-2.637=-0.017
policies=200
mean15537.931-15824.185=-286.254
σ0.082-0.149=-0.067
min15537.839-15824.002=-286.163
max15538.012-15824.364=-286.353
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1653.000=-8.000
σ0.000
min1645.000-1653.000=-8.000
max1645.000-1653.000=-8.000
mean26.122-26.556=-0.433
σ0.106-0.039=0.067
min26.029-26.525=-0.496
max26.272-26.607=-0.335