Compare commits

Home / Compare bcc28777 .. c71a215f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.000
σ0.368-0.370=-0.002
min53.918-53.913=0.005
max55.102-55.109=-0.007
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.140-0.140=-0.001
σ0.005-0.003=0.001
min0.133-0.136=-0.003
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.005=0.002
min43.387-43.386=0.001
max43.408-43.403=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.120-0.122=-0.002
σ0.003-0.004=-0.001
min0.116-0.118=-0.002
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.003=-0.001
σ1.210-1.188=0.022
min1006.444-1006.432=0.012
max1012.081-1011.983=0.098
mean1052.900-1055.550=-2.650
σ308.059-307.773=0.286
min578.000-581.000=-3.000
max1645.000-1647.000=-2.000
mean1.580-1.550=0.030
σ0.120-0.075=0.046
min1.482-1.469=0.013
max1.907-1.782=0.125

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.403-0.413=-0.010
σ0.122-0.145=-0.023
min0.325-0.333=-0.008
max0.616-0.671=-0.055
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.893-0.873=0.020
σ0.092-0.096=-0.004
min0.810-0.814=-0.004
max1.038-1.043=-0.005
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.541-0.534=0.007
σ0.051-0.049=0.002
min0.497-0.501=-0.004
max0.627-0.619=0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.843-0.843=-0.001
σ0.045-0.044=0.001
min0.808-0.803=0.005
max0.916-0.916=-0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.035-0.032=0.002
min964.810-964.812=-0.002
max964.897-964.892=0.005
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.827-0.835=-0.007
σ0.032-0.025=0.007
min0.785-0.811=-0.026
max0.863-0.862=0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.504
max885.522-885.522=0.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.712-0.728=-0.015
σ0.033-0.031=0.002
min0.675-0.674=0.002
max0.745-0.754=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean4.262-3.558=0.705
σ0.089-0.123=-0.034
min4.097-3.400=0.697
max4.700-4.593=0.107
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean4.220-3.511=0.710
σ0.073-0.071=0.001
min4.084-3.391=0.693
max4.531-3.812=0.719
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.747-0.740=0.006
σ0.021-0.018=0.002
min0.715-0.708=0.007
max0.866-0.862=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.710-0.704=0.006
σ0.017-0.016=0.001
min0.675-0.677=-0.002
max0.815-0.778=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.985-297.029=-0.043
σ0.231-0.253=-0.022
min296.807-296.866=-0.060
max297.584-297.729=-0.145
mean1909.000-1958.000=-49.000
σ0.000
min1909.000-1958.000=-49.000
max1909.000-1958.000=-49.000
mean0.577-0.561=0.016
σ0.035-0.032=0.003
min0.505-0.510=-0.005
max0.609-0.612=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.807=0.015
σ0.038-0.036=0.003
min286.769-286.764=0.005
max286.865-286.854=0.011
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.396-0.396=-0.000
σ0.007-0.006=0.001
min0.388-0.392=-0.004
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.269-1297.259=0.011
σ0.084-0.125=-0.041
min1297.155-1297.074=0.081
max1297.374-1297.411=-0.037
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.261-2.195=0.066
σ0.115-0.097=0.018
min2.171-2.053=0.119
max2.455-2.318=0.137
iters=5
new-facts=6402
prior-facts=1
mean1541.368-1541.381=-0.013
σ6.804-6.806=-0.002
min1538.212-1538.238=-0.026
max1553.537-1553.555=-0.018
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.310-2.348=-0.038
σ0.252-0.271=-0.019
min2.118-2.143=-0.025
max2.727-2.800=-0.073
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.110=0.001
σ0.066-0.067=-0.001
min1859.028-1859.030=-0.003
max1859.190-1859.191=-0.001
mean1777.600-1796.400=-18.800
σ129.181-156.097=-26.916
min1645.000-1647.000=-2.000
max1909.000-1958.000=-49.000
mean3.053-2.990=0.064
σ0.241-0.157=0.084
min2.806-2.830=-0.023
max3.359-3.221=0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.223-1.236=-0.013
σ0.323-0.360=-0.037
min0.942-0.931=0.011
max1.754-1.843=-0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=0.000
σ581.372-581.373=-0.001
min158.135-158.134=0.001
max1320.881-1320.882=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.556-0.569=-0.013
σ0.578-0.599=-0.021
min0.262-0.263=-0.001
max1.422-1.468=-0.045
policies=20
mean1581.627-1581.629=-0.001
σ0.366-0.363=0.003
min1581.388-1581.387=0.001
max1582.173-1582.169=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.651-2.643=0.008
σ0.014-0.018=-0.004
min2.636-2.627=0.009
max2.669-2.665=0.004
policies=200
mean15824.162-15824.163=-0.000
σ0.100-0.094=0.007
min15824.016-15824.056=-0.040
max15824.244-15824.248=-0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean26.712-26.646=0.067
σ0.079-0.064=0.015
min26.629-26.571=0.059
max26.800-26.719=0.080