Compare commits

Home / Compare 08fb18fa .. b1d96e49

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.002
σ0.368-0.368=0.000
min53.916-53.914=0.002
max55.103-55.104=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.139-0.137=0.002
σ0.004-0.006=-0.001
min0.135-0.130=0.005
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.396=-0.003
σ0.007-0.006=0.001
min43.385-43.386=-0.001
max43.406-43.406=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.122-0.125=-0.003
σ0.003-0.005=-0.001
min0.119-0.120=-0.001
max0.128-0.135=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1006.961=0.023
σ0.855-0.867=-0.012
min1006.483-1006.462=0.021
max1010.507-1010.547=-0.040
mean1047.200-1048.750=-1.550
σ314.016-318.009=-3.993
min577.000-546.000=31.000
max1645.000-1650.000=-5.000
mean1.534-1.538=-0.004
σ0.082-0.095=-0.013
min1.404-1.384=0.019
max1.798-1.785=0.013

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.430-0.424=0.006
σ0.144-0.142=0.001
min0.326-0.339=-0.013
max0.684-0.677=0.007
name=error_case.art
mean2.340-2.339=0.002
σ0.003-0.003=0.000
min2.337
max2.343-2.342=0.001
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.887-0.912=-0.026
σ0.091-0.097=-0.006
min0.812-0.848=-0.036
max1.046-1.083=-0.038
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.545-0.540=0.005
σ0.054-0.050=0.004
min0.496-0.512=-0.016
max0.632-0.630=0.002
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.865-0.863=0.002
σ0.033-0.036=-0.003
min0.843-0.838=0.005
max0.924-0.925=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.839=-0.007
σ0.028-0.034=-0.006
min964.810-964.810=0.000
max964.876-964.894=-0.019
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.808-0.807=0.002
σ0.048-0.051=-0.003
min0.748-0.739=0.009
max0.864-0.854=0.010
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.003
σ0.007-0.007=-0.001
min885.504-885.505=-0.001
max885.520-885.522=-0.002
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.686-0.690=-0.004
σ0.057-0.045=0.012
min0.608-0.635=-0.027
max0.758-0.735=0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean4.233-4.238=-0.005
σ0.099-0.099=-0.000
min4.098-3.803=0.295
max4.633-4.552=0.081
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean4.236-4.220=0.016
σ0.077-0.063=0.015
min4.113-4.117=-0.004
max4.536-4.468=0.068
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.747-0.751=-0.003
σ0.019-0.018=0.000
min0.685-0.723=-0.038
max0.851-0.868=-0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.706-0.712=-0.006
σ0.016-0.015=0.002
min0.635-0.686=-0.051
max0.764-0.786=-0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.492=0.135
σ0.258-0.264=-0.006
min295.377-295.244=0.133
max296.311-296.175=0.136
mean1913.000-2018.000=-105.000
σ0.000
min1913.000-2018.000=-105.000
max1913.000-2018.000=-105.000
mean0.575-0.550=0.025
σ0.053-0.041=0.013
min0.513-0.502=0.011
max0.694-0.598=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.390=0.015
σ0.032-0.034=-0.003
min285.365-285.342=0.023
max285.441-285.424=0.017
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.391-0.391=-0.000
σ0.009-0.005=0.004
min0.381-0.383=-0.003
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.759=0.036
σ0.114-0.086=0.028
min1295.666-1295.656=0.010
max1295.947-1295.870=0.077
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean1.978-1.847=0.131
σ0.124-0.056=0.068
min1.843-1.799=0.044
max2.132-1.921=0.211
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1539.896=0.040
σ6.890-6.858=0.032
min1536.634-1536.598=0.036
max1552.255-1552.158=0.097
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean2.345-2.289=0.056
σ0.207-0.182=0.025
min2.102-2.135=-0.033
max2.618-2.589=0.029
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1857.688=0.017
σ0.059-0.067=-0.008
min1857.642-1857.610=0.032
max1857.785-1857.775=0.010
mean1772.800-1767.200=5.600
σ134.715-156.516=-21.801
min1645.000-1650.000=-5.000
max1913.000-2018.000=-105.000
mean2.971-2.913=0.058
σ0.212-0.063=0.149
min2.677-2.838=-0.161
max3.277-2.977=0.300

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.224=0.121
σ0.221-0.328=-0.108
min1.107-0.946=0.161
max1.702-1.776=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.708=0.034
σ580.934-580.934=0.001
min155.272-155.239=0.033
max1317.142-1317.108=0.035
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean0.534-0.551=-0.017
σ0.549-0.576=-0.027
min0.255-0.259=-0.004
max1.358-1.416=-0.058
policies=20
mean1552.990-1552.659=0.332
σ0.328-0.327=0.001
min1552.767-1552.431=0.336
max1553.478-1553.144=0.334
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean2.590-2.591=-0.002
σ0.024-0.001=0.023
min2.569-2.590=-0.021
max2.620-2.592=0.028
policies=200
mean15537.931-15534.652=3.279
σ0.082-0.196=-0.114
min15537.839-15534.529=3.311
max15538.012-15534.944=3.068
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1650.000=-5.000
σ0.000
min1645.000-1650.000=-5.000
max1645.000-1650.000=-5.000
mean26.122-26.245=-0.123
σ0.106-0.114=-0.008
min26.029-26.144=-0.115
max26.272-26.384=-0.112