Compare commits

Home / Compare 4d49563b .. b1ec9491

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.000
σ0.371-0.368=0.002
min53.913-53.912=0.001
max55.111-55.105=0.006
mean416.700-415.000=1.700
σ0.483-0.000=0.483
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.139-0.139=-0.000
σ0.004-0.004=0.000
min0.132-0.133=-0.000
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.007-0.007=-0.000
min43.383-43.383=0.000
max43.405-43.407=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.123-0.123=0.000
σ0.003-0.003=-0.000
min0.120-0.120=0.000
max0.129-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.960-1006.964=-0.004
σ0.875-0.870=0.005
min1006.463-1006.464=-0.001
max1010.586-1010.564=0.022
mean1050.500-1055.050=-4.550
σ313.503-315.939=-2.436
min565.000-557.000=8.000
max1649.000-1636.000=13.000
mean1.556-1.542=0.014
σ0.057-0.093=-0.037
min1.491-1.425=0.066
max1.661-1.804=-0.143

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.431-0.412=0.020
σ0.135-0.130=0.005
min0.335-0.327=0.008
max0.660-0.642=0.018
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.894-0.882=0.012
σ0.093-0.105=-0.012
min0.829-0.808=0.021
max1.058-1.064=-0.006
name=heavy_item.art
mean1.524-1.524=0.001
σ0.003-0.002=0.001
min1.522
max1.529-1.526=0.003
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.540-0.532=0.008
σ0.039-0.052=-0.013
min0.510-0.482=0.028
max0.608-0.621=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.855-0.850=0.005
σ0.034-0.045=-0.011
min0.825-0.811=0.014
max0.912-0.925=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.034-0.034=0.000
min964.810-964.811=-0.001
max964.895-964.895=-0.000
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.841-0.798=0.043
σ0.029-0.038=-0.009
min0.789-0.737=0.053
max0.861-0.839=0.021
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.007-0.007=0.000
min885.505-885.506=-0.000
max885.523-885.522=0.001
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.727-0.712=0.015
σ0.015-0.045=-0.030
min0.702-0.636=0.066
max0.739-0.750=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean3.530-3.562=-0.032
σ0.075-0.100=-0.025
min3.406-3.392=0.014
max3.708-4.199=-0.491
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean3.516-3.526=-0.010
σ0.069-0.079=-0.011
min3.362-3.356=0.006
max3.704-3.739=-0.035
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.553-0.744=-0.191
σ0.026-0.016=0.010
min0.518-0.717=-0.198
max0.686-0.837=-0.152
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.512-0.704=-0.192
σ0.011-0.028=-0.017
min0.493-0.518=-0.026
max0.577-0.834=-0.257

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.499-295.510=-0.011
σ0.238-0.222=0.016
min295.350-295.326=0.023
max296.158-296.117=0.042
mean1967.000-2029.000=-62.000
σ0.000
min1967.000-2029.000=-62.000
max1967.000-2029.000=-62.000
mean0.530-0.559=-0.029
σ0.025-0.037=-0.012
min0.501-0.509=-0.007
max0.575-0.605=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.393=-0.001
σ0.039-0.037=0.002
min285.343-285.343=-0.001
max285.433-285.432=0.001
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.387-0.385=0.002
σ0.005-0.006=-0.001
min0.382-0.381=0.001
max0.393-0.396=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.772-1295.784=-0.012
σ0.098-0.119=-0.021
min1295.662-1295.650=0.012
max1295.887-1295.933=-0.046
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean1.954-1.862=0.092
σ0.112-0.066=0.046
min1.832-1.801=0.031
max2.095-1.939=0.155
iters=5
new-facts=6402
prior-facts=1
mean1539.891-1539.902=-0.011
σ6.887-6.876=0.011
min1536.570-1536.623=-0.053
max1552.206-1552.199=0.007
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean2.277-2.246=0.031
σ0.188-0.297=-0.109
min1.989-1.958=0.031
max2.517-2.634=-0.118
iters=5
new-facts=6402
prior-facts=6402
mean1857.687-1857.679=0.008
σ0.066-0.063=0.002
min1857.610-1857.617=-0.007
max1857.765-1857.770=-0.005
mean1778.800-1774.800=4.000
σ126.314-172.290=-45.976
min1649.000-1636.000=13.000
max1967.000-2029.000=-62.000
mean2.934-2.867=0.067
σ0.061-0.059=0.001
min2.845-2.787=0.057
max2.995-2.954=0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.229=-0.036
σ0.289-0.304=-0.015
min0.937-0.949=-0.012
max1.667-1.736=-0.069

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.743-447.403=-1.661
σ581.010-584.329=-3.319
min155.234-155.235=-0.000
max1317.257-1323.896=-6.639
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean0.538-0.559=-0.021
σ0.548-0.577=-0.029
min0.260-0.262=-0.002
max1.359-1.425=-0.065
policies=20
mean1552.652-1552.668=-0.016
σ0.337-0.339=-0.003
min1552.419-1552.436=-0.017
max1553.152-1553.172=-0.020
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean2.607-2.614=-0.007
σ0.018-0.042=-0.025
min2.592-2.587=0.005
max2.632-2.677=-0.045
policies=200
mean15534.736-15534.640=0.096
σ0.138-0.125=0.013
min15534.641-15534.528=0.113
max15534.939-15534.799=0.140
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1636.000=13.000
σ0.000
min1649.000-1636.000=13.000
max1649.000-1636.000=13.000
mean26.080-26.206=-0.126
σ0.033-0.125=-0.093
min26.048-26.120=-0.071
max26.108-26.392=-0.284