Compare commits

Home / Compare 32f2241a .. 3ada3754

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.369-0.368=0.000
min53.913-53.912=0.002
max55.104-55.102=0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.140-0.142=-0.002
σ0.004-0.004=-0.000
min0.135-0.138=-0.003
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.007-0.006=0.001
min43.383-43.385=-0.002
max43.407-43.405=0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.123-0.121=0.001
σ0.003-0.003=-0.000
min0.119-0.119=0.000
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.001
σ1.193-1.191=0.002
min1006.433-1006.433=-0.000
max1012.004-1011.994=0.011
mean1053.800-1045.200=8.600
σ313.753-312.312=1.441
min585.000-590.000=-5.000
max1615.000-1634.000=-19.000
mean1.531-1.537=-0.006
σ0.051-0.056=-0.005
min1.453-1.469=-0.016
max1.621-1.705=-0.085

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.437-0.416=0.020
σ0.128-0.130=-0.003
min0.359-0.336=0.023
max0.664-0.646=0.018
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.936-0.885=0.052
σ0.094-0.088=0.006
min0.846-0.821=0.026
max1.071-1.039=0.032
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.537-0.540=-0.003
σ0.060-0.056=0.004
min0.488-0.497=-0.008
max0.640-0.635=0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.842-0.858=-0.016
σ0.042-0.037=0.005
min0.809-0.832=-0.023
max0.915-0.924=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.023-0.035=-0.012
min964.818-964.809=0.009
max964.873-964.896=-0.023
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.802-0.844=-0.041
σ0.052-0.027=0.025
min0.726-0.796=-0.070
max0.866-0.862=0.004
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.007-0.006=0.001
min885.504-885.505=-0.001
max885.523-885.520=0.003
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.686-0.730=-0.043
σ0.060-0.015=0.045
min0.591-0.704=-0.113
max0.736-0.745=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.002
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean4.262-4.258=0.004
σ0.097-0.078=0.019
min4.110-4.105=0.005
max4.597-4.484=0.113
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.670-7.668=0.002
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean4.241-4.239=0.002
σ0.083-0.073=0.009
min4.059-4.128=-0.069
max4.492-4.484=0.008
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.730-0.740=-0.010
σ0.018-0.020=-0.003
min0.696-0.698=-0.002
max0.843-0.871=-0.028
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.695-0.696=-0.001
σ0.014-0.014=-0.000
min0.670-0.663=0.007
max0.751-0.766=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.953-296.989=-0.036
σ0.198-0.245=-0.046
min296.792-296.788=0.004
max297.468-297.647=-0.180
mean2022.000-1935.000=87.000
σ0.000
min2022.000-1935.000=87.000
max2022.000-1935.000=87.000
mean0.556-0.596=-0.040
σ0.033-0.041=-0.007
min0.506-0.512=-0.006
max0.592-0.673=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.818=0.004
σ0.039-0.037=0.003
min286.776-286.771=0.005
max286.868-286.854=0.013
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.397-0.394=0.003
σ0.007-0.007=-0.000
min0.390-0.390=0.000
max0.405-0.406=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.260-1297.253=0.007
σ0.079-0.056=0.023
min1297.162-1297.195=-0.033
max1297.360-1297.318=0.042
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean2.103-2.096=0.007
σ0.093-0.075=0.018
min2.006-2.018=-0.012
max2.237-2.203=0.034
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1541.334=0.001
σ6.835-6.822=0.013
min1538.037-1538.113=-0.075
max1553.556-1553.534=0.022
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean2.289-2.254=0.035
σ0.247-0.201=0.045
min2.077-2.049=0.028
max2.673-2.549=0.124
iters=5
new-facts=6402
prior-facts=6402
mean1859.110-1859.116=-0.006
σ0.084-0.078=0.006
min1858.979-1859.011=-0.033
max1859.189-1859.201=-0.012
mean1769.800-1779.800=-10.000
σ179.228-150.866=28.362
min1615.000-1634.000=-19.000
max2022.000-1935.000=87.000
mean2.926-2.936=-0.010
σ0.103-0.093=0.010
min2.814-2.869=-0.055
max3.086-3.097=-0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.234=-0.053
σ0.308-0.351=-0.043
min0.926-0.941=-0.015
max1.676-1.799=-0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.372=0.000
min158.133-158.133=-0.001
max1320.878-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean0.548-0.556=-0.008
σ0.568-0.582=-0.014
min0.260-0.261=-0.001
max1.399-1.429=-0.030
policies=20
mean1581.615-1581.622=-0.007
σ0.368-0.364=0.004
min1581.366-1581.377=-0.010
max1582.162-1582.163=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean2.640-2.637=0.003
σ0.023-0.009=0.014
min2.613-2.628=-0.015
max2.659-2.649=0.010
policies=200
mean15824.240-15824.255=-0.015
σ0.125-0.097=0.028
min15824.151-15824.191=-0.040
max15824.420-15824.399=0.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1615.000-1634.000=-19.000
σ0.000
min1615.000-1634.000=-19.000
max1615.000-1634.000=-19.000
mean26.588-26.603=-0.015
σ0.027-0.028=-0.001
min26.553-26.578=-0.025
max26.611-26.637=-0.026