Compare commits

Home / Compare c06bf2c9 .. 1a503d08

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.369-0.368=0.000
min53.908-53.916=-0.008
max55.103-55.103=-0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.138-0.139=-0.001
σ0.004-0.004=-0.001
min0.132-0.135=-0.003
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.006-0.007=-0.000
min43.386-43.385=0.000
max43.402-43.406=-0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.001
min0.115-0.119=-0.003
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.984=-0.005
σ0.925-0.855=0.070
min1006.507-1006.483=0.023
max1010.827-1010.507=0.320
mean1055.650-1047.200=8.450
σ306.148-314.016=-7.868
min576.000-577.000=-1.000
max1457.000-1645.000=-188.000
mean1.568-1.534=0.034
σ0.135-0.082=0.053
min1.469-1.404=0.065
max2.021-1.798=0.223

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.441-0.430=0.010
σ0.126-0.144=-0.018
min0.352-0.326=0.025
max0.659-0.684=-0.024
name=error_case.art
mean2.339-2.340=-0.002
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.886-0.887=-0.001
σ0.097-0.091=0.006
min0.826-0.812=0.014
max1.058-1.046=0.012
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.532-0.545=-0.013
σ0.051-0.054=-0.003
min0.482-0.496=-0.014
max0.616-0.632=-0.016
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.843-0.865=-0.022
σ0.040-0.033=0.007
min0.816-0.843=-0.027
max0.911-0.924=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.832=-0.010
σ0.026-0.028=-0.002
min964.802-964.810=-0.008
max964.864-964.876=-0.011
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.829-0.808=0.021
σ0.032-0.048=-0.017
min0.795-0.748=0.047
max0.865-0.864=0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.006-0.007=-0.000
min885.504
max885.518-885.520=-0.002
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.736-0.686=0.050
σ0.008-0.057=-0.049
min0.723-0.608=0.114
max0.745-0.758=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719-7.719=0.000
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean3.535-4.233=-0.697
σ0.084-0.099=-0.015
min3.395-4.098=-0.703
max3.894-4.633=-0.739
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean3.523-4.236=-0.713
σ0.064-0.077=-0.013
min3.386-4.113=-0.727
max3.734-4.536=-0.802
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.540-0.747=-0.208
σ0.015-0.019=-0.003
min0.520-0.685=-0.165
max0.638-0.851=-0.213
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.506-0.706=-0.200
σ0.016-0.016=0.000
min0.475-0.635=-0.160
max0.569-0.764=-0.195

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.628-295.627=0.001
σ0.285-0.258=0.028
min295.466-295.377=0.090
max296.421-296.311=0.110
mean1905.000-1913.000=-8.000
σ0.000
min1905.000-1913.000=-8.000
max1905.000-1913.000=-8.000
mean0.583-0.575=0.008
σ0.046-0.053=-0.007
min0.500-0.513=-0.013
max0.645-0.694=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-285.406=-0.008
σ0.030-0.032=-0.002
min285.360-285.365=-0.005
max285.431-285.441=-0.010
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.403-0.391=0.012
σ0.005-0.009=-0.004
min0.396-0.381=0.015
max0.410-0.401=0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.765-1295.795=-0.029
σ0.069-0.114=-0.045
min1295.676-1295.666=0.010
max1295.838-1295.947=-0.109
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean1.913-1.978=-0.065
σ0.102-0.124=-0.022
min1.819-1.843=-0.024
max2.048-2.132=-0.085
iters=5
new-facts=6402
prior-facts=1
mean1539.992-1539.936=0.056
σ6.860-6.890=-0.030
min1536.776-1536.634=0.142
max1552.261-1552.255=0.005
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean2.503-2.345=0.157
σ0.156-0.207=-0.050
min2.248-2.102=0.146
max2.645-2.618=0.027
iters=5
new-facts=6402
prior-facts=6402
mean1857.700-1857.705=-0.005
σ0.051-0.059=-0.009
min1857.654-1857.642=0.012
max1857.774-1857.785=-0.011
mean1744.600-1772.800=-28.200
σ171.144-134.715=36.429
min1505.000-1645.000=-140.000
max1905.000-1913.000=-8.000
mean3.058-2.971=0.088
σ0.264-0.212=0.051
min2.869-2.677=0.192
max3.524-3.277=0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.344=0.415
σ0.129-0.221=-0.092
min1.608-1.107=0.501
max1.917-1.702=0.215

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=0.000
σ580.934-580.934=-0.000
min155.272-155.272=0.000
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean0.542-0.534=0.007
σ0.558-0.549=0.008
min0.262-0.255=0.007
max1.378-1.358=0.020
policies=20
mean1552.986-1552.990=-0.005
σ0.317-0.328=-0.011
min1552.769-1552.767=0.001
max1553.457-1553.478=-0.021
mean920.000
σ0.000
min920.000
max920.000
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean2.572-2.590=-0.018
σ0.017-0.024=-0.007
min2.557-2.569=-0.012
max2.595-2.620=-0.024
policies=200
mean15538.060-15537.931=0.129
σ0.060-0.082=-0.022
min15538.014-15537.839=0.175
max15538.147-15538.012=0.136
mean9200.000
σ0.000
min9200.000
max9200.000
mean1457.000-1645.000=-188.000
σ0.000
min1457.000-1645.000=-188.000
max1457.000-1645.000=-188.000
mean26.140-26.122=0.018
σ0.018-0.106=-0.088
min26.118-26.029=0.089
max26.161-26.272=-0.111