Compare commits

Home / Compare 4d9642cf .. 6ac8c389

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.371-0.371=-0.000
min53.875-53.872=0.003
max55.070-55.069=0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.137-0.140=-0.002
σ0.010-0.005=0.005
min0.113-0.133=-0.020
max0.146-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=0.000
σ0.005-0.007=-0.001
min43.317-43.312=0.005
max43.336-43.334=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.001
min0.119-0.114=0.005
max0.129-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.304-1006.310=-0.006
σ1.199-1.167=0.032
min1005.745-1005.765=-0.020
max1011.336-1011.184=0.152
mean1050.050-1047.950=2.100
σ303.945-312.582=-8.638
min585.000-600.000=-15.000
max1639.000-1645.000=-6.000
mean1.544-1.578=-0.034
σ0.062-0.082=-0.019
min1.472-1.489=-0.017
max1.715-1.775=-0.060

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.403-0.419=-0.016
σ0.131-0.145=-0.014
min0.327-0.319=0.008
max0.636-0.667=-0.032
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.881-0.903=-0.022
σ0.096-0.153=-0.057
min0.815-0.818=-0.003
max1.050-1.176=-0.126
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.574-0.538=0.036
σ0.057-0.050=0.007
min0.518-0.504=0.014
max0.652-0.624=0.028
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.829-0.834=-0.005
σ0.048-0.037=0.012
min0.794-0.808=-0.014
max0.913-0.896=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.001
σ0.034-0.025=0.009
min964.087-964.094=-0.007
max964.171-964.155=0.016
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.826-0.846=-0.020
σ0.052-0.022=0.030
min0.736-0.808=-0.072
max0.860-0.866=-0.006
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.008-0.007=0.001
min884.703-884.705=-0.001
max884.723-884.722=0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.725-0.717=0.008
σ0.028-0.033=-0.005
min0.675-0.661=0.014
max0.742-0.739=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.259-4.210=0.050
σ0.085-0.078=0.007
min4.120-4.084=0.037
max4.578-4.617=-0.040
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.242-4.230=0.012
σ0.074-0.101=-0.027
min4.072-3.710=0.362
max4.597-4.540=0.056
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.580-0.739=-0.159
σ0.092-0.019=0.072
min0.509-0.656=-0.146
max0.864-0.856=0.008
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.500-0.700=-0.200
σ0.010-0.013=-0.003
min0.480-0.671=-0.191
max0.547-0.759=-0.212

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.186-296.024=0.162
σ0.221-0.230=-0.009
min295.992-295.846=0.146
max296.780-296.653=0.126
mean1902.000-1909.000=-7.000
σ0.000
min1902.000-1909.000=-7.000
max1902.000-1909.000=-7.000
mean0.578-0.560=0.019
σ0.049-0.061=-0.011
min0.518-0.502=0.017
max0.702-0.691=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.702-284.692=0.010
σ0.027-0.038=-0.010
min284.671-284.645=0.027
max284.733-284.735=-0.002
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.397-0.397=-0.000
σ0.012-0.010=0.002
min0.384-0.386=-0.002
max0.408-0.409=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.040=0.038
σ0.101-0.094=0.007
min1294.959-1294.959=-0.000
max1295.193-1295.192=0.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean1.891-1.939=-0.048
σ0.075-0.199=-0.124
min1.816-1.802=0.014
max1.977-2.274=-0.297
iters=5
new-facts=6402
prior-facts=1
mean1539.239-1539.246=-0.007
σ6.834-6.816=0.018
min1536.004-1536.086=-0.082
max1551.461-1551.438=0.023
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.400-2.322=0.077
σ0.280-0.278=0.002
min2.026-2.107=-0.081
max2.690-2.755=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.990=-0.005
σ0.053-0.051=0.003
min1856.934-1856.939=-0.005
max1857.064-1857.058=0.006
mean1770.000-1777.400=-7.400
σ127.650-129.201=-1.551
min1639.000-1645.000=-6.000
max1902.000-1909.000=-7.000
mean3.052-3.087=-0.035
σ0.224-0.293=-0.068
min2.858-2.865=-0.007
max3.433-3.598=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.235-1.165=0.070
σ0.350-0.242=0.108
min0.944-0.934=0.011
max1.826-1.540=0.286

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.003
σ581.212-581.212=-0.000
min157.178-157.175=0.003
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.542-0.540=0.003
σ0.560-0.549=0.011
min0.261-0.265=-0.004
max1.383-1.364=0.019
policies=20
mean1572.106-1572.054=0.052
σ0.357-0.295=0.062
min1571.867-1571.847=0.020
max1572.637-1572.491=0.146
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.637-2.647=-0.011
σ0.016-0.025=-0.009
min2.620-2.630=-0.010
max2.658-2.683=-0.025
policies=200
mean15728.999-15728.940=0.058
σ0.099-0.181=-0.081
min15728.881-15728.688=0.193
max15729.104-15729.085=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean26.545-26.618=-0.073
σ0.032-0.105=-0.073
min26.513-26.556=-0.043
max26.589-26.775=-0.185