Compare commits

Home / Compare 1cbaa087 .. c5b376f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.001
σ0.370-0.371=-0.001
min53.871-53.870=0.001
max55.068-55.069=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.140-0.138=0.002
σ0.005-0.005=-0.001
min0.135-0.130=0.005
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=-0.001
σ0.006-0.007=-0.001
min43.315-43.310=0.005
max43.338-43.334=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.123-0.123=0.000
σ0.004-0.004=0.000
min0.120-0.120=0.000
max0.132-0.131=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.305=0.000
σ1.188-1.195=-0.007
min1005.768-1005.741=0.027
max1011.289-1011.318=-0.028
mean1045.950-1048.300=-2.350
σ311.597-305.990=5.607
min572.000-584.000=-12.000
max1639.000-1642.000=-3.000
mean1.543-1.524=0.019
σ0.087-0.053=0.033
min1.459-1.467=-0.007
max1.741-1.639=0.103

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.423-0.412=0.011
σ0.159-0.133=0.026
min0.329-0.319=0.010
max0.706-0.646=0.060
name=error_case.art
mean2.337-2.338=-0.000
σ0.003-0.002=0.000
min2.336
max2.341
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.918-0.889=0.030
σ0.154-0.106=0.048
min0.836-0.824=0.012
max1.192-1.075=0.117
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.552-0.542=0.009
σ0.055-0.051=0.005
min0.510-0.505=0.005
max0.648-0.629=0.019
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.855-0.851=0.003
σ0.036-0.041=-0.006
min0.823-0.818=0.004
max0.916-0.923=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.001
σ0.032-0.034=-0.001
min964.086
max964.167-964.169=-0.002
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.818-0.804=0.014
σ0.020-0.046=-0.025
min0.804-0.727=0.077
max0.852-0.850=0.002
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=-0.000
σ0.008-0.008=-0.000
min884.703
max884.722-884.723=-0.000
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.727-0.692=0.035
σ0.026-0.048=-0.021
min0.681-0.613=0.068
max0.747-0.739=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean3.525-3.401=0.124
σ0.086-0.306=-0.220
min3.375-2.669=0.705
max3.844-3.973=-0.129
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean3.499-3.550=-0.051
σ0.069-0.068=0.001
min3.378-3.405=-0.028
max3.722-3.762=-0.040
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.742-0.496=0.246
σ0.017-0.083=-0.066
min0.714-0.300=0.414
max0.852-0.608=0.243
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.627-0.282=0.345
σ0.103-0.007=0.096
min0.490-0.269=0.221
max0.835-0.320=0.515

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.365-296.038=0.326
σ0.242-0.277=-0.035
min296.181-295.792=0.389
max297.026-296.778=0.248
mean1917.000-1902.000=15.000
σ0.000
min1917.000-1902.000=15.000
max1917.000-1902.000=15.000
mean0.561-0.579=-0.018
σ0.059-0.044=0.015
min0.497-0.508=-0.011
max0.693-0.657=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.692=0.001
σ0.036-0.037=-0.001
min284.644-284.646=-0.002
max284.732-284.732=0.000
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.400-0.397=0.002
σ0.010-0.010=-0.001
min0.390-0.390=-0.001
max0.411-0.414=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.082=-0.002
σ0.109-0.120=-0.011
min1294.962-1294.955=0.007
max1295.216-1295.266=-0.051
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean1.912-1.907=0.006
σ0.097-0.092=0.005
min1.804-1.819=-0.015
max2.005-2.030=-0.026
iters=5
new-facts=6402
prior-facts=1
mean1537.932-1537.947=-0.015
σ4.055-4.019=0.037
min1535.899-1535.932=-0.032
max1545.178-1545.130=0.048
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean2.274-2.176=0.098
σ0.247-0.147=0.100
min1.988-2.040=-0.052
max2.528-2.393=0.136
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.987=0.001
σ0.055-0.052=0.002
min1856.936-1856.935=0.001
max1857.070-1857.057=0.013
mean1774.800-1770.600=4.200
σ137.718-128.467=9.251
min1639.000-1642.000=-3.000
max1917.000-1902.000=15.000
mean3.010-3.049=-0.039
σ0.310-0.203=0.107
min2.694-2.856=-0.162
max3.523-3.383=0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.195=0.006
σ0.301-0.266=0.035
min0.938-0.950=-0.012
max1.695-1.622=0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.124-446.124=-0.000
σ577.890-577.890=0.000
min157.177-157.174=0.003
max1312.960-1312.960=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean0.540-0.530=0.010
σ0.561-0.534=0.026
min0.258-0.260=-0.002
max1.381-1.331=0.050
policies=20
mean1572.098-1572.099=-0.001
σ0.363-0.361=0.001
min1571.855-1571.851=0.004
max1572.637-1572.636=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean2.635-2.635=-0.001
σ0.026-0.006=0.020
min2.607-2.628=-0.022
max2.658-2.643=0.015
policies=200
mean15729.075-15729.077=-0.002
σ0.071-0.065=0.006
min15729.006-15729.006=0.000
max15729.156-15729.156=-0.000
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1642.000=-3.000
σ0.000
min1639.000-1642.000=-3.000
max1639.000-1642.000=-3.000
mean26.688-26.539=0.149
σ0.272-0.146=0.126
min26.546-26.385=0.161
max27.096-26.738=0.359