Compare commits

Home / Compare 6460cbfd .. b3bae400

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.371=-0.000
min53.869-53.872=-0.003
max55.069-55.070=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.140-0.138=0.002
σ0.004-0.004=-0.001
min0.136-0.131=0.005
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.324=-0.001
σ0.006-0.007=-0.001
min43.311-43.309=0.002
max43.333-43.333=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.123=-0.002
σ0.002-0.010=-0.008
min0.119-0.114=0.005
max0.126-0.141=-0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.313-1006.308=0.005
σ1.153-1.185=-0.032
min1005.740-1005.768=-0.027
max1011.135-1011.269=-0.134
mean1053.150-1045.000=8.150
σ315.938-311.721=4.218
min564.000-597.000=-33.000
max1613.000-1634.000=-21.000
mean1.508-1.549=-0.042
σ0.057-0.086=-0.029
min1.451-1.469=-0.018
max1.648-1.762=-0.114

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.417-0.429=-0.012
σ0.137-0.150=-0.013
min0.325-0.329=-0.004
max0.657-0.688=-0.031
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.895-0.910=-0.015
σ0.106-0.166=-0.059
min0.836-0.822=0.014
max1.082-1.204=-0.121
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.559-0.544=0.015
σ0.075-0.060=0.015
min0.497-0.496=0.001
max0.682-0.648=0.035
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.844-0.844=0.001
σ0.043-0.039=0.004
min0.801-0.815=-0.014
max0.907-0.909=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.111=0.004
σ0.034-0.023=0.011
min964.086-964.090=-0.004
max964.170-964.146=0.024
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.815-0.817=-0.002
σ0.035-0.041=-0.007
min0.760-0.750=0.010
max0.854-0.859=-0.005
name=cdr_enhanced_4k_loc.art
mean884.711-884.714=-0.003
σ0.008-0.002=0.006
min884.705-884.712=-0.008
max884.723-884.717=0.006
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.719-0.725=-0.006
σ0.033-0.029=0.004
min0.666-0.680=-0.014
max0.744-0.745=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean4.269-4.301=-0.033
σ0.103-0.096=0.007
min4.115-4.160=-0.046
max4.775-4.937=-0.162
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean4.254-4.280=-0.026
σ0.075-0.119=-0.044
min4.086-3.586=0.500
max4.448-4.531=-0.083
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.731-0.735=-0.005
σ0.017-0.017=0.000
min0.704-0.705=-0.001
max0.847-0.840=0.007
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.697-0.699=-0.002
σ0.015-0.014=0.001
min0.670-0.669=0.001
max0.765-0.781=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.248-296.382=-0.134
σ0.193-0.224=-0.031
min296.047-296.228=-0.181
max296.765-297.006=-0.240
mean1904.000-1902.000=2.000
σ0.000
min1904.000-1902.000=2.000
max1904.000-1902.000=2.000
mean0.583-0.576=0.007
σ0.052-0.044=0.008
min0.533-0.513=0.019
max0.705-0.657=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.696=0.002
σ0.030-0.040=-0.010
min284.664-284.644=0.020
max284.732-284.742=-0.010
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.399-0.407=-0.008
σ0.012-0.003=0.009
min0.384-0.404=-0.020
max0.410-0.411=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.090-1295.079=0.011
σ0.130-0.111=0.018
min1294.960-1294.958=0.002
max1295.268-1295.220=0.048
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean1.894-1.918=-0.024
σ0.093-0.108=-0.015
min1.786-1.799=-0.013
max2.004-2.015=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1539.178-1539.190=-0.012
σ6.846-6.859=-0.013
min1535.926-1535.926=0.000
max1551.421-1551.456=-0.035
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean2.238-2.257=-0.019
σ0.227-0.275=-0.048
min2.018-2.034=-0.017
max2.534-2.686=-0.152
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1856.984=-0.001
σ0.063-0.056=0.007
min1856.910-1856.928=-0.017
max1857.069-1857.065=0.005
mean1765.800-1771.000=-5.200
σ137.347-130.832=6.515
min1613.000-1634.000=-21.000
max1904.000-1902.000=2.000
mean3.049-3.051=-0.002
σ0.338-0.244=0.094
min2.818-2.866=-0.048
max3.648-3.469=0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.123=0.101
σ0.348-0.214=0.134
min0.932-0.936=-0.004
max1.786-1.421=0.364

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.787=-0.000
σ581.212-581.212=0.000
min157.179-157.179=-0.000
max1319.605-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean0.536-0.547=-0.011
σ0.555-0.571=-0.016
min0.258-0.259=-0.002
max1.368-1.404=-0.036
policies=20
mean1572.101-1572.103=-0.002
σ0.349-0.354=-0.005
min1571.866-1571.863=0.003
max1572.620-1572.629=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean2.616-2.630=-0.014
σ0.018-0.009=0.009
min2.598-2.624=-0.025
max2.635-2.644=-0.009
policies=200
mean15728.967-15729.098=-0.130
σ0.117-0.109=0.008
min15728.817-15729.028=-0.211
max15729.090-15729.259=-0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1613.000-1634.000=-21.000
σ0.000
min1613.000-1634.000=-21.000
max1613.000-1634.000=-21.000
mean26.418-26.472=-0.054
σ0.153-0.016=0.137
min26.289-26.448=-0.159
max26.634-26.481=0.152