Compare commits

Home / Compare 45880858 .. 77d01fbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.370-0.371=-0.001
min53.878-53.873=0.005
max55.067-55.069=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.141-0.140=0.001
σ0.004-0.004=-0.001
min0.136-0.136=0.001
max0.146-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.006-0.005=0.001
min43.315-43.314=0.001
max43.335-43.334=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.123-0.119=0.004
σ0.004-0.002=0.001
min0.120-0.115=0.005
max0.128-0.122=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.309=-0.000
σ1.180-1.160=0.020
min1005.743-1005.750=-0.007
max1011.250-1011.165=0.085
mean1048.100-1046.500=1.600
σ303.966-313.135=-9.169
min596.000-597.000=-1.000
max1638.000-1641.000=-3.000
mean1.549-1.538=0.011
σ0.085-0.081=0.004
min1.471-1.467=0.004
max1.803-1.780=0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.412-0.410=0.002
σ0.121-0.129=-0.008
min0.346-0.332=0.014
max0.627-0.639=-0.012
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.885-0.882=0.003
σ0.102-0.100=0.003
min0.796-0.813=-0.018
max1.061-1.056=0.005
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.538-0.546=-0.008
σ0.051-0.045=0.006
min0.498-0.501=-0.003
max0.626-0.617=0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.844-0.847=-0.003
σ0.040-0.039=0.000
min0.812-0.808=0.005
max0.913-0.910=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.034-0.034=0.000
min964.086-964.086=-0.000
max964.170-964.170=-0.000
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.843-0.826=0.017
σ0.023-0.047=-0.024
min0.803-0.746=0.057
max0.859-0.857=0.001
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.007=0.000
min884.705
max884.721-884.720=0.001
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.713-0.719=-0.006
σ0.040-0.031=0.008
min0.643-0.670=-0.027
max0.741-0.743=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.721=-0.002
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean4.265-4.233=0.032
σ0.084-0.097=-0.013
min4.120-4.100=0.020
max4.681-4.577=0.104
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean4.223-4.206=0.017
σ0.065-0.084=-0.019
min4.050-4.089=-0.039
max4.372-4.537=-0.165
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.738-0.744=-0.006
σ0.019-0.018=0.001
min0.704-0.714=-0.010
max0.865-0.858=0.007
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.701-0.535=0.166
σ0.015-0.078=-0.063
min0.673-0.482=0.191
max0.790-0.801=-0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.245-296.098=0.147
σ0.252-0.261=-0.009
min295.945-295.896=0.049
max296.887-296.800=0.087
mean1907.000-1909.000=-2.000
σ0.000
min1907.000-1909.000=-2.000
max1907.000-1909.000=-2.000
mean0.584-0.578=0.006
σ0.044-0.061=-0.017
min0.512-0.503=0.009
max0.691-0.713=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.691=0.002
σ0.036-0.037=-0.002
min284.643-284.641=0.002
max284.731-284.734=-0.003
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.397-0.391=0.007
σ0.009-0.007=0.003
min0.385-0.386=-0.000
max0.405-0.402=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.087=-0.003
σ0.109-0.123=-0.014
min1294.960-1294.957=0.003
max1295.215-1295.238=-0.023
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean1.885-1.925=-0.039
σ0.066-0.104=-0.038
min1.809-1.813=-0.004
max1.956-2.043=-0.087
iters=5
new-facts=6402
prior-facts=1
mean1539.193-1539.182=0.011
σ6.868-6.839=0.030
min1535.927-1535.937=-0.010
max1551.474-1551.412=0.062
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean2.288-2.213=0.075
σ0.162-0.186=-0.024
min2.107-2.029=0.079
max2.496-2.466=0.030
iters=5
new-facts=6402
prior-facts=6402
mean1856.993-1856.991=0.002
σ0.052-0.056=-0.004
min1856.940-1856.927=0.012
max1857.066-1857.068=-0.002
mean1773.800-1775.200=-1.400
σ130.972-131.218=-0.246
min1638.000-1641.000=-3.000
max1907.000-1909.000=-2.000
mean3.122-3.074=0.048
σ0.382-0.282=0.100
min2.839-2.864=-0.026
max3.789-3.562=0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.218=-0.011
σ0.283-0.328=-0.045
min0.944-0.930=0.014
max1.669-1.766=-0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.000
σ581.213-581.212=0.001
min157.177-157.179=-0.002
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean0.528-0.546=-0.017
σ0.535-0.571=-0.036
min0.259-0.256=0.003
max1.330-1.402=-0.072
policies=20
mean1572.116-1572.108=0.007
σ0.374-0.363=0.012
min1571.867-1571.864=0.003
max1572.672-1572.648=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean2.657-2.633=0.024
σ0.047-0.015=0.032
min2.617-2.622=-0.005
max2.723-2.654=0.069
policies=200
mean15729.081-15729.064=0.017
σ0.150-0.036=0.114
min15728.953-15729.028=-0.075
max15729.289-15729.113=0.176
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1641.000=-3.000
σ0.000
min1638.000-1641.000=-3.000
max1638.000-1641.000=-3.000
mean26.566-26.492=0.074
σ0.040-0.183=-0.143
min26.513-26.362=0.150
max26.599-26.763=-0.164