Compare commits

Home / Compare ed6075be .. ac7efd48

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.367=0.003
min53.906-53.912=-0.007
max55.105-55.098=0.007
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.139-0.138=0.000
σ0.006-0.004=0.001
min0.131-0.132=-0.001
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.007-0.007=-0.000
min43.386-43.384=0.002
max43.408-43.403=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.122=-0.000
σ0.005-0.004=0.001
min0.115-0.116=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.973-1006.978=-0.005
σ0.911-0.873=0.038
min1006.507-1006.482=0.025
max1010.764-1010.595=0.169
mean1050.450-1047.200=3.250
σ307.589-314.257=-6.668
min577.000
max1650.000-1644.000=6.000
mean1.546-1.528=0.018
σ0.087-0.055=0.032
min1.470-1.460=0.010
max1.813-1.650=0.163

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.432-0.399=0.033
σ0.118-0.095=0.023
min0.340-0.342=-0.002
max0.630-0.564=0.066
name=error_case.art
mean2.339-2.339=-0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.878-0.885=-0.007
σ0.088-0.088=0.000
min0.822-0.821=0.002
max1.034-1.039=-0.005
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.000
min1.522
max1.526-1.525=0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.533-0.531=0.002
σ0.049-0.058=-0.009
min0.487-0.483=0.004
max0.615-0.624=-0.009
name=nested_use.art
mean2.361-2.362=-0.000
σ0.002-0.002=0.000
min2.360
max2.365-2.364=0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.854-0.844=0.010
σ0.043-0.038=0.005
min0.816-0.801=0.015
max0.922-0.904=0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.835=-0.002
σ0.030-0.031=-0.001
min964.802-964.811=-0.009
max964.876-964.888=-0.012
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.831-0.785=0.045
σ0.023-0.032=-0.010
min0.802-0.738=0.063
max0.856-0.815=0.040
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=-0.000
σ0.006-0.007=-0.002
min885.505-885.504=0.001
max885.520-885.521=-0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.667-0.697=-0.031
σ0.061-0.071=-0.010
min0.600-0.603=-0.003
max0.737-0.752=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean4.248-4.279=-0.032
σ0.079-0.079=0.000
min4.099-4.160=-0.061
max4.532-4.554=-0.022
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean4.243-4.238=0.005
σ0.061-0.056=0.005
min4.123-4.110=0.013
max4.502-4.393=0.108
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.748-0.753=-0.005
σ0.018-0.017=0.001
min0.715-0.724=-0.009
max0.861-0.850=0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.710-0.713=-0.003
σ0.014-0.015=-0.001
min0.681-0.683=-0.002
max0.780-0.777=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.577-295.655=-0.078
σ0.228-0.205=0.023
min295.417-295.506=-0.089
max296.201-296.216=-0.015
mean2016.000-1930.000=86.000
σ0.000
min2016.000-1930.000=86.000
max2016.000-1930.000=86.000
mean0.540-0.574=-0.034
σ0.028-0.052=-0.024
min0.500-0.499=0.001
max0.574-0.694=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.416-285.410=0.006
σ0.035-0.034=0.001
min285.370-285.367=0.003
max285.451-285.446=0.005
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.392-0.387=0.005
σ0.008-0.010=-0.002
min0.384-0.378=0.006
max0.403-0.398=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.803-1295.795=0.008
σ0.104-0.102=0.002
min1295.677-1295.678=-0.002
max1295.923-1295.912=0.012
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean1.916-1.892=0.024
σ0.096-0.085=0.012
min1.839-1.789=0.050
max2.077-1.977=0.100
iters=5
new-facts=6402
prior-facts=1
mean1539.944-1539.984=-0.040
σ6.864-6.841=0.023
min1536.647-1536.742=-0.094
max1552.217-1552.216=0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean2.372-2.432=-0.060
σ0.119-0.277=-0.158
min2.202-2.160=0.042
max2.494-2.829=-0.335
iters=5
new-facts=6402
prior-facts=6402
mean1857.699-1857.709=-0.011
σ0.063-0.051=0.012
min1857.616-1857.660=-0.043
max1857.777-1857.779=-0.002
mean1785.400-1780.800=4.600
σ158.581-143.670=14.910
min1650.000-1644.000=6.000
max2016.000-1930.000=86.000
mean3.113-3.005=0.108
σ0.261-0.126=0.135
min2.878-2.853=0.025
max3.510-3.168=0.342

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.352-1.325=0.027
σ0.292-0.216=0.076
min1.109-1.105=0.004
max1.793-1.686=0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.002
σ580.934-580.934=0.000
min155.271-155.272=-0.002
max1317.140-1317.142=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.541-0.564=-0.023
σ0.569-0.603=-0.034
min0.255-0.262=-0.007
max1.394-1.468=-0.074
policies=20
mean1552.965-1552.979=-0.013
σ0.315-0.333=-0.018
min1552.747-1552.750=-0.003
max1553.433-1553.473=-0.040
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean2.575-2.592=-0.017
σ0.023-0.011=0.012
min2.550-2.579=-0.029
max2.603-2.601=0.001
policies=200
mean15538.010-15537.969=0.041
σ0.104-0.053=0.051
min15537.879-15537.891=-0.012
max15538.132-15538.003=0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean26.176-26.116=0.061
σ0.079-0.163=-0.084
min26.115-25.921=0.194
max26.287-26.319=-0.032