Compare commits

Home / Compare 9e1a8ddb .. c4f1c620

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-54.045=0.004
σ0.373-0.371=0.002
min53.904-53.903=0.001
max55.109-55.101=0.008
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.147-0.138=0.009
σ0.011-0.006=0.004
min0.137-0.130=0.007
max0.167-0.150=0.016
cache=y
dps=1
iters=10
policies=100
mean43.386-43.383=0.003
σ0.009-0.007=0.002
min43.377-43.369=0.009
max43.406-43.395=0.012
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.128-0.120=0.008
σ0.009-0.004=0.005
min0.120-0.114=0.006
max0.148-0.128=0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1006.983=-0.001
σ0.871-0.853=0.018
min1006.480-1006.476=0.004
max1010.582-1010.496=0.087
mean1051.700-1051.850=-0.150
σ319.782-307.554=12.229
min575.000-577.000=-2.000
max1620.000-1651.000=-31.000
mean1.553-1.544=0.009
σ0.066-0.053=0.013
min1.474-1.477=-0.004
max1.768-1.684=0.084

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.410-0.411=-0.000
σ0.141-0.144=-0.002
min0.325-0.328=-0.004
max0.661-0.665=-0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.884-0.888=-0.004
σ0.100-0.084=0.015
min0.823-0.829=-0.006
max1.060-1.036=0.024
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.540-0.529=0.011
σ0.056-0.047=0.009
min0.500-0.489=0.010
max0.636-0.603=0.033
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.846-0.847=-0.001
σ0.041-0.034=0.008
min0.817-0.822=-0.004
max0.916-0.904=0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.000
σ0.023-0.026=-0.003
min964.805-964.802=0.004
max964.862-964.862=0.000
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.827-0.809=0.018
σ0.038-0.040=-0.001
min0.770-0.755=0.015
max0.856-0.856=-0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.009-0.006=0.003
min885.504
max885.524-885.519=0.005
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.702-0.742=-0.039
σ0.030-0.010=0.020
min0.664-0.726=-0.062
max0.739-0.754=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean4.222-4.232=-0.011
σ0.091-0.083=0.008
min4.041-4.111=-0.070
max4.569-4.570=-0.001
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean4.211-4.221=-0.010
σ0.095-0.094=0.001
min4.059-4.077=-0.018
max4.719-4.511=0.208
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.737-0.743=-0.006
σ0.027-0.018=0.008
min0.528-0.704=-0.176
max0.835-0.868=-0.033
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.701-0.702=-0.001
σ0.014-0.015=-0.001
min0.672-0.668=0.004
max0.780-0.776=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.737-295.494=0.244
σ0.223-0.250=-0.028
min295.571-295.362=0.208
max296.356-296.197=0.159
mean2046.000-1949.000=97.000
σ0.000
min2046.000-1949.000=97.000
max2046.000-1949.000=97.000
mean0.548-0.549=-0.001
σ0.029-0.043=-0.013
min0.505-0.502=0.003
max0.579-0.596=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.413=-0.004
σ0.037-0.036=0.001
min285.363-285.364=-0.000
max285.446-285.451=-0.005
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.395-0.390=0.005
σ0.008-0.008=0.000
min0.388-0.383=0.006
max0.408-0.398=0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.800-1295.773=0.028
σ0.114-0.096=0.019
min1295.673-1295.660=0.013
max1295.942-1295.903=0.039
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean1.917-1.931=-0.013
σ0.099-0.107=-0.007
min1.806-1.805=0.001
max2.052-2.089=-0.037
iters=5
new-facts=6402
prior-facts=1
mean1539.933-1539.917=0.016
σ6.875-6.891=-0.016
min1536.654-1536.587=0.067
max1552.226-1552.238=-0.012
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean2.306-2.281=0.025
σ0.168-0.184=-0.016
min2.110-2.065=0.044
max2.476-2.560=-0.084
iters=5
new-facts=6402
prior-facts=6402
mean1857.712-1857.703=0.009
σ0.056-0.052=0.004
min1857.656-1857.643=0.013
max1857.784-1857.767=0.017
mean1783.400-1769.600=13.800
σ184.268-123.034=61.235
min1620.000-1651.000=-31.000
max2046.000-1949.000=97.000
mean2.891-2.953=-0.062
σ0.082-0.087=-0.005
min2.826-2.868=-0.042
max3.014-3.082=-0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.408-1.419=-0.011
σ0.241-0.206=0.035
min1.259-1.230=0.029
max1.827-1.734=0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.001
σ580.934-580.934=-0.000
min155.271-155.272=-0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean0.536-0.553=-0.018
σ0.546-0.582=-0.037
min0.258-0.258=0.000
max1.354-1.427=-0.073
policies=20
mean1552.978-1552.991=-0.013
σ0.339-0.332=0.007
min1552.742-1552.761=-0.019
max1553.481-1553.484=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean2.607-2.597=0.010
σ0.013-0.036=-0.023
min2.590-2.543=0.047
max2.620-2.620=0.000
policies=200
mean15538.039-15538.031=0.008
σ0.111-0.066=0.044
min15537.933-15537.966=-0.034
max15538.194-15538.114=0.080
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1651.000=-31.000
σ0.000
min1620.000-1651.000=-31.000
max1620.000-1651.000=-31.000
mean26.254-26.349=-0.096
σ0.037-0.171=-0.134
min26.209-26.133=0.075
max26.290-26.549=-0.259