Compare commits

Home / Compare 688c4be0 .. 5e5afe61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.000
σ0.368-0.369=-0.001
min53.910-53.917=-0.007
max55.101-55.105=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.140-0.140=0.000
σ0.004-0.004=0.000
min0.136-0.136=0.000
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.001
σ0.007-0.007=0.000
min43.382-43.387=-0.005
max43.403-43.404=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.001
min0.118-0.116=0.003
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.981=-0.000
σ0.861-0.871=-0.011
min1006.482-1006.484=-0.002
max1010.535-1010.586=-0.050
mean1051.600-1042.650=8.950
σ310.935-314.008=-3.073
min555.000-573.000=-18.000
max1649.000-1637.000=12.000
mean1.547-1.568=-0.021
σ0.071-0.093=-0.022
min1.482-1.467=0.014
max1.761-1.826=-0.065

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.421-0.427=-0.006
σ0.142-0.147=-0.004
min0.344-0.336=0.008
max0.674-0.688=-0.014
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.875-0.921=-0.046
σ0.084-0.087=-0.003
min0.815-0.841=-0.026
max1.022-1.047=-0.025
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.533-0.533=-0.000
σ0.052-0.051=0.001
min0.477-0.487=-0.010
max0.617-0.614=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.843-0.840=0.003
σ0.039-0.035=0.003
min0.815-0.807=0.007
max0.909-0.900=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.830=0.007
σ0.031-0.030=0.001
min964.811-964.802=0.009
max964.889-964.876=0.013
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.804-0.823=-0.019
σ0.018-0.027=-0.009
min0.777-0.800=-0.023
max0.826-0.854=-0.029
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.004-0.009=-0.005
min885.508-885.504=0.003
max885.517-885.523=-0.006
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.693-0.723=-0.029
σ0.063-0.017=0.046
min0.588-0.696=-0.108
max0.748-0.736=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean4.197-4.208=-0.011
σ0.075-0.081=-0.006
min4.029-4.085=-0.056
max4.505-4.522=-0.017
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean4.198-4.208=-0.010
σ0.073-0.076=-0.003
min4.059-4.072=-0.013
max4.421-4.434=-0.013
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.738-0.738=0.001
σ0.019-0.018=0.001
min0.703-0.701=0.003
max0.870-0.847=0.024
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.696-0.693=0.003
σ0.014-0.015=-0.001
min0.671-0.661=0.009
max0.781-0.769=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.480-295.674=-0.194
σ0.259-0.154=0.105
min295.322-295.456=-0.134
max296.201-296.045=0.157
mean2019.000-1890.000=129.000
σ0.000
min2019.000-1890.000=129.000
max2019.000-1890.000=129.000
mean0.532-0.574=-0.042
σ0.039-0.048=-0.009
min0.495-0.511=-0.015
max0.598-0.661=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.416=-0.004
σ0.043-0.031=0.012
min285.354-285.382=-0.028
max285.455-285.451=0.004
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.388-0.390=-0.002
σ0.008-0.010=-0.002
min0.380-0.381=-0.001
max0.399-0.404=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.806-1295.793=0.013
σ0.112-0.100=0.013
min1295.677-1295.685=-0.008
max1295.947-1295.909=0.038
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean1.876-1.907=-0.031
σ0.086-0.089=-0.003
min1.805-1.815=-0.010
max2.018-2.019=-0.001
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.936=-0.020
σ6.867-6.917=-0.049
min1536.654-1536.562=0.092
max1552.197-1552.302=-0.105
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean2.210-2.403=-0.193
σ0.180-0.343=-0.163
min2.037-2.059=-0.022
max2.429-2.855=-0.426
iters=5
new-facts=6402
prior-facts=6402
mean1857.708-1857.702=0.007
σ0.055-0.053=0.002
min1857.649-1857.653=-0.005
max1857.776-1857.780=-0.004
mean1776.000-1770.200=5.800
σ162.779-122.013=40.766
min1649.000-1637.000=12.000
max2019.000-1890.000=129.000
mean3.028-3.047=-0.019
σ0.332-0.225=0.107
min2.828-2.858=-0.030
max3.613-3.432=0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.438=-0.123
σ0.320-0.288=0.032
min1.104-1.101=0.002
max1.872-1.844=0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.001
σ580.934-580.934=-0.000
min155.272-155.271=0.001
max1317.142-1317.141=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean0.526-0.543=-0.017
σ0.529-0.571=-0.041
min0.256-0.255=0.001
max1.320-1.399=-0.079
policies=20
mean1552.986-1552.969=0.017
σ0.323-0.319=0.003
min1552.761-1552.748=0.013
max1553.465-1553.443=0.022
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean2.586-2.577=0.009
σ0.018-0.008=0.010
min2.568-2.569=-0.002
max2.604-2.588=0.016
policies=200
mean15537.947-15537.995=-0.048
σ0.070-0.074=-0.003
min15537.875-15537.908=-0.032
max15538.014-15538.088=-0.074
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1637.000=12.000
σ0.000
min1649.000-1637.000=12.000
max1649.000-1637.000=12.000
mean26.096-26.182=-0.085
σ0.184-0.246=-0.062
min25.939-26.051=-0.112
max26.363-26.551=-0.188