Compare commits

Home / Compare 03254bda .. ee6a9af3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.371-0.369=0.002
min53.912-53.917=-0.005
max55.110-55.105=0.005
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.138-0.140=-0.002
σ0.006-0.004=0.002
min0.131-0.136=-0.005
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.007-0.007=0.000
min43.382-43.387=-0.005
max43.406-43.404=0.002
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.124-0.121=0.002
σ0.003-0.004=-0.001
min0.120-0.116=0.005
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.975-1006.981=-0.006
σ0.881-0.871=0.009
min1006.502-1006.484=0.019
max1010.625-1010.586=0.039
mean1048.550-1042.650=5.900
σ303.679-314.008=-10.330
min579.000-573.000=6.000
max1663.000-1637.000=26.000
mean1.573-1.568=0.006
σ0.091-0.093=-0.001
min1.494-1.467=0.026
max1.799-1.826=-0.027

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.415-0.427=-0.012
σ0.135-0.147=-0.012
min0.334-0.336=-0.001
max0.654-0.688=-0.034
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.002
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.885-0.921=-0.036
σ0.084-0.087=-0.003
min0.826-0.841=-0.014
max1.031-1.047=-0.017
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.540-0.533=0.007
σ0.047-0.051=-0.004
min0.500-0.487=0.014
max0.617-0.614=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.848-0.840=0.008
σ0.038-0.035=0.002
min0.809-0.807=0.001
max0.910-0.900=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.001
σ0.025-0.030=-0.006
min964.802
max964.862-964.876=-0.014
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.786-0.823=-0.037
σ0.080-0.027=0.053
min0.663-0.800=-0.137
max0.859-0.854=0.005
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.000
σ0.006-0.009=-0.003
min885.504
max885.519-885.523=-0.004
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.739-0.723=0.017
σ0.009-0.017=-0.008
min0.725-0.696=0.028
max0.746-0.736=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.721=0.002
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean4.219-4.208=0.011
σ0.102-0.081=0.021
min4.084-4.085=-0.001
max4.746-4.522=0.224
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean4.223-4.208=0.014
σ0.081-0.076=0.005
min4.083-4.072=0.011
max4.428-4.434=-0.007
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.740-0.738=0.002
σ0.017-0.018=-0.001
min0.704-0.701=0.003
max0.847-0.847=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.699-0.693=0.006
σ0.027-0.015=0.013
min0.558-0.661=-0.103
max0.812-0.769=0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.571-295.674=-0.103
σ0.247-0.154=0.093
min295.410-295.456=-0.046
max296.253-296.045=0.208
mean2069.000-1890.000=179.000
σ0.000
min2069.000-1890.000=179.000
max2069.000-1890.000=179.000
mean0.540-0.574=-0.034
σ0.034-0.048=-0.014
min0.487-0.511=-0.024
max0.575-0.661=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.416=-0.011
σ0.031-0.031=0.001
min285.362-285.382=-0.019
max285.441-285.451=-0.010
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.396-0.390=0.006
σ0.007-0.010=-0.003
min0.388-0.381=0.008
max0.403-0.404=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.793=0.003
σ0.107-0.100=0.008
min1295.682-1295.685=-0.003
max1295.923-1295.909=0.015
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean1.893-1.907=-0.014
σ0.100-0.089=0.010
min1.798-1.815=-0.017
max2.039-2.019=0.020
iters=5
new-facts=6402
prior-facts=1
mean1539.920-1539.936=-0.016
σ6.880-6.917=-0.037
min1536.647-1536.562=0.085
max1552.224-1552.302=-0.078
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean2.242-2.403=-0.162
σ0.221-0.343=-0.122
min2.047-2.059=-0.012
max2.565-2.855=-0.290
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1857.702=0.006
σ0.062-0.053=0.009
min1857.648-1857.653=-0.005
max1857.793-1857.780=0.013
mean1809.600-1770.200=39.400
σ175.476-122.013=53.463
min1663.000-1637.000=26.000
max2069.000-1890.000=179.000
mean2.819-3.047=-0.228
σ0.167-0.225=-0.058
min2.600-2.858=-0.258
max2.970-3.432=-0.462

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.407-1.438=-0.031
σ0.293-0.288=0.005
min1.100-1.101=-0.001
max1.888-1.844=0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.739=0.002
σ580.934-580.934=-0.000
min155.272-155.271=0.002
max1317.142-1317.141=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean0.537-0.543=-0.005
σ0.562-0.571=-0.008
min0.254-0.255=-0.001
max1.381-1.399=-0.018
policies=20
mean1553.004-1552.969=0.035
σ0.350-0.319=0.031
min1552.767-1552.748=0.019
max1553.525-1553.443=0.082
mean920.000
σ0.000
min920.000
max920.000
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean2.628-2.577=0.051
σ0.079-0.008=0.071
min2.548-2.569=-0.021
max2.716-2.588=0.128
policies=200
mean15537.965-15537.995=-0.029
σ0.167-0.074=0.093
min15537.868-15537.908=-0.040
max15538.215-15538.088=0.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1663.000-1637.000=26.000
σ0.000
min1663.000-1637.000=26.000
max1663.000-1637.000=26.000
mean26.024-26.182=-0.157
σ0.058-0.246=-0.188
min25.963-26.051=-0.088
max26.080-26.551=-0.471