Compare commits

Home / Compare cb95e84a .. 06207a15

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.056=-0.010
σ0.370-0.369=0.001
min53.900-53.917=-0.017
max55.097-55.105=-0.008
mean414.700-413.000=1.700
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.140-0.140=0.000
σ0.003-0.004=-0.001
min0.137-0.136=0.001
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.394=-0.010
σ0.007-0.007=0.000
min43.371-43.387=-0.016
max43.396-43.404=-0.008
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.122-0.121=0.000
σ0.004-0.004=0.000
min0.116-0.116=0.001
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.981=-0.002
σ0.864-0.871=-0.007
min1006.508-1006.484=0.024
max1010.554-1010.586=-0.032
mean1052.700-1042.650=10.050
σ319.840-314.008=5.832
min576.000-573.000=3.000
max1620.000-1637.000=-17.000
mean1.563-1.568=-0.005
σ0.129-0.093=0.036
min1.479-1.467=0.012
max2.084-1.826=0.259

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.438-0.427=0.011
σ0.182-0.147=0.035
min0.337-0.336=0.001
max0.762-0.688=0.074
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.913-0.921=-0.008
σ0.145-0.087=0.058
min0.825-0.841=-0.015
max1.169-1.047=0.122
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.544-0.533=0.011
σ0.042-0.051=-0.008
min0.512-0.487=0.025
max0.615-0.614=0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.850-0.840=0.010
σ0.029-0.035=-0.006
min0.822-0.807=0.015
max0.895-0.900=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.002
σ0.025-0.030=-0.005
min964.802
max964.862-964.876=-0.014
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.803-0.823=-0.019
σ0.019-0.027=-0.008
min0.772-0.800=-0.029
max0.821-0.854=-0.033
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.000
σ0.005-0.009=-0.004
min885.505-885.504=0.001
max885.518-885.523=-0.005
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.707-0.723=-0.016
σ0.044-0.017=0.027
min0.646-0.696=-0.050
max0.746-0.736=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean4.251-4.208=0.043
σ0.088-0.081=0.007
min4.086-4.085=0.001
max4.524-4.522=0.002
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean4.256-4.208=0.048
σ0.088-0.076=0.012
min4.096-4.072=0.025
max4.660-4.434=0.226
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.653-0.738=-0.084
σ0.105-0.018=0.087
min0.519-0.701=-0.182
max0.887-0.847=0.040
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.511-0.693=-0.183
σ0.028-0.015=0.013
min0.481-0.661=-0.180
max0.752-0.769=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.651-295.674=-0.023
σ0.231-0.154=0.077
min295.496-295.456=0.039
max296.283-296.045=0.238
mean1924.000-1890.000=34.000
σ0.000
min1924.000-1890.000=34.000
max1924.000-1890.000=34.000
mean0.586-0.574=0.012
σ0.025-0.048=-0.023
min0.538-0.511=0.028
max0.636-0.661=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.416=-0.003
σ0.036-0.031=0.005
min285.371-285.382=-0.011
max285.455-285.451=0.004
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.395-0.390=0.005
σ0.007-0.010=-0.003
min0.388-0.381=0.008
max0.404-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.793=0.003
σ0.114-0.100=0.014
min1295.667-1295.685=-0.018
max1295.931-1295.909=0.022
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean1.882-1.907=-0.025
σ0.064-0.089=-0.026
min1.824-1.815=0.009
max1.978-2.019=-0.041
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.936=-0.012
σ6.875-6.917=-0.042
min1536.635-1536.562=0.072
max1552.218-1552.302=-0.084
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean2.267-2.403=-0.136
σ0.255-0.343=-0.089
min2.050-2.059=-0.008
max2.666-2.855=-0.189
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.702=0.008
σ0.053-0.053=0.000
min1857.645-1857.653=-0.008
max1857.775-1857.780=-0.005
mean1779.800-1770.200=9.600
σ145.819-122.013=23.806
min1620.000-1637.000=-17.000
max1924.000-1890.000=34.000
mean3.128-3.047=0.081
σ0.310-0.225=0.085
min2.857-2.858=-0.001
max3.656-3.432=0.224

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.385-1.438=-0.053
σ0.200-0.288=-0.088
min1.257-1.101=0.156
max1.733-1.844=-0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.739=0.001
σ580.934-580.934=0.000
min155.271-155.271=0.000
max1317.141-1317.141=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean0.556-0.543=0.013
σ0.597-0.571=0.026
min0.255-0.255=0.000
max1.451-1.399=0.053
policies=20
mean1552.990-1552.969=0.021
σ0.327-0.319=0.007
min1552.763-1552.748=0.015
max1553.475-1553.443=0.032
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean2.583-2.577=0.006
σ0.013-0.008=0.005
min2.573-2.569=0.004
max2.601-2.588=0.013
policies=200
mean15537.960-15537.995=-0.034
σ0.096-0.074=0.022
min15537.859-15537.908=-0.049
max15538.051-15538.088=-0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1637.000=-17.000
σ0.000
min1620.000-1637.000=-17.000
max1620.000-1637.000=-17.000
mean26.286-26.182=0.104
σ0.032-0.246=-0.215
min26.248-26.051=0.198
max26.317-26.551=-0.234