Automatic Analysis of Lexical Complexity: Evaluating The Linguistic Performance of The National and International Publication

Authors

  • Laily Martin Universitas Andalas, Padang
  • Lucy Suraiya Universitas Andalas, Padang
  • Almaghvirah Chan Universitas Andalas, Padang

DOI:

https://doi.org/10.30983/mj.v3i1.6280

Keywords:

EFL writers, lexical complexity, Indonesia

Abstract

This research is a kind of a comparison study that deals with lexical complexity in the Indonesian scholars’ journal articles. The analysis covers 98 journal articles from the national and international publication using 25 lexical complexity indices. Results of the research showed that the journal articles of international journals have higher mean scores of lexical complexity indices than the national, but significant differences only occurred in the indices for the lexical sophistication and lexical variation, particularly the type-token ratio and verb variation. This may show the performance gap between the two publications from Indonesian academics as to share the lexical characteristic of the international publication surpass the national.

Studi komparatif ini membahas lexical complexity dari artikel-artikel jurnal yang dihasilkan para penulis Indonesia. Analisis dilakukan terhadap 98 artikel jurnal terbitan nasional dan internasional dengan memakai 25 indeks lexical complexity. Hasil penelitian memperlihatkan bahwa artikel-artikel jurnal terbitan internasional memiliki rerata indeks lexical complexity lebih tinggi dibanding terbitan nasional, namun perbedaan signifikan hanya terdapat pada indeks-indeks lexical sophistication dan lexical variation, terutama pada rasio type-token dan verb variation. Hal ini bisa jadi merefleksikan adanya performance gap antara kedua kelompok publikasi yang dihasilkan para akademis Indonesia, sekaligus memperlihatkan bahwa karakteristik leksikal dari publikasi internasional lebih tinggi dibanding publikasi nasional

 

References

Ahmed, K. (2019). Academic integrity: Challenges and strategies for Asia and the Middle East, Accountability in Research, 27(5), 256-270. https://doi.org/10.1080/08989621.2019.1646646

Allaw, E. & McDonough, K. (2019). The effect of task sequencing on second language written lexical complexity, accuracy, and fluency. System, 85,[102104]. https://doi.org/10.1016/j.system.2019.06.008.

Arsyad, S. (2018). Struggling for international publication: the potential rhetorical problems for Indonesian scholars in social sciences and humanities when writing in English. Advances in Social Science. Education and Humanities Research, 301, 469-478.

Arsyad, S., Purwo, B. K., Sukamto, K. E. & Adnan, Z. (2019). Factors hindering Indonesian lecturers from publishing articles in reputable international journals. Journal on English as a Foreign Language, 9(1), 42-70. http://e-journal.iain-palangkaraya.ac.id/index.php/jefl.

Arsyad, S., Zaim, M., & Susyla, D. (2018). Review and citation style in research article introductions: a comparative study between national and international English-medium journals in medical sciences. Discourse and Interaction, 28-51. https://doi.org/10.5817/DI2018-1-28.

Aryadoust, V. (2014). Understanding the growth of ESL paragraph writing skills and its relationships with linguistic features. Educational Psychology. https://doi.org/10.1080/01443410.2014.950946.

Bermani, R. A., Safnil, & Arono. (2017). An analysis of argument structure of research article of English postgraduate program of Bengkulu University published in journal. Journal of Applied Linguistics and Literature, 2(2), 47-64.

Biber, D. & Gray, B. (2010). Challenging stereotypes about academic writing: complexity, elaboration, explicitness. Journal of English for Academic Purposes, 9, 2-20. https://doi.org/10.1016/j.jeap.2010.01.001

Bui, G. (2019). Influence of learners’ prior knowledge, L2 proficiency and pre-task planning on L2 lexical complexity. IRAL- International Review of Applied Linguistics in Language Teaching, 1-25. https://doi.org/10.1515/iral-2018-0244

Çepni, S. B. & Demirel, E. T. (2016). Impact of text-mining and imitating strategies on lexical richness, lexical diversity and general success in second language writing. The Turkish Online Journal of Educational Technology, 15(4), 61-68.

Crosson, A. C., McKeown, M. G., & Ward, A. K. (2019). An innovative approach to assessing depth of knowledge of academic words, Language Assessment Quarterly, 16(2), 196-216. https://doi.org/10.1080/15434303.2019.1612899.

Dabbagh, A. & Enayat, M. J. (2017). The role of vocabulary breadth and depth in predicting second language descriptive writing performance, The Language Learning Journal, 47(5), 575-590. https://doi.org/10.1080/09571736.2017.1335765.

Delić, A. & Jašić, A. J. (2017). Linguistic complexity in high-school students’ EFL writing. ExELL (Explorations in English Language and Linguistics), 5(2), 122-146. https://doi.org/10.2478/exell-2019-000d

Djiwandono, p. I. (2016). Lexical richness in academic papers: a comparison between students’ and lecturers’ essays. Indonesian Journal of Applied Linguistics 5(2), 209-216.

Fergadiotis, G., Wright, H. H., & Geen, S. H. (2015). Psychometric evaluation of lexical diversity indices: assessing length effects. Journal of Speech, Language, and Hearing Research, 58, 840-852. https://doi.org/10.1044/2015_JSLHR-L-14-0280.

Fritz, E. & Ruegg, R. (2013). Rater sensitivity to lexical accuracy, sophistication and range when assessing writing. Assessing Writing, 18(2), 173–81.

Ginting, S. A. (2018). Lexical complexity on descriptive writing of Indonesian male and female EFL learners. International Journal of English Linguistics, 8(3), 297-302. https://doi.org/10.5539/ijel.v8n3p297.

Gonzalez, M. C. (2017). The contribution of lexical diversity to college-level writing. TESOL Journal, 8(4), 899-919. https://doi.org/10.1002/tesj.342

Greidanus, T. & Nienhuis, L. (2001). Testing the quality of word knowledge in L2 by means of word associations: Types of distractors and types of associations. Modern Language Journal, 85, 567–577.

He, T. H., Gou, W. J., Chien, Y. C., Chen, I. S. J., & Chang, S. M. (2013). Multi-faceted Rasch measurement and bias patterns in EFL writing performance assessment. Psychological Reports, 112, 469-485.

Henriksen, B. (1999). Three dimensions of vocabulary development. Studies in Second Language Acquisition, 21, 303–317.

Jasrial, D., Arsyad, S., & Arono (2019). The effect of genre-based mentoring on linguistic feature quality of research article abstracts by Indonesian lecturers in social sciences and humanities. Journal of Applied Linguistics and Literature, 4(2), 146-161. https://doi.org/10.33369/joall.v4i2.7780.

Johnson, M. D. (2017). Cognitive task complexity and L2 written syntactic complexity, accuracy, lexical complexity, and fluency: a research synthesis and meta-analysis. Journal of Second Language Writing, 37, 13-38. https://doi.org/10.1016/j.jslw.2017.06.001.

Khany, K. & Kafshgar, N. B. (2016). Analysing texts through their linguistic properties: a cross-disciplinary study. Journal of Quantitative Linguistics, 23(3), 278-294. https://doi.org/10.1080/09296174.2016.1169848.

Kim, M., Crossley, S. A., & Kyle, K. (2018). Lexical sophistication as a multidimensional phenomenon: relations to second language lexical proficiency, development, and writing quality. The Modern Language Journal, 102(1), 120-141. https://doi.org/10.1111/modl.12447.

Kurniawan, E., Dallyono, R., & Cahyowati, A. (2019). Exploring logical connectors in journals with different indexing levels: A comparison between international and national indexed journals. Indonesian Journal of Applied Linguistics, 9(1), 76-84. https://doi.org/10.17509/ijal.v9i1.16088

Kyle, K. & Crossley, S. (2015). Automatically assessing lexical sophistication: Indices, tools, findings, and application. TESOL Quarterly, 49(4), 757-786.

Kyle, K. & Crossley, S. (2016). The relationship between lexical sophistication and independent and source-based writing. Journal of Second Language Writing, 34, 12-24. https://doi.org/10.1016/j.jslw.2016.10.003.

Laufer, B. & Nation, P. (1995). Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics, 16(3), 307-322.

Laufer, B. & Paribakht, S. (1998). The relationship between passive and active vocabularies: Effects of language learning contexts. Language Learning, 48, 365–391.

Li, J. & Schmitt, N. (2009). The acquisition of lexical phrases in academic writing: a longitudinal case study. Journal of Second Language Writing, 18(2), 85-85-102.

Li, M. & Kirby, J. R. (2012). Breadth and depth of vocabulary knowledge in second language reading. Language Learning, 4, 79-103.

Lu, C., Bu, Y., Dong, X., Wang, J., Larivière, V., Sugimoto, C. R., Paul, L. & Zhang, C. (2019). Analyzing linguistic complexity and scientific impact. Journal of Infometrics, 13, 817-829. https://doi.org/10.1016/j.joi.2019.07.004.

Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474-496. https://doi.org/10.1075/ijcl.15.4.02lu

Lu, X. (2012). The Relationship of lexical richness to the quality of ESL learners' oral narratives. The Modern Language Journal, 96(2), 190-208. https://doi.org/10.1 111/j. 1540-4781.2011.01232.x

Lu, X., Gamson, D. A., & Eckert, S. A. (2014). Lexical difficulty and diversity of American elementary school reading textbooks: Changes over the past century. International Journal of Corpus Linguistics, 19(1), 94–117. https://doi.org/10.1075/ijcl.19.1.04lu.

Meara, P. (1996). The vocabulary knowledge framework. Unpublished paper. www.swan.ac.uk/cals/vlibrary/pm96d.htm.

Miasari, S., Arsyad, S., & Arono. (2018). Indonesian authors’ stances in citing English research article introductions literature in sciences. Journal of English Education, Literature, and Culture, 3(2), 205-226. https://doi.org/10.30659/e.3.1.205-226.

Palfreyman, D. M. & Karaki, S. (2017). Lexical sophistication across languages: a preliminary study of undergraduate writing in Arabic (L1) and English (L2). International Journal of Bilingual Education and Bilingualism, 22(8), 992-1015. https://doi.org/10.1080/13670050.2017.1326456.

Qian, D. & Schedl, M. (2004). Evaluation of an in depth vocabulary knowledge measure for assessing reading performance. Language Testing, 21(1), 28–52.

Schmitt, N. (1998). Tracking the incremental acquisition of second language vocabulary: A longitudinal study. Language Learning, 48, 281-317.

Tracy-Ventura, N. (2017). Combining corpora and experimental data to investigate language learning during residence abroad: A study of lexical sophistication. System, 71, 35-45. https://doi.org/10.1016/j.system.2017.09.022.

Vera, G. G., Sotomayor, C., Bedwell, P., Domínguez, A. M., & Jéldrez, E. (2016). Analysis of lexical quality and its relation to writing quality for 4th grade, primary school students in Chile. Reading Writing, 29, 1317–1336. https://doi.org/10.1007/s11145-016-9637-9

Vermeer, A. (2001). Breadth and depth of vocabulary in relation to L1/L2 acquisition and frequency of input. Applied Psycholinguistics, 22, 217–234.

Vögelin, C., Jansen, T., Keller, S. D., Machts, N. & Möller, J. (2019). The influence of lexical features on teacher judments of ESL argumentative essays. Assessing Writing, 39, 50-63. https://doi.org/10.1016/j.asw.2018.12.003

Wesche, M. & Paribakht, S. (1996). Assessing second language vocabulary knowledge: Breadth vs. depth. Canadian Modern Language Review, 53, 13–39.

Wolter, B. (2001). Comparing the L1 and L2 mental lexicon. Studies in Second Language Acquisition, 23, 41–69.

Wu, S., Dixon, L. Q., Sun, H. & Zhang, P. (2019). Breadth or depth: the role of vocabulary in Chinese English-Language beginning writers’ development, International Journal of Bilingual Education and Bilingualism. https://doi.org/10.1080/13670050.2019.1572066.

Yin, S., Gao, Y., & Lu, X (2021). Syntactic complexity of research article part-genres: differences between emerging and expert international publication writers. System, 97, [102427]. https://doi.org/10.1016/j.system.2020.102427.

Yoon, H. (2017). Linguistic complexity in L2 writing revisited: issues of topic, proficiency, and construct multidimensionality. System, 66, 130-141. https://doi.org/10.1016/j.system.2017.03.007

Yuan, R. (2019). “Living in parallel worldsâ€: investigating teacher educators’ academic publishing experiences in two Chinese universities. Compare: A Journal of Comparative and International Education. https://doi.org/10.1080/03057925.2019.1681260

Zavera, A., Schwanenfluel, P., & Nikolova, Y. (2005). Relationship between lexical competence and language proficiency: variable sensitivity. Studies in Second Language Acquisition, 27(4), 567–595. https://doi.org/10.10170S0272263105050254.

Zhong, H. F. (2016). The relationship between receptive and productive vocabulary knowledge: a perspective from vocabulary use in sentence writing. The Language Learning Journal, 46(4), 357-370. https://doi.org/10.1080/09571736.2015.1127403.

Book

Albrechtsen, D., Haastrupand, K., & Henriksen, B. (2008). Vocabulary and Writing in a First and Second Language: Processes and Development. Palgrave Macmillan.

Chapelle, C. (1998). Construct definition and validity inquiry in SLA research. In Interfaces between Second Language Acquisition and Language Testing Research, L. F. Bachman & A. D. Cohen (Eds.), 32–70. Cambridge University Press.

Laufer, B. (2013). Vocabulary and writing. In The Encyclopaedia of Applied Linguistics, C.A. Chapelle (Ed.), pp. 1–5. Boston, MA: Wiley-Blackwell.

Levitzky-Aviad, T. & Laufer, B. (2013). Lexical properties in the writing of foreign language learners over eight years of study: single words and collocations. In L2 Vocabulary Acquisition, Knowledge and Use: New Perspectives on Assessment and Corpus Analysis (EUROSLA Monographs Series 2), C. Bardel, C. Lindqvist and B. Laufer (eds.), 127–50. European Second Language Association.

Melka, F. (1997). Receptive vs. productive aspects of vocabulary. In Vocabulary: Description, Acquisition and Pedagogy, N. Schmitt and M. McCarthy (eds.). Cambridge: Cambridge University Press.

Nation, I.S.P. (2001). Learning Vocabulary in Another Language. Cambridge: Cambridge University Press.

Ortega, L. (2012). Interlanguage complexity: A construct in search of theoretical renewal. In Linguistic Complexity: Second Language Acquisition, Indigenization, Contact, B. Kortmann & B. Szmrecsanyi (eds.), 127-155. Berlin: de Gruyter.

Read, J. (2000). Assessing Vocabulary. Cambridge: Cambridge University Press.

Read, J. (2004). Plumbing the depth: how should the construct of vocabulary knowledge be defined? In Vocabulary in a Second Language, P. Bogaards and B. Laufer (eds.), 209–27. Amsterdam: Benjamins.

Weigle, S. C. (2002). Assessing Writing. Cambridge University Press.

Downloads

Submitted

2023-05-08

Accepted

2023-08-09

Published

2023-06-30

Issue

Vol. 3 No. 1 (2023): June 2023

Section

Articles

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).