Exploring the Practices on Macro Skills Integrated Assessment in Philippine Higher Education Context:Basis in Designing a Language Training Material

Jennelyn Lacar Raymundo(1*),

(1) Isabela State University
(*) Corresponding Author




DOI: https://doi.org/10.26858/ijole.v7i3.24252

Abstract


Despite the great number of studies on separated skills assessment in measuring language performance, integrated assessment has recently been occupying a significant place as educational paradigm shift continues to uphold a more skills-oriented language assessment scheme. This research determined the practices on integrated assessment of macro skills in English as a Second Language (ESL) classes to subsequently design a Language Training Program (LTP) and material appropriate to teachers’ needs. It followed the design of a Type I developmental research which includes multilevel stages of instructional development such as analysis, design, implementation and evaluation. Nevertheless, this paper only reports the analysis phase of the research due to its longitudinal nature and the multifaceted analysis of the qualitative data. It utilized interview and document analysis as initial research instruments. The participants of the study were language teachers and learners selected via total enumeration and purposive sampling, respectively. As a result, the research accentuates the need to improve the employment of stimulus-related and thematically linked tasks as equally significant features defining the practice of integrated assessment in language classrooms.


Keywords


integrated task; developmental research; text- or content-responsible task; stimulus-related task; thematically linked tasks

Full Text:

PDF

References


Adnan, Suwandi, S., Nurkamto, J., & Setiawan, B. (2019). Teacher competence in authentic and integrative assessment in Indonesian language learning. International Journal of Instruction, 12(1), 701-716.

Alhussain, A. (2009). Proposing and testing an integrative approach to improve EFL students' communicative skill. https://files.eric.ed.gov/fulltext/ED507284.pdf

Alshakhi, A. (2019). Revisiting the writing assessment process at a Saudi English Language Institute: Problems and solutions. English Language Teaching, 12(1), 176-185. https://doi.org/10.5539/elt.v12n1p176

Barabadi, E., Khajavy, G. H., & Kamrood, A. M. (2018). Applying interventionist and interactionist approaches to dynamic assessment for L2 listening comprehension. International Journal of Instruction, 11(3), 681-700. https://doi.org/10.12973/iji.2018.11346a

Barkaoui, K., Brooks, L., Swain, M., & Lapkin, S. (2013). Test-takers’ strategic behaviors in independent and integrated speaking tasks. Applied Linguistics, 34(3), 304–324. https://doi.org/10.1093/applin/ams046

Barrot, J. S. (2018). English curriculum reform in the Philippines: Issues and challenges from a 21st century learning perspective. Journal of Language, Identity & Education, 1-16. https://doi.org/10.1080/15348458.2018.1528547

Basal, A., Gulozer, K., & Demir, I. (2015). Use of video and audio texts in EFL listening test. Journal of Education and Training Studies, 3(6), 83-89. https://doi.org/10.11114/jets.v3i6.1001

Bastias, E. E. M., Sepulveda, A. C. R., Muñoz, S., & Lorena, M. (2011). Integration of the four skills of the English language and its influence on the performance of second grade high school students. Universidad del Bio-Bio. Red de Bibliotecas.

Biloon, J. S. (2018). Integrating EFL skills for authentically teaching specific grammar and vocabulary. Studies in English Language and Education, 5(2), 175-184. https://doi.org/10.24815/siele.v5i2.9705

Birenbaum, M., Breuer, K., Cascallar, E., Dochy, F.,Dori, Y., Ridgway, J., Wiesemes, R. (Ed.), & Nickmans, G. (Ed.). (2006). A learning integrated assessment system. Educational Research Review 1, 61–67. https://doi.org/10.1016/j.edurev.2006.01.001

Brindley, G. (2001). Outcomes-based assessment in practice: Some examples and emerging insights. Language Testing, 18(4) 393–407. https://doi.org/10.1177/026553220101800405

Butz, N. T., & Lovseth, M. K. A. (2015). Oral communication skills assessment in a synchronous hybrid MBA programme: Does attending face-to-face matter for US and international students? Assessment & Evaluation in Higher Education, 40(4), 624-639. https://doi.org/10.1080/02602938.2014.940577

Cameron, C., & Dickfos, J. (2014). ‘Lights, camera, action!’ Video technology and students’ perceptions of oral communication in accounting education. Accounting Education: An International Journal, 23(2), 135-154. https://doi.org/10.1080/09639284.2013.847326

Chandio, M. T., & Jafferi, S. (2015). Teaching English as a language not subject by employing formative assessment. Journal of Education and Educational Development, 2(2), 151 – 171.

Chen, S., & Wang, J. (2019). Effects of Task-based Language Teaching (TBLT) approach and language assessment on students’ competences in intensive reading course. English Language Teaching, 12(3), 119-138. https://doi.org/10.5539/elt.v12n3p119

Cleofas, N. I. P. & Macapagal, G. S. (2015). Towards integrative teaching in Filipino and English. Paper presented at the 2nd International Conference on Language, Innovation, Culture and Education (ICLICE) (November 27-28, 2015), (pp. 20-28).

Cumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M. (2005). Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing 10, 5–43. https://doi.org/10.1016/j.asw.2005.02.001

Diaz, A. R., Hortiguera, H., & Vera, M. E. (2015). Quality assurance and foreign languages – Reflecting on oral assessment practices in two University Spanish language programs in Australia. Journal of University Teaching & Learning Practice, 12(3), 1-15.

Douglas, D. (2014). Understanding language testing. In B. Comrie & G. Corbett (Eds), Understanding Language Series. Routledge. https://doi.org/10.1177/0265532210373604

Elshawa, N. R. M., Abdullah, A. N., & Rashid, S. M. (2017). Malaysian instructors’ assessment beliefs in tertiary ESL classrooms. International Journal of Education & Literacy Studies, 5(2), 29-46. https://doi.org/10.7575/aiac.ijels.v.5n.2p.29

Esmaeili, H. (2000). The effects of content knowledge from reading on adult ESL students’ written compositions in an English language test using reading and writing modules. [Doctoral dissertation, University of Toronto]. National Library of Canada.

Evanini, K., Hauck, M. C., & Hakuta, K. (2017). Approaches to automated scoring of speaking for K–12 English language proficiency assessments (Research Report No. RR-17-18). Educational Testing Service. https://doi.org/10.1002/ets2.12147

Frost, K., Elder, C., & Wigglesworth, G. (2011). Investigating the validity of an integrated listening-speaking task: A discourse-based analysis of test takers’ oral performances. Language Testing, 29(3), 345–369. https://doi.org/10.1177/0265532211424479

Gabinete, M. K. L. (2017). Teachers’ beliefs and practices in assessing the viewing skill of ESL learners. Indonesian Journal of Applied Linguistics, 7(1), 19-28. https://doi.org/10.17509/ijal.v7i1.6854

Gebril, A. (2009). Score generalizability of academic writing tasks: Does one test method fit it all?. Language Testing, 26(4), 507–531. https://doi.org/10.1177/0265532209340188

Gebril, A., & Plakans, L. (2014). Assembling validity evidence for assessing academic writing: Rater reactions to integrated tasks. Assessing Writing 21, 56–73. https://doi.org/10.1016/j.asw.2014.03.002

Gholami, J. & Alinasab, M. (2017). Source-based tasks in writing independent and integrated essays. International Journal of Instruction, 10(3), 127-142. https://doi.org/10.12973/iji.2017.1039a

Guo, L., Crossley, S. A., & McNamara, D. S. (2013). Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study. Assessing Writing 18, 218–238. https://dx.doi.org/10.1016/j.asw.2013.05.002

Han, T., & Huang, J. (2017). Examining the impact of scoring methods on the institutional EFL writing assessment: A Turkish perspective. PASAA, 53, 112-147. https://files.eric.ed.gov/fulltext/EJ1153666.pdf

Karimullah, I. W. (2018). A critical review of Yang and Plakans’ strategy inventory for integrated writing. JU-Ke, 2(1), 117-121.

Karumpa, A., Parangwasa, P., Mansyur, & Saleh, M. (2016). The development of integrative assessment model for the subject of Bahasa Indonesia in senior high school students. Journal of Language Teaching and Research, 7(3), 476-483. https://doi.org/10.17507/jltr.0703.06

Lam, R. (2018). Understanding assessment as learning in writing classrooms: The case of portfolio assessment. Iranian Journal of Language Teaching Research, 6(3), 19-36.

Lee, H. J. (2004). Developing a professional development program model based on teachers’ needs. The Professional Educator, 27(1 & 2), 39-49.

Li, Z., & Yang, C. (2014). Reading-to-write: A practice of critical thinking. Journal of Arts and Humanities (JAH), 3(5), 67-71.

McCawley, P. F. (2009). Methods for conducting an educational needs assessment: Guidelines for cooperative extension system professionals. University of Idaho Extension.

Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43 (6), 1-18. https://doi.org/10.14221/ajte.2018v43n6.1

Michel, M., Revesz, A., Lu, X., Kourtali, N. E., Lee, M., & Borges, L. (2020). Investigating L2 writing processes across independent and integrated tasks: A mixed-methods study. Second Language Research, 00(0), 277–304. https://doi.org/10.1177/0267658320915501

Murcia, M. C., Brinton, D. M., Snow, M. A. (Eds). (2014). English as a Second or Foreign Language (4th ed.). USA: National Geographic Learning.

Nasab, F. G. (2015). Alternative versus traditional assessment. Journal of Applied Linguistics and Language Research 2(6), 2015, 165-178.

Nation, I. S. P. & Macalister, J. (2010). Language Curriculum Design. In Hinkel, E. (Ed), ESL & Applied Linguistics Professional Series. Routledge.

Obeid, R. (2017). Second language writing and assessment: Voices from within the Saudi EFL context. English Language Teaching, 10(6), 174-181. https://doi.org/10.5539/elt.v10n6p174

Ohkubo, N. (2009). Validating the integrated writing task of the TOEFL internet‐based test (iBT): Linguistic analysis of test takers’ use of input material. Melbourne Papers in Language Testing, 14(1), 1-31.

Olivier, J. (2019). Exploring autonomography: The development of a self-directed writing self-rating scale. Iranian Journal of Language Teaching Research, 7(1), 1-22.

Phaiboonnugulkij, M., & Prapphal, K. (2013). Online speaking strategy assessment for improving speaking ability in the area of Language for Specific Purposes: The case of tourism. English Language Teaching, 6(9), 19-29. https://doi.org/10.5539/elt.v6n9p19

Plakans, L. (2013). Assessment of integrated skills. In C. A. Chapelle (Ed), The encyclopedia of applied linguistics (pp. 1-8). Blackwell Publishing Ltd. https://doi.org/10.1002/9781405198431.wbeal0046

Powers, D. E. (2010). The case for a comprehensive, four-skills assessment of English language proficiency. TOEIC Compendium 12, 1-11.

Richey, R. C., & Klein, J. D. (2005). Developmental research methods: Creating knowledge from instructional design and development practice. Journal of Computing in Higher Education, 16(2), 23-38.

Richey, R. C., Klein, J. D., & Nelson, W. A. (2004). Developmental research: Studies of instructional design and development. In HD. H. Jonassen (Ed.), Handbook of research on educational communications and technology (p. 1099-1130). Lawrence Erlbaum Associates Publishers.

Roohr, K. C., Burkander, K., & Mao, L. (2018). A preliminary investigation of the factors related to the design and scoring of video-based oral communication performance tasks in higher education. (Research Report No. RR-18-09). Educational Testing Service. https://doi.org/10.1002/ets2.12197

Rukthong, A., & Brunfaut, T. (2020). Is anybody listening? The nature of second language listening in integrated listening-to-summarize tasks. Language Testing 2020, 37(1), 31-53. https://doi.org/10.1177/0265532219871470

Sarigoz, I. H., & Fişne, F. N. (2018). English language assessment and evaluation practices in the 4th grade classes at mainstream schools. Journal of Language and Linguistic Studies, 14 (3), 380-395.

Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128

Soleimani, H., & Mahdavipour, M. (2014). The effect of variations in integrated writing tasks and proficiency level on features of written discourse generated by Iranian EFL learners. The Journal of Teaching Language Skills (JTLS) 6(2), 131-159.

Sonmez, H. (2019). An examination of needs analysis research in the language education process. International Journal of Education & Literacy Studies 7(1), 8-17. https://dx.doi.org/10.7575/aiac.ijels.v.7n.1p.8

Sulaiman, N., Muhammad, A. M., Ganapathy, N. N. D. F., Khairuddin, Z., & Othman, S. (2017). Students’ perceptions on using different listening assessment methods: Audio-only and video media. English Language Teaching, 10(8), 93-99. https://doi.org/10.5539/elt.v10n8p93

Tajeddin, Z., Alemi, M., & Yasaei, H. (2018). Classroom assessment literacy for speaking: Exploring novice and experienced English language teachers’ knowledge and practice. Iranian Journal of Language Teaching Research, 6(3), 57-77.

Thirakunkovit, S. (2018). The notions of language proficiency and language dimensionality. PASAA, 55. https://files.eric.ed.gov/fulltext/EJ1191745.pdf.

Veloo, A., Aziz, N. H. A., & Yaacob, A. (2018). The most suitable scoring method to assess essay writing in ESL classrooms. Advances in Language and Literary Studies, 9(4), 19-25. https://doi.org/10.7575/aiac.alls.v.9n.4p.19

Vernier, S., Barbuzza, S., Del Giusti, S., & del Moral, G. (2008). The five language skills in the EFL classroom. Geography, 265-291.

Weigle, S. C. (2004). Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing 9, 27–55. https://doi.org/10.1016/j.asw.2004.01.002

Wickramaarachchi, T. I. (2014). Writing-reading relationships: Effectiveness of writing activities as pre-reading tasks to enhance L2 inferential reading comprehension. Advances in Language and Literary Studies, 5(5), 213-221. https://doi.org/10.7575/aiac.alls.v.5n.5p.213

Willis, C., & Nanni, A. (2017). Relative influence of reading and listening inputs on students’ writing. ELT Pathways to Professional Excellence and ELT Leadership Management Certificate Program; Thailand TESOL International Conference Proceedings 2017, Bangkok, Thailand (pp. 165-178).

Yilmazer, M. O., & Okan, Y. (2017). Classroom assessment practices of English language instructors. Journal of Language and Linguistic Studies, 13(2), 324-345.

Zhang, X., Zhou, Y., & Zhang, S. (2015). Chinese EFL learners’ writing strategy use in reading-to-write and reading-listening-writing tasks. TESOL International Journal, 10(2) 97-109. https://doi.org/10.1177/003368820303400303

Zhao, Z. (2014). A needs-based approach to the development of a diagnostic college English speaking test. International Education Studies, 7(6), 145-153. https://doi.org/10.5539/ies.v7n6p145

Zhu, X., Li, X., Yu, G., Cheong, C. M., & Liao, X. (2016). Exploring the relationships between independent listening and listening-reading- writing tasks in Chinese Language testing: Toward a better understanding of the construct underlying integrated writing tasks. Language Assessment Quarterly, 13(3), 167-185. https://doi.org/10.1080/15434303.2016.1210609


Article Metrics

Abstract view : 1394 times | PDF view : 133 times

Refbacks

  • There are currently no refbacks.


License URL: https://creativecommons.org/

 

 

 

Creative Commons License


This work is licensed under a Creative Commons Attribution 4.0 International License.