Abstract
The higher education landscape is continually evolving, with educators adapting to meet the needs, aspirations, and expectations of their students. Data technology and virtual-learning systems have become vital components in higher education operations, with many institutions incorporating online frameworks and innovations. The aims of the study to evaluate the effectiveness of Communicative Language Teaching (CLT) using university platforms for online teaching and learning in Indonesia and Malaysia, focusing on students' perspectives. The research utilizes the CIPP, which stands for Context, Input, Process, and Product appraisal framework proposed by Stufflebeam (Journal of Research and Development in Education, 5, 19-25, 1971). The study includes all students who take English as their subject in the English Department Program, as well as English lecturers. The stratified random sampling approach was employed for data collection. Qualitative data gathered through interviews with educators from both institutions, while written papers provide additional insights. For quantitative data, a modified questionnaire with 63 items divided into six sections and five score scales were disseminated online through the Survey123 program. Descriptive and inferential statistics were used to analyze the questionnaire results. Smart-PLS was utilized for barrier element analysis, using PLS-SEM for causal predictive analysis and consideration of reflective and formative factors. Figure 1 presents the conceptual model, illustrating the connections between exogenous and endogenous latent components in the study. By integrating qualitative and quantitative approaches, this research provides valuable contributions to the understanding of CLT's impact on online education in these settings.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets generated and/or analyzed during this study are not publicly available because the data are part of an officially unfinished reported project to MORA but are available from the corresponding author upon reasonable request.
References
Abd Hamid, R., Hamid, S. N. A., Saoula, O., Saidin, Z. H., & Rahman, W. A. W. A. (2020). The satisfaction of blended learning among universiti Utara Malaysia ( Uum ) students. Journal of Critical Reviews, 7(16), 2317–2329.
Abdul Lasi, M. B. (2021). Online distance learning perception and readiness during Covid-19 outbreak: A research review. International Journal of Academic Research in Progressive Education and Development, 10(1). https://doi.org/10.6007/ijarped/v10-i1/8593
Agustina, N. Q., & Mukhtaruddin, F. (2019). The Cipp model-based evaluation on integrated english learning (IEL) program at language center. English Language Teaching Educational Journal, 2(1), 22. https://doi.org/10.12928/eltej.v2i1.1043
Ahmed, S., & MehediMasud, M. (2014). Measure service quality of a higher educational institute towards student satisfaction. American Journal of Educational Research, 2(7), 447–455. https://doi.org/10.12691/education-2-7-3
Aisha, N., & Ratra, A. (2022). Online education amid COVID-19 pandemic and its opportunities, challenges and psychological impacts among students and teachers: A systematic review. Asian Association of Open Universities Journal, 17(3), 242–260. https://doi.org/10.1108/AAOUJ-03-2022-0028
Al-rahmi, A. M., Al-rahmi, W. M., Alturki, U., Aldraiweesh, A., Almutairy, S., & Al-adwan, A. S. (2021). Exploring the factors affecting mobile learning for sustainability in higher education. Sustainability (Switzerland), 13(14), 1–22. https://doi.org/10.3390/su13147893
Alhabeeb, A., & Rowley, J. (2017). Critical success factors for eLearning in Saudi Arabian universities. International Journal of Educational Management, 31(2), 131–147. https://doi.org/10.1108/IJEM-01-2016-0006
Ali GumaHaolader, F. A., & Khushi, M. (2013). The role of ICT to make teaching-learning effective in higher institutions of learning in Uganda. International Journal of Innovative Research in Science, Engineering and Technology, 2(8), 4061–4073.
Alias, N. E. (2021). The influence of computer and internet self-efficacy on individual entrepreneurial orientation: An empirical study among Bumiputra University Students in Malaysia. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(3), 2760–2770. https://doi.org/10.17762/turcomat.v12i3.1305
Alkraiji, A., & Ameen, N. (2021). The impact of service quality, trust and satisfaction on young citizen loyalty towards government e-services. Information Technology and People, 35(4), 1239–1270. https://doi.org/10.1108/ITP-04-2020-0229
Allam, S. N. S., Hassan, M. S., Mohideen, R. S., Ramlan, A. F., & Kamal, R. M. (2020). Online distance learning readiness during Covid-19 outbreak among undergraduate students. International Journal of Academic Research in Business and Social Sciences, 10(5). https://doi.org/10.6007/ijarbss/v10-i5/7236
Alzahrani, H. A., Shati, A. A., Bawahab, M. A., Alamri, A. A., Hassan, B., Patel, A. A., Ahmad, M. T., El Maksoud, W. A., & Alsaleem, M. A. (2023). Students’ perception of asynchronous versus synchronous distance learning during COVID-19 pandemic in a medical college, southwestern region of Saudi Arabia. BMC Medical Education, 23(1), 1–6. https://doi.org/10.1186/s12909-023-04034-5
Amnouychokanant, V., Boonlue, S., Chuathong, S., & Thamwipat, K. (2021). Online learning using block-based programming to foster computational thinking abilities during the COVID-19 pandemic. International Journal of Emerging Technologies in Learning, 16(13), 227–247. https://doi.org/10.3991/ijet.v16i13.22591
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. https://doi.org/10.1037/0033-2909.103.3.411
Ardiyanto, A., Mulyadin, T., Santi, A. M., & Dharma, I. G. B. B. (2021). Online classrooms during covid-19 pandemic: A survey of industrial engineering instructors in indonesia. Higher Learning Research Communications, 11(1), 27–46. https://doi.org/10.18870/HLRC.V11I1.1232
Asghar, M. Z., Afzaal, M. N., Iqbal, J., Waqar, Y., & Seitamaa-Hakkarainen, P. (2022). Evaluation of in-service vocational teacher training program: A blend of face-to-face, online and offline learning approaches. Sustainability, 14(21), 13906. https://doi.org/10.3390/su142113906
Azhari, B., & Fajri, I. (2022). Distance learning during the COVID-19 pandemic: School closure in Indonesia. International Journal of Mathematical Education in Science and Technology, 53(7), 1934–1954. https://doi.org/10.1080/0020739X.2021.1875072
Azlan, A. A., Hamzah, M. R., Sern, T. J., Ayub, S. H., & Mohamad, E. (2020). Public knowledge, attitudes and practices towards COVID-19: A cross-sectional study in Malaysia. Plos One, 15(5), 1–15. https://doi.org/10.1371/journal.pone.0233668
Azlim, M., Amran, M., & Rusli, M. R. (2015). Utilization of educational technology to enhance teaching practices: Case study of community college in Malaysia. Procedia - Social and Behavioral Sciences, 195, 1793–1797. https://doi.org/10.1016/j.sbspro.2015.06.385
Baharuldin, Z., Jamaluddin, S., & Shaharom, M. S. N. (2020). The role of school administrative support and primary school teachers’ ICT literacy to integrate ICT into the classrooms in Pahang, Malaysia. International Online Journal of Educational Leadership, 3(1), 26–42. https://doi.org/10.22452/iojel.vol3no1.3
Bahasoan, A. N., Ayuandiani, W., Mukhram, M., & Rahmat, A. (2020). Effectiveness of online learning in pandemic Covid-19. International Journal of Science, Technology & Management, 1(2), 100–106. https://doi.org/10.46729/ijstm.v1i2.30
Bailey, D. R., & Lee, A. R. (2020). Learning from experience in the midst of covid-19: Benefits, challenges, and strategies in online teaching. Call-Ej, 21(2), 176–196.
Ballena, C. T., & Feranil, B. S. (2021). Remote learning amid a global crisis: A literature review. Journal of Institutional Research South East Asia, 19(2), 21–42.
Bond, M., Zawacki-Richter, O., & Nichols, M. (2019). Revisiting five decades of educational technology research: A content and authorship analysis of the British Journal of Educational Technology. British Journal of Educational Technology, 50(1), 12–63. https://doi.org/10.1111/bjet.12730
Britwum, K., Catrone, R., Smith, G. D., & Koch, D. S. (2020). A university-based social services parent-training model: A telehealth adaptation during the COVID-19 pandemic. Behavior Analysis in Practice, 13(3), 532–542. https://doi.org/10.1007/s40617-020-00450-x
Cahapay, M. B. (2021). Kirkpatrick model: Its limitations as used in higher education evaluation. International Journal of Assessment Tools in Education, 8(1), 135–144. https://doi.org/10.21449/ijate.856143
Canale, Michael., M. S. (1980). Theoretical Bases of Communicative Approaches to Second Language Teaching and Testing. Applied Linguistics, 1(Bases of Communicative Approaches to Second Languaguage Teaching and Testing), 47. https://doi.org/10.1093/applin/i.1.1
Canale, M. (1983). From communicative competence to communicative language pedagogy. In Book chapter (1st ed., p. 26). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315836027-2/communicativecompetence-communicative-language-pedagogy-1-michael-canale
Castro, M. D. B., & Tumibay, G. M. (2021). A literature review: Efficacy of online learning courses for higher education institution using meta-analysis. Education and Information Technologies, 26(2), 1367–1385. https://doi.org/10.1007/s10639-019-10027-z
Celce-Murcia, M. (2007a). Rethinking the Role of Communicative Competence in Language Teaching. In M. P. S. J. Soler, Eva Alcón (Ed.), Intercultural Language Use and Language Learning (Issue May 2007, pp. 1–287). Springer. https://doi.org/10.1007/978-1-4020-5639-0
Celce-murcia, M. (2007b). Towards more context and discourse in grammar instruction. TESL-EJ, 11(September), 1–6.
Celce-murcia, M. (2011). Language Teaching Approaches : An Overview, 1991, 1–8.
Celce-Murcia, M., & Zoltan Dornyei, S. T. (1995). Communicative competence: A pedagogically motivated model with content specifications. Applied Linguistics, 6(2), 32. https://doi.org/10.5070/L462005216
Celce-murcia, M., Thurrell, S., Celce, M., Domyei, Z., & Thurrell, S. (1993). A pedagogical framework for communicative competence : Content specifications and guidelines for communicative language teaching a pedagogical framework for communicative competence : Content specifications and guidelines for communicative language teachi. Deseret Language and Linguistic Society Symposium, 19(1)
Celik, I., Gedrimiene, E., Silvola, A., & Muukkonen, H. (2022). Response of learning analytics to the online education challenges during pandemic: Opportunities and key examples in higher education. Policy Futures in Education, 21(4), 387–404. https://doi.org/10.1177/14782103221078401
Cheawjindakarn, B., Suwannatthachote, P., & Theeraroungchaisri, A. (2012). Critical success factors for online distance learning in higher education: A review of the literature. Creative Education, 03(08), 61–66. https://doi.org/10.4236/ce.2012.38b014
Chin, W. W. (2010). Handbook of Partial Least Squares. In Handbook of Partial Least Squares (Issue January 2010). https://doi.org/10.1007/978-3-540-32827-8
Chomsky, N. (1957). [Review of Fundamentals of Language, by R. Jakobson & M. Halle]. International Journal of American Linguistics, 23(3), 234–242
Chomsky, N. (1970). Current issues in linguistic theory. In Book series (5th ed.). The Hague, Paris: Mouton & Co., Printers. https://doi.org/10.1515/9783110867565
Chomsky, N. (1976). On the nature of language. Annals of the New York Academy of Science, 280(October), 46–57.
Churiyah, M., Sholikhan, S., Filianti, F., & Sakdiyyah, D. A. (2020). Indonesia education readiness conducting distance learning in Covid-19 pandemic situation. International Journal of Multicultural and Multireligious Understanding, 7(6), 491. https://doi.org/10.18415/ijmmu.v7i6.1833
Cleofas, J. V., & Rocha, I. C. N. (2021). Demographic, gadget and internet profiles as determinants of disease and consequence related COVID-19 anxiety among Filipino college students. Education and Information Technologies, 26(6), 6771–6786. https://doi.org/10.1007/s10639-021-10529-9
Cloudia Ho, Y. Y. (2020). Communicative language teaching and English as a foreign language undergraduates’ communicative competence in Tourism English. Journal of Hospitality, Leisure, Sport and Tourism Education, 27(1), 100271. https://doi.org/10.1016/j.jhlste.2020.100271
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203771587
Colman, A. M., & Norris, C. E. (1997). Comparing rating scales of different lengths: Equivalence of scores from 5-point and 7-point scales. Psychological Report, 80(6), 355–362.
Coman, C., Ţîru, L. G., Meseşan-Schmitz, L., Stanciu, C., & Bularca, M. C. (2020). Online teaching and learning in higher education during the coronavirus pandemic: Students’ perspective. Sustainability (Switzerland), 12(24), 1–22. https://doi.org/10.3390/su122410367
Costley, K. C. (2014). The positive effects of technology on teaching and student learning. Eric. Retrieved July 6, 2022, from https://eric.ed.gov/?id=ED554557
Dash, G., & Paul, J. (2021). CB-SEM vs PLS-SEM methods for research in social sciences and technology forecasting. Technological Forecasting and Social Change, 173(August), 121092. https://doi.org/10.1016/j.techfore.2021.121092
Diana, S., & Mansur, M. (2018). Need analysis on english teaching materials for Ict students. ETERNAL (English, Teaching, Learning, and Research Journal), 4(2), 209. https://doi.org/10.24252/eternal.v42.2018.a6
Diaz Pérez, M. M., & Colorado Aguilar, B. L. (2020). Study to carry out the tutorial action through a learning management system at the secondary level. MLS Educational Research, 4(1), 41–56. https://doi.org/10.29314/mlser.v4i1.260
Dube, B. (2020). Rural online learning in the context of COVID-19 in South Africa: Evoking an inclusive education approach. Multidisciplinary Journal of Educational Research, 10(2), 135–157. https://doi.org/10.4471/remie.2020.5607
Erdfelder, E., Faul, F., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160.
Febrianto, P. T., Masudah, S., & Megasari, L. A. (2020). Implementation of online learning during the covid-19 pandemic on Madura Island, Indonesia. International Journal of Learning, Teaching and Educational Research, 19(8), 233–254. https://doi.org/10.26803/ijlter.19.8.13
Finney, T. L. (2019). Confirmative evaluation: New CIPP evaluation model. Journal of Modern Applied Statistical Methods, 18(2), 2–24. https://doi.org/10.22237/jmasm/1598889893
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312
Francom, G. M., Lee, S. J., & Pinkney, H. (2021). Technologies, challenges and Needs of K-12 teachers in the transition to distance learning during the COVID-19 pandemic. TechTrends, 65(4), 589–601. https://doi.org/10.1007/s11528-021-00625-5
Funa, A. A., & Talaue, F. T. (2021). Constructivist learning amid the Covid-19 pandemic: Investigating students’ perceptions of biology self-learning modules. International Journal of Learning, Teaching and Educational Research, 20(3), 250–264. https://doi.org/10.26803/ijlter.20.3.15
Goodell, J. W. (2020). COVID-19 and finance: Agendas for future research. Finance Research Letters, 35(April). https://doi.org/10.1016/j.frl.2020.101512
Gopal, R., Singh, V., & Aggarwal, A. (2021). Impact of online classes on the satisfaction and performance of students during the pandemic period of COVID 19. Education and Information Technologies, 26(6), 6923–6947. https://doi.org/10.1007/s10639-021-10523-1
Gorres-Martens, B. K. (2020). Using exam reflections to augment learning. Advances in Physiology Education, 44(3), 501–504. https://doi.org/10.1152/ADVAN.00028.2020
Gunasinghe, A., Hamid, J. A., Khatibi, A., & Ferdous Adam, S. M. (2019). The Viability of UTAUT-3 in understanding the lecturers acceptance and use of virtual learning environments. International Journal of Technology Enhanced Learning, 1(1), 1. https://doi.org/10.1504/ijtel.2019.10023751
Gustian, K., Rusmawaty, D., Mulawarman, U., Kuaro, J., Kelua, G., Samarinda Ulu, K., Samarinda, K., & Timur, K. (2023). The benefits of flipped classroom model for Efl learners. Journal on Education, 05(04), 13918–13935.
Habibi, A., Sofyan, S., & Mukminin, A. (2023). Factors affecting digital technology access in vocational education. Scientific Reports, 13(1), 5682. https://doi.org/10.1038/s41598-023-32755-6
Hair, J., Anderson, R., Babin, B., & Black, W. (2010a). Multivariate Data Analysis.pdf. In Australia : Cengage: Vol. 8 edition. Retrieved May 12, 2022, from https://www.pdfdrive.com/multivariate-data-analysis-7th-edition-d156708931.html
Hair, J., Black, W., Babin, B., & Anderson, R. (2010b). Multivariate data analysis: A global perspective (7th ed.). Publisher: Pearson. Retrieved May 12, 2022, from https://www.researchgate.net/publication/237009923_Multivariate_Data_Analysis_A_Global_Perspective
Hair, J. F., Black Jr, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate Data Analysis. In Pearson (7th ed., p. 816). Pearson. www.pearsoned.co.uk
Hair, J. F., Sarstedt, M., Matthews, L. M., & Ringle, C. M. (2016). Identifying and treating unobserved heterogeneity with FIMIX-PLS: Part I – method. European Business Review, 28(1), 63–76. https://doi.org/10.1108/EBR-09-2015-0094
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM). In Sage (2nd ed.). Thousand Oaks: SAGE Publications, Inc. http://study.sagepub.com/hairprimer2e
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24. https://doi.org/10.1108/EBR-11-2018-0203
Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109(November 2019), 101–110. https://doi.org/10.1016/j.jbusres.2019.11.069
Hair Jr, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. In Springer (A Workbook). Springer. https://doi.org/10.1007/978-3-030-80519-7
Henseler, J., Ringle, C. M., & Sinkovics, R. R. (2009). The use of partial least squares path modeling in international marketing. Advances in International Marketing, 20, 277–319. https://doi.org/10.1108/S1474-7979(2009)0000020014
Hidayati, A. N., Sri, M., Abdullah, F., Ramalia, T., Yunita, W., & Sulastri, F. (2022). Whatsapp in the Indonesian online EFL learning Milieu: How do the students engage? English Franca : Academic Journal of English Language and Education, 6(1), 83. https://doi.org/10.29240/ef.v6i1.4136
Hockaday, M. Z., Sandhu, R., Rajadurai, S., Aldosari, M., & Park, S. E. (2022). Assessing dental student and faculty views on the transition to the clinical setting. Journal of Curriculum and Teaching, 11(8), 423–431. https://doi.org/10.5430/jct.v11n8p423
Hossan, D., Aktar, A., & Zhang, Q. (2020). A study on partial least squares structural equation modeling (PLS-SEM) as emerging tool in action research. LC International Journal of Stem, 1(4), 130–145. Retrieved November 23, 2022, from www.lcjstem.com
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Huang, C. H. (2021). Using pls-sem model to explore the influencing factors of learning satisfaction in blended learning. Education Sciences, 11(5). https://doi.org/10.3390/educsci11050249
Hymes, D. H. (1967). Models of the interaction of language and social setting. Journal of Social, 23(2), 8–23.
Hymes, D. H. (1972). On communicative competence. In J. B. Pride & J. Holmes (eds) Sociolinguistics. Selected Readings (pp. 269-293). Harmondsworth: Penguin. Retrieved December 21, 2022, from. http://smjegupr.net/wp-content/uploads/2012/05/ESPA-3246-On-Communicative-Competence-p-53-73.pdf
Ibrahim, A., Elfeky, M., Saleem, T., Masadeh, Y., Yasien, M., & Elbyaly, H. (2019). Advance Organizers in Flipped Classroom via E-learning Management System and the Promotion of Integrated Science Process Skills. Thinking Skills and Creativity, 100622. https://doi.org/10.1016/j.tsc.2019.100622
Ismail, I., Muliadi, A., & Verawati, N. N. S. P. (2022). Online learning interaction patterns during the Covid-19 pandemic: Prospective teachers’ perceptions. Prisma Sains: Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 10(2), 373. https://doi.org/10.33394/j-ps.v10i2.5138
Jaffar, M. N., Mahmud, N. H., Amran, M. F., Abdul Rahman, M. H., Abd Aziz, N. H., & Che Noh, M. A. (2022). Online learning and teaching technology services: USIM’s experience during COVID-19 pandemic. Frontiers in Education, 7(April), 1–7. https://doi.org/10.3389/feduc.2022.813679
Jebb, A. T., Ng, V., & Tay, L. (2021). A review of key Likert scale development advances: 1995–2019. Frontiers in Psychology, 12(May), 1–14. https://doi.org/10.3389/fpsyg.2021.637547
Jiang, H., Islam, A. Y. M. A., Gu, X., Spector, J. M., & Chen, S. (2022). Technology-Enabled E-Learning Platforms in Chinese Higher Education During the Pandemic Age of COVID-19. SAGE Open, 12(2). https://doi.org/10.1177/21582440221095085
Joseph, J. (2012). The barriers of using education technology for optimizing the educational experience of learners. Procedia - Social and Behavioral Sciences, 64, 427–436. https://doi.org/10.1016/j.sbspro.2012.11.051
Kim, S. (2022). Innovating workplace learning: Training methodology analysis based on content, instructional design, programmed learning, and recommendation framework. Frontiers in Psychology, 13(July), 1–14. https://doi.org/10.3389/fpsyg.2022.870574
Kusuma, I. P. I. (2022). EFL teachers’ online teaching in rural schools during the COVID-19 pandemic: Stories from Indonesia. Studies in English Language and Education, 9(1), 203–221. https://doi.org/10.24815/siele.v9i1.21239
Lan, Y. (2020). Willingness to communicate in english language learning among Chinese doctoral students. Asian EFL Journal, 27(33), 230–244.
Lee, W. C., Neo, W. L., Chen, D.-T., & Lin, T.-B. (2021). Fostering changes in teacher attitudes toward the use of computer simulations: Flexibility, pedagogy, usability and needs. Education and Information Technologies, 26(4), 4905–4923. https://doi.org/10.1007/s10639-021-10506-2
Lemay, D. J., Bazelais, P., & Doleck, T. (2021). Transition to online learning during the COVID-19 pandemic. Computers in Human Behavior Reports, 4(August), 10. https://doi.org/10.1016/j.chbr.2021.100130
Luib, S. A., Loquias, M. M., Capule, F. R., Garcia, K. E. S., & Sendito, M. J. V. (2022). Evaluation of the patient medication counseling services in the philippine general hospital using the CIPP model. Acta Medica Philippina, 56(6), 143–150. https://doi.org/10.47895/amp.v56i6.4522
Madya, S. A., & Abdurahman. (2021). Online learning implementation in the Covid-19 pandemic. Proceedings of the Ninth International Conference on Language and Arts (ICLA 2020), 539(Icla 2020), 26–31. https://doi.org/10.2991/assehr.k.210325.005
Malhotra, N. K., Kim, S. S., & Patil, A. (2006). Common method variance in IS research: A comparison of alternative approaches and a reanalysis of past research. Management Science, 52(12), 1865–1883. https://doi.org/10.1287/mnsc.1060.0597
Martin, Florence & Ritzhaupt, Albert & Kumar, Swapna & Budhrani, K. (2019). Award-winning faculty online teaching practices: Course design, assessment and evaluation, and facilitation. The Internet and Higher Education, 42(4). https://doi.org/10.1016/j.iheduc.2019.04.001.
Martini, S., & Aizan, R. (2013). ScienceDirect Communicative language teaching ( CLT ) in Malaysian context : its ’ implementation in selected community colleges. 90(InCULT 2012), 788–794. https://doi.org/10.1016/j.sbspro.2013.07.153
Martono, H. H., Tiyanto, D., & Surwati, C. H. D. (2018). Teaching journalism ethics: An evaluative study on teaching model effectiveness. Cogent Arts and Humanities, 5(1). https://doi.org/10.1080/23311983.2018.1498163
Matthew, V. R., & Yamat, H. (2020). Evaluation of highly immersive program (HIP) using CIPP model. International Journal of Academic Research in Business and Social Sciences, 10(4), 509–526. https://doi.org/10.6007/ijarbss/v10-i4/7152
Maulana, M. R. W., & Muslim, S. (2019). Assessment of media learning based on learning virtual reality in industrial work practices in SMK. Humanities and Social Sciences Reviews, 7(3), 446–453. https://doi.org/10.18510/hssr.2019.7365
Menold, N., & Bogner, K. (2016). Design of rating scales in questionnaires. GESIS Survey Guidelines, December. https://doi.org/10.15465/gesis-sg_en_015
Mohammed, M. I. (2015). The perception of students and teachers about the benefits of and barriers to technology aided EFL. Journal of Literature, Languages and Linguistics, 13(2010), 85–100. Retrieved October 11, 2022, from https://iiste.org/Journals/index.php/JLLL/article/view/24820/25423
Mohmmed, A. O., Khidhir, B. A., Nazeer, A., & Vijayan, V. J. (2020). Emergency remote teaching during Coronavirus pandemic: The current trend and future directive at Middle East College Oman. Innovative Infrastructure Solutions, 5(3), 1–11. https://doi.org/10.1007/s41062-020-00326-7
Mulyadi, D., Wijayatiningsih, T. D., Swaran Singh, C. K., & Prastikawati, E. F. (2021). Effects of technology enhanced task-based language teaching on learners’ listening comprehension and speaking performance. International Journal of Instruction, 14(3), 717–736. https://doi.org/10.29333/iji.2021.14342a
Nitzl, C. (2014). Partial least squares structural equation modelling (PLS-SEM) in management accounting research: Critical analysis, advances, and future directions. In SSRN Electronic Journal (Issue December).https://doi.org/10.2139/ssrn.2469802
Norman, G. (2010). Likert scales, levels of measurement and the “laws” of statistics. Advances in Health Sciences Education, 15(5), 625–632. https://doi.org/10.1007/s10459-010-9222-y
O’Leary-Kelly, S. W., & Vokurka, R. J. (1998). The empirical assessment of construct validity. Journal of Operations Management, 16(4), 387–405. https://doi.org/10.1016/s0272-6963(98)00020-5
Phoeun, M., & Sengsri, S. (2021). The effect of a flipped classroom with communicative language teaching approach on undergraduate students’ English speaking ability. International Journal of Instruction, 14(3), 1025–1042. https://doi.org/10.29333/iji.2021.14360a
Prasetya, R. (2022). Establishing cognitive strategies to support online english language learners’ critical thinking. Jet Adi Buana, 7(01), 17–33. https://doi.org/10.36456/jet.v7.n01.2022.4938
Purwaningsih, H., & Dardjito, H. (2021). Implementation of Cipp model for online learning evaluation during Covid-19 pandemic. Getsempena English Education Journal, 8(2), 294–309. https://doi.org/10.46244/geej.v8i2.1394
Ramlo, S. (2021). The coronavirus and higher education: Faculty viewpoints about universities moving online during a worldwide pandemic. Innovative Higher Education, 46(3), 241–259. https://doi.org/10.1007/s10755-020-09532-8
Redmond, P., Abawi, L. A., Brown, A., Henderson, R., & Heffernan, A. (2018). An online engagement framework for higher education. Online Learning Journal, 22(1), 183–204. https://doi.org/10.24059/olj.v22i1.1175
Rizal, F., Kiong, T. T., Ambiyar, E., & Verawardina, U. (2022). Evaluation of educator’s functional training program of teaching and learning studio (SKB) at learning activity development center (BPKB) of West Sumatra. Educational Administration: Theory and Practice, 28(2), 39–48. https://doi.org/10.17762/kuey.v28i02.404
Salamah, U., & Istiyono, E. (2022). Evaluation of teacher professional training (TPT) program in the position of full online learning. Jurnal Penelitian Dan Evaluasi Pendidikan, 26(2), 116–125. https://doi.org/10.21831/pep.v26i2.43978
Sankaran, S., & Saad, N. (2022). Evaluating the bachelor of education program based on the context, input, process, and product model. Frontiers in Education, 7(June), 1–8. https://doi.org/10.3389/feduc.2022.924374
Saputri, G. Z., Dini, S. M., & Purwantoyo, E. (2020). Discriminant validity assessment of religious teacher acceptance : The use of HTMT criterion discriminant validity assessment of religious teacher acceptance : The use of htmt criterion.https://doi.org/10.1088/1742-6596/1529/4/042045
Sarstedt, M., Ringle, C. M., & Hair, J. F. (2017). Partial least squares structural equation modeling. In Springer International Publishing AG 2017 (Issue September). Springer International Publishing AG 2017. https://doi.org/10.1007/978-3-319-05542-8
Savignon, S. J. (2018). Communicative competence. The TESOL Encyclopedia of English Language Teaching, 7. https://doi.org/10.1002/9781118784235.eelt0047
Sayaf, A. M. (2023). Adoption of E-learning systems: An integration of ISSM and constructivism theories in higher education. Heliyon, 9(2), e13014. https://doi.org/10.1016/j.heliyon.2023.e13014
Setiawan, R., Aman, A., Prasojo, L. D., & Mehta, K. (2021). Evaluation of hybrid learning in college using CIPP model. Jurnal Penelitian Dan Evaluasi Pendidikan, 25(2), 218–231. https://doi.org/10.21831/pep.v25i2.46348
Silviariza, W. Y., SumarmiUtaya, S., Bachri, S., & Handoyo, B. (2023). Development of evaluation instruments to measure the quality of spatial problem based learning (SPBL): CIPP framework. International Journal of Instruction, 16(2), 413–436. https://doi.org/10.29333/iji.2023.16223a
Simamora, R. M. (2020). The challenges of online learning during the COVID-19 pandemic: An essay analysis of performing arts education students. Studies in Learning and Teaching, 1(2), 86–103.
Stufflebeam, D. L. (1971). The relevance of the CIPP evaluation model for educational accountability. Journal of Research and Development in Education, 5, 19–25.
Stufflebeam, D. L. (2003a). The CIPP Model for Evaluation. International Handbook of Educational Evaluation, 31–62. https://doi.org/10.1007/978-94-010-0309-4_4
Stufflebeam, D. L. (2003b). The CIPP model for evaluation. In International Handbook of Educational Evaluation. https://doi.org/10.1007/978-94-010-0309-4_4
Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications (2nd ed.). Jossey-Bass/Wiley.
Taherdoost, H. (2019). What is the best response scale for survey and questionnaire design; Review of different lengths of rating scale / attitude scale / likert scale. International Journal of Academic Research in Management (IJARM), 8(1), 1–10. Retrieved November 13, 2021, from https://hal.archives-ouvertes.fr/hal-02557308
Taridi, M., & Sanjaya, M. E. (2019). Communicative english language learning program with CIPP: An evaluative study. 253(Aes 2018), 452–457. https://doi.org/10.2991/aes-18.2019.102
Thamarana, S. (2016). Role of E-learning and Virtual Learning Environment in English language learning Simhachalam. 4th Annual International Conference, August. https://doi.org/10.13140/RG.2.1.4665.1122
Thanawala, A., Murphy, C., & Hakim, T. (2022). Sustaining STEM student learning support and engagement during COVID-19. Community College Journal of Research and Practice, 46(1–2), 74–84. https://doi.org/10.1080/10668926.2021.1973612
Theocharis, Y., Cardenal, A., Jin, S., Aalberg, T., Hopmann, D. N., Strömbäck, J., Castro, L., Esser, F., Van Aelst, P., de Vreese, C., Corbu, N., Koc-Michalska, K., Matthes, J., Schemer, C., Sheafer, T., Splendore, S., Stanyer, J., Stępińska, A., & Štětka, V. (2021). Does the platform matter? Social media and COVID-19 conspiracy theory beliefs in 17 countries. New Media and Society, 1–26. https://doi.org/10.1177/14614448211045666
Todd, R. W., Pansa, D., Jaturapitakkul, N., Chanchula, N., Pojanapunya, P., Tepsuriwong, S., Towns, S. G., & Trakulkasemsuk, W. (2021). Assessment in thai elt: What do teachers do, why, and how can practices be improved? LEARN Journal: Language Education and Acquisition Research Network, 14(2), 627–649.
Tojib, D. R., & Sugianto, L.-F. (2012). Construct Validity Assessment in IS Research. Innovative Strategies and Approaches for End-User Computing Advancements, 134–159. https://doi.org/10.4018/978-1-4666-2059-9.ch008
Tong, K. P., & Trinidad, S. G. (2005). Conditions and constraints of sustainable innovative pedagogical practices using technology. International Electronic Journal for Leadership in Learning, 9(2000), 24. https://eric.ed.gov/?id=EJ985387
Vilchez, J. A., Kruse, J., Puffer, M., & Dudovitz, R. N. (2021). Teachers and school health leaders’ perspectives on distance learning physical education during the COVID-19 pandemic. Journal of School Health, 91(7), 541–549. https://doi.org/10.1111/josh.13030
Vizconde, C. (2022). English language programs (Pre-K to 12) impact on Social and academic engagements: The case of a Philippine university. Modern Journal of Studies in English Language Teaching and Literature, 4(1), 76–92. https://doi.org/10.56498/412022158
Wahidah, N. I., & Nasir. (2020). Analysis of massive open online courses (Moocs) in higher education. International Journal of Scientific and Technology Research, 9(2), 2929–2931
Wandani, S. D. A., Ali, M., Maksum, M. N. R., & Alauddin, M. B. (2022). Principal’s strategy in developing teacher’s pedagogic competencies in the distance learning. Jurnal Iqra’: Kajian Ilmu Pendidikan, 7(2), 226–245. https://doi.org/10.25217/ji.v7i2.2595
Wang, W., & Zhan, J. (2020). The relationship between english language learner characteristics and online self-regulation: A structural equation modeling approach. Sustainability (Switzerland), 12(7). https://doi.org/10.3390/su12073009
Yates, A., Starkey, L., Egerton, B., & Flueggen, F. (2021). High school students’ experience of online learning during Covid-19: The influence of technology and pedagogy. Technology, Pedagogy and Education, 30(1), 59–73. https://doi.org/10.1080/1475939X.2020.1854337
Yeboah, D., & Nyagorme, P. (2022). Students’ acceptance of WhatsApp as teaching and learning tool in distance higher education in sub-Saharan Africa. Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2077045
Zacharis, G., & Nikolopoulou, K. (2022). Factors predicting University students’ behavioral intention to use eLearning platforms in the post-pandemic normal: An UTAUT2 approach with ‘Learning Value.’ Education and Information Technologies, 27(9), 12065–12082. https://doi.org/10.1007/s10639-022-11116-2
Zhang, W. (2022). The role of technology-based education and teacher professional development in english as a foreign language classes. Frontiers in Psychology, 13(June). https://doi.org/10.3389/fpsyg.2022.910315
Zhao, L., Xu, P., Chen, Y., & Yan, S. (2022). A literature review of the research on students’ evaluation of teaching in higher education. Frontiers in Psychology, 13(September), 1–9. https://doi.org/10.3389/fpsyg.2022.1004487
Acknowledgements
The authors thank the lecturers and students who participated in the survey from both universities, and great appreciation to the two anonymous reviewers and their comments.
Author information
Authors and Affiliations
Contributions
Conceptualization: [MT].; Methodology: [RI].; Formal analysis and investigation: [MT & RI].; Writing—original draft preparation: [MT].; Writing—review and editing: [MF].; Data collecting and inputting; [MK].: Funding acquisition: [MT].; and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Taridi, M., Risnita, Yaakob, M.F.M. et al. An evaluative study for communicative language teaching (CLT) on online teaching and learning in higher education: Indonesian and Malaysian university context. Educ Inf Technol (2023). https://doi.org/10.1007/s10639-023-12221-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-023-12221-6