Evaluating the Effectiveness of English Speaking Conversation Practice for Communication Suitable for Students using the Random Forest Technique: A Case Study of Students Enrolled in English for Communication Course at Rajamangala University of Technology
DOI:
https://doi.org/10.53848/ssstj.v11i1.609Keywords:
Efficiency evaluation, Dialogue-based English speaking skills training, Data mining, Random forest techniqueAbstract
The objectives of this research are twofold: 1) to compare the effectiveness before and after using a dialogue-based English speaking skills training model for effective communication, and 2) to identify guidelines for adjusting the English speaking skills training model using the Random Forest technique suited to students enrolled in the English for communication course at Rajamangala University of Technology Tawan-ok. The methodology were 1) a dialogue-based English speaking skills assessment questionnaire, and 2) observation of English speaking behaviour for communication. The research findings indicated that the average scores before implementing the speaking skills training model were 3.11, which was considered good. After the training, the average scores increased to 4.30, indicating a significantly higher level of proficiency. The statistical test yielded a t-value of 15.871. Therefore, it could be concluded that the English speaking skills training model significantly enhanced students' English communication abilities at a significance level of .05. Regarding the guidelines for adjusting the English speaking skills training model using the Random Forest technique, the data classification results demonstrated an accuracy rate of 86.78%, a recall rate of 85.4%, and a precision rate of 83.13%. Additionally, 18 rules were identified as having significant correlations. The adjusted training model focused on various topics, including Greetings, Feelings and Emotions, Health, Asking for and Giving Directions, Weather, and University Life.
References
Beatty, K., Longshaw, R. N., & Austin, H. M. (2020). StartUp. Hoboken: Pearson Education.
Byrne, D. (1997). Teaching oral English (7th ed.). Harlow: Longman.
Carroll, B. J. (1980). Testing communicative performance. London: Pergamon.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum Associates.
Denisko, D. , & Hoffman, M. M. ( 2018) . Classification and interaction in random forests. Proceedings of the National Academy of Sciences of the United States of America, 115(8), 1690-1692.doi:10.1073/pnas.1800256115
Dorfman, R. (1979). A formula for the Gini coefficient. The Review of Economics and Statistics, 61, 146-149.doi:10.2307/1924845
EF English Proficiency Index. (2022). Is English enough? But the ranking results can't tell! Thai English skills rank at the bottom of the rankings.4 Asia. Retrieved from https://www.smartsme.co.th/content/248794
Ellis, M., & Johnson, C. (1994). Teaching Business English. Oxford: Oxford University Press.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Hampshire:Cengage Learning.
Hengsuko, C., Boonkao, K., Srihanam, N., & Manee, W. (2019). Current situation and factors affected English language communication skill of Thai people. MBU Education Journal: Faculty of Education Mahamakut Buddhist University, 7(1), 155-160.
Huynh-Cam, T. T., Chen, L. S., & Le, H. (2021). Using decision trees and random forest algorithms to predict and determine factors contributing to first-year university students’ learning performance. Algorithms, 14,318. doi:10.3390/a14110318
Jayaprakash, S., Krishnan, S., & Jaiganesh, V. (2020). Predicting students academic performance using an improved random forest classifier. In 2020 International Conference on Emerging Smart Computing and Informatics (ESCI) (pp. 238-243). Pune, India. doi:10.1109/ESCI48226.2020.9167547
Kaewpanitch, C. (2020). Using data mining techniques to analyze most characteristics that affect the performance of undergraduate students learning English (Master’s thesis, National Institute of Development Administration, Bangkok). Retrieved from https://as.nida.ac.th/wp-content/uploads/ 2022/08/6210426022_ชิดชนนก.pdf
Kanjanawasee, S., Pitayanon, T., & Srisukho, D. (2008). Selection of appropriate statistics for research (5th ed.).Bangkok: Chulalongkorn University Printing House.
Klanrit, P. (2019). Conversation analysis: An approach to teaching English speaking skill. Faculty of Humanities and Social Sciences Review, 7(1), 33-51.
Madaan, M., Kumar, A., Keshri, C., Jain, R., & Nagrath, P. (2021). Loan default prediction using decision trees and random forest: A comparative study. IOP Conference Series: Materials Science and Engineering,1022, 012042. doi:10.1088/1757-899X/1022/1/012042
Meteevorakij, P., T.Chaisuwan, P., Nubpetchploy, S., & Tanwong, K. (2020). Performance measurement forecasting equations ability to study English for business communication based on the 21st century learning skills by creating decision tree. Journal of Educational Measurement, 37(102), 202-218.
Pomin, T., & Srinonyang, P. (2020). Applying Web-based instruction to EFL for undergraduate students to improve the English language ability based on the reference levels of the Common European Framework of Reference for Languages. Journal of Modern Learning Development, 5(5), 212-223.
Richards, J., & Rodgers, T. (2002). Approaches and methods in language teaching (2nd ed.). New York:Cambridge University Press.
Rujichom, K. (2018). English communication life skills of Thailand people in the 21th century. Journal of Arts Management, 2(3), 199 210.
Ruksuan, P. (2022). Development of English innovation and guidebook based on communicative approach for working preparation about hospitality industry concerning hotel and accommodation services in ASEAN Community for Maehongson Community College students. The Academic Journal: Faculty of Humanities and Social Sciences Nakhonsawan Rajabhat University, 9(1), 210-221.
Srithongkul, W. (2022). The development of Multimedia Electronic Book in English for Study Skills Subject of students at Dhonburi Rajabhat University Samutprakarn. Sisaket Rajabhat University Journal, 16(1),89-100.
Stansfield, C. (1973). Review of foreign language testing: Theory and practice, by John L. D. Clark. Hispania, 56(3), 746-747. doi:10.2307/339288
Supakorn, S. (2020). A conversation analytic study of classroom interactional competence. LEARN Journal: Language Education and Acquisition Research Network, 13(2), 15-40.
Tangpattanakit, J. (2020). Influence of factors affecting English communication with motivation as a central variable and anxiety as a controlling variable. RMUTL Journal of Business Administration and Liberal Arts, 8(2), 111-126.
Thaweerat, P. (1997). Social science research (7th ed.). Bangkok: Charoenphon Printing.
The Office of Academic Support and Registration Rajamangala University of Technology Tawan-ok. (2005). English for Communication Academic Year 2022. Retrieved from http://regis.rmutto.ac.th/registrar/home.asp
Ur, P. (1996). A course in language teaching: Practice and theory. Cambridge: Cambridge University Press.
Wiengnil, A. (2010). A study of out-of-class English language learning activities of secondary school students in English Program (Master’s thesis, Chulalongkorn University, Bangkok). Retrieved from http://cuir.car.chula.ac.th/bitstream/123456789/30421/1/atitaya_wi.pdf
Yates, J. (2016). Practice makes perfect: English conversation (2nd ed.). Tennessee: McGraw-Hill Education.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Suan Sunandha Rajabhat University
This work is licensed under a Creative Commons Attribution 4.0 International License.
