Implementation of IoT-based STEM-Contextual learning with the MQTT protocol on the digital literacy skills of pre-service science teacher

Didik Setyawarno; Dadan Rosana; Ibrohim; Erti Hamimi; Ade Gafar Abdulloh

doi:10.31129/LUMAT.12.4.2277

Authors

Didik Setyawarno Universitas Negeri Yogyakarta, Indonesia https://orcid.org/0000-0002-9918-2486
Dadan Rosana Universitas Negeri Yogyakarta, Indonesia
Ibrohim Universitas Negeri Malang, Indonesia
Erti Hamimi Universitas Negeri Malang, Indonesia
Ade Gafar Abdulloh Universitas Pendidikan Indonesia, Indonesia

DOI:

https://doi.org/10.31129/LUMAT.12.4.2277

Keywords:

STEM-Contextual, Internet of Things, Message Queue Telemetry Transport, Digital Literacy Skills

Abstract

The Internet of Things (IoT) with the Message Queue Telemetry Transport (MQTT) protocol in learning processes is one of the learning innovations in the digital era which has a significant role in students' digital literacy skills. Moreover, the STEM-contextual approach is in line with the demands of 21st-century learning. The authors attempt to integrate IoT with MQTT protocol in STEM-Contextual learning. This study aims to determine the results of the implementation of STEM-Contextual learning based on the IoT with the MQTT protocol on the digital literacy skills of pre-service science teachers. The research used a one-shot case study design. The research sample was pre-service science teacher students from Universitas Negeri Yogyakarta (UNY), totalling 43, and from Universitas Negeri Malang (UM), totalling 66, determined by convenience sampling technique. The research instruments used were a questionnaire sheet on digital literacy skills and an observation sheet on STEM-Contextual learning implementation. The quality of the instrument was analyzed using the content validity ratio, Fleiss Kappa, confirmatory factor analysis, and Rasch model. Data analysis of digital literacy skills used descriptive statistics, the conversion of quantitative to qualitative scales, and inferential statistics. The finding shows a significant positive effect of implementing IoT-based STEM-contextual learning with the MQTT protocol on the digital literacy skills of pre-service science teachers at UNY and UM. The total score of pre-science teachers of UNY is 70.98 in the High Performers category, while the pre-science teachers of UM are 67.52 in the Above Average Performers category.

References

Al-Ali, A. R., & Aburukba, R. (2015). Role of Internet of Things in the Smart Grid Technology. Journal of Computer and Communications, 03(05), 229–233. https://doi.org/10.4236/jcc.2015.35029 DOI: https://doi.org/10.4236/jcc.2015.35029

Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015). Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications. IEEE Communications Surveys & Tutorials, 17(4), 2347–2376. https://doi.org/10.1109/COMST.2015.2444095 DOI: https://doi.org/10.1109/COMST.2015.2444095

Almaiah, M., Alfaisal, R., Salloum, S., Al-Otaibi, S., Shishakly, R., Lutfi, A., Alrawad, M., Mulhem, A., Awad, A., & Al-Maroof, R. (2022). Integrating Teachers’ TPACK Levels and Students’ Learning Motivation, Technology Innovativeness, and Optimism in an IoT Acceptance Model. Electronics, 11(19), 3197. https://doi.org/10.3390/electronics11193197 DOI: https://doi.org/10.3390/electronics11193197

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814 DOI: https://doi.org/10.1007/BF02293814

Arends, R. I. (2012). Learning to Teach (9th ed.). McGraw Hill.

Bahri, A., Jamaluddin, A. B., Arifin, A. N., & Saparuddin, S. (2022). Students’ and Teachers’ Digital Literacy Skill: A Comparative Study between Schools, Classes, and Genders in Urban and Rural Areas. International Journal of Science and Research (IJSR), 11(2), 184–191. https://doi.org/10.21275/SR22130101519 DOI: https://doi.org/10.21275/SR22130101519

Bawden, D. (2001). Information and digital literacies: A review of concepts. Journal of Documentation, 57(2), 218–259. https://doi.org/10.1108/EUM0000000007083 DOI: https://doi.org/10.1108/EUM0000000007083

Bhattacherjee, A. (2012). Social Science Research: Principles, Methods, and Practices. University of South Florida.

Bilal, D., Rehman, A.-U., & Ali, R. (2018). Internet of Things (IoT) Protocols: A Brief Exploration of MQTT and CoAP. International Journal of Computer Applications, 179(27), 9–14. https://doi.org/10.5120/ijca2018916438 DOI: https://doi.org/10.5120/ijca2018916438

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer. DOI: https://doi.org/10.1007/978-94-007-6857-4

Brydges, C. R. (2019). Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology. Innovation in Aging, 3(4), 1–8. https://doi.org/10.1093/geroni/igz036 DOI: https://doi.org/10.1093/geroni/igz036

Campbell, D. T., & Stanley, J. C. (1963). Experimental and Quasi-Experimental Designs for Research. Houghton Mifflin Company. https://www.sfu.ca/~palys/Campbell&Stanley-1959-Exptl&QuasiExptlDesignsForResearch.pdf

Canals, L. (2017). Instruments for Gathering Data. In E. Moore & M. Dooly (Eds.), Qualitative approaches to research on plurilingual education / Enfocaments qualitatius per a la recerca en educació plurilingüe / Enfoques cualitativos para la investigación en educación plurilingüe (pp. 390–401). Research-publishing.net. https://doi.org/10.14705/rpnet.2017.emmd2016.637 DOI: https://doi.org/10.14705/rpnet.2017.emmd2016.637

Carin, A. A., & Sund, R. B. (1989). Teaching Science Through Discovery. Merrill Publishing Company.

Çevik, M., & Bakioğlu, B. (2022). The Effect of STEM Education Integrated into Teaching-Learning Approaches (SEITLA) on Learning Outcomes: A Meta-Analysis Study. International Journal of Progressive Education, 18(2), 119–135. https://doi.org/10.29329/ijpe.2022.431.8 DOI: https://doi.org/10.29329/ijpe.2022.431.8

Chiappetta, E. L., & Koballa, T. R. (2010). Science Instruction in The Middle and Secondinary Schools Developing Fundamental Knowledge and Skills (7th ed.). Pearson Education Inc.

Çoban, M., & Goksu, İ. (2022). Using virtual reality learning environments to motivate and socialize undergraduates in distance learning. Participatory Educational Research, 9(2), 199–218. https://doi.org/10.17275/per.22.36.9.2 DOI: https://doi.org/10.17275/per.22.36.9.2

Creswell, J. W. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications.

Dhingra, S., Madda, R. B., Gandomi, A. H., Patan, R., & Daneshmand, M. (2019). Internet of Things Mobile–Air Pollution Monitoring System (IoT-Mobair). IEEE Internet of Things Journal, 6(3), 5577–5584. https://doi.org/10.1109/JIOT.2019.2903821 DOI: https://doi.org/10.1109/JIOT.2019.2903821

Dimitrov, D. M. (2012). Statistical Methods for Validation of Assessment Scale Data in Counseling and Related Fields. Wiley.

Eija, N., Sari, P.-S., Kristina, M., Tiina, T., Jonna, J., & Heli-Maria, K. (2024). The experiences of health sciences students with hybrid learning in health sciences education—A qualitative study. Nurse Education Today, 132, 106017. https://doi.org/10.1016/j.nedt.2023.106017 DOI: https://doi.org/10.1016/j.nedt.2023.106017

Ferrari, A., Punie, Y., & Redecker, C. (2012). Understanding Digital Competence in the 21st Century: An Analysis of Current Frameworks. In A. Ravenscroft, S. Lindstaedt, C. D. Kloos, & D. Hernández-Leo (Eds.), 21st Century Learning for 21st Century Skills (Vol. 7563, pp. 79–92). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-33263-0_7 DOI: https://doi.org/10.1007/978-3-642-33263-0_7

Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2023). How to design and evaluate research in education (11th ed.). (11th ed.). McGraw Hill.

Ghashim, I. A., & Arshad, M. (2023). Internet of Things (IoT)-Based Teaching and Learning: Modern Trends and Open Challenges. Sustainability, 15(21), 15656. https://doi.org/10.3390/su152115656 DOI: https://doi.org/10.3390/su152115656

Ghory, S., & Ghafory, H. (2021). The impact of modern technology in the teaching and learning process. International Journal of Innovative Research and Scientific Studies, 4(3), 168–173. https://doi.org/10.53894/ijirss.v4i3.73 DOI: https://doi.org/10.53894/ijirss.v4i3.73

Gilster, P., & Gilster, P. (1997). Digital literacy. Wiley Computer Pub.

Gubbi, J., Buyya, R., Marusic, S., & Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future Generation Computer Systems, 29(7), 1645–1660. https://doi.org/10.1016/j.future.2013.01.010 DOI: https://doi.org/10.1016/j.future.2013.01.010

Guptha, M. A. (2020). Internet of Things & Its Applications. Malla Reddy College of Engineering & Technology.

Handayani, S., Hussin, M., & Norman, H. (2023). Technological Pedagogical Content Knowledge (TPACK) Model in teaching: A Review and Bibliometric Analysis. Pegem Journal of Education and Instruction, 13(3), 176–190. https://doi.org/10.47750/pegegog.13.03.19 DOI: https://doi.org/10.47750/pegegog.13.03.19

Harwell, M. R., & Gatti, G. G. (2001). Rescaling Ordinal Data to Interval Data in Educational Research. Review of Educational Research, 71(1), 105–131. https://doi.org/10.3102/00346543071001105 DOI: https://doi.org/10.3102/00346543071001105

Hollweck, T. (2015). Case Study Research Design and Methods. Canadian Journal of Program Evaluation, 30(1), 108–110. https://doi.org/10.3138/cjpe.30.1.108 DOI: https://doi.org/10.3138/cjpe.30.1.108

Hu, C.-C., Yeh, H.-C., & Chen, N.-S. (2023). Teacher development in robot and IoT knowledge, skills, and attitudes with the use of the TPACK-based Support-Stimulate-Seek approach. Interactive Learning Environments, 31(9), 5811–5830. https://doi.org/10.1080/10494820.2021.2019058 DOI: https://doi.org/10.1080/10494820.2021.2019058

Hu-Au, E., & Lee, J. J. (2017). Virtual reality in education: A tool for learning in the experience age. International Journal of Innovation in Education, 4, 215. https://api.semanticscholar.org/CorpusID:56655416 DOI: https://doi.org/10.1504/IJIIE.2017.091481

Ibrahim, M., & Şeker, H. (2022). Examination of the attitudes of grade 7 and 8 students towards STEM education in Turkey and Ghana. LUMAT: International Journal on Math, Science and Technology Education, 10(1). https://doi.org/10.31129/LUMAT.10.1.1657 DOI: https://doi.org/10.31129/LUMAT.10.1.1657

Inde, K. H., Kaleka, M. B. U., & Ilyas, I. (2020). The Effect of Discovery Learning Model on Learning Outcome of Grade-VII Students of SMP N 5 Nangapanda. Journal of Science Education Research, 4(1), 11–14. https://doi.org/10.21831/jser.v4i1.34233 DOI: https://doi.org/10.21831/jser.v4i1.34233

Jatmika, S., Purwanto, A., & Dwandaru, W. S. B. (2022). Effect of Sound Vibration towards the Stomata Opening Area via Edge Detection Analysis. Revista Mexicana de Física, 68(5 Sep-Oct). https://doi.org/10.31349/RevMexFis.68.051402 DOI: https://doi.org/10.31349/RevMexFis.68.051402

Johnson, R. B., & Christensen, L. (2019). Educational research: Quantitative, qualitative, and mixed approaches (6th ed.). SAGE Publications.

Joyce, B., Weil, M., & Calhoun, E. (2015). Models of Teaching (Ninth Edition) (9th ed.). Pearson Education, Inc.

Kadarisman, N., Agustika, D. K., Purwanto, A., Alvianty, V., & Wibowo, B. (2019). Characterization of Sound Spectrum based on Natural Animals as an Alternative Source of Harmonic System Audio Bio Stimulators for Increasing Productivity of Food Plants. Journal of Physics: Conference Series, 1387(1), 012098. https://doi.org/10.1088/1742-6596/1387/1/012098 DOI: https://doi.org/10.1088/1742-6596/1387/1/012098

Kasmaienezhadfard, S., Talebloo, B., Roustae, R., & Pourrajab, M. (2015). Students’ Learning Through Teaching Creativity: Teachers’ Perception. Journal of Educational, Health and Community Psychology, 4(1), 1–13. https://dx.doi.org/10.12928/jehcp.v4i1.3699

Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 11. https://doi.org/10.1186/s40594-016-0046-z DOI: https://doi.org/10.1186/s40594-016-0046-z

Kilbane, C. R., & Milman, N. B. (2014). Teaching Models Designing Instruction for 21st Century Learners. Pearson Education.

Kumar, S., Tiwari, P., & Zymbler, M. (2019). Internet of Things is a revolutionary approach for future technology enhancement: A review. Journal of Big Data, 6(1), 111. https://doi.org/10.1186/s40537-019-0268-2 DOI: https://doi.org/10.1186/s40537-019-0268-2

Lämsä, J., Virtanen, A., Tynjälä, P., Maunuksela, J., & Koskinen, P. (2023). Exploring students’ perceptions of self-assessment in the context of problem solving in STEM. LUMAT: International Journal on Math, Science and Technology Education, 11(2). https://doi.org/10.31129/LUMAT.11.2.2028 DOI: https://doi.org/10.31129/LUMAT.11.2.2028

Law, N., Woo, D., & Wong, G. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4.2. UNESCO Institute for Statistics. http://uis.unesco.org/sites/default/files/documents/ip51-global-framework-reference-digital-literacy-skills-2018-en.pdf

Lawshe, C. H. (1975). A Quantitative Approach to Content Validity. 28, 563–575. http://dx.doi.org/10.1111/j.1744-6570.1975.tb01393.x DOI: https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Lee, E. A.-L., Wong, K. W., & Fung, C. C. (2009). Learning effectiveness in a desktop virtual reality-based learning environment. Asia-Pacific Society for Computers in Education.

Linacre, J. M. (1994). Sample Size and Item Calibration Stability. Rasch Measurement Transactions, 7(4), 328.

Linacre, J. M. (2002). Optimizing Rating Scale Category Effectiveness. Journal of Applied Measurement, 3(1), 85–106.

Louangrath, P. (2014). Sample Size Determination for Non-Finite Population. International Conference on Discrete Mathematics and Applied Sciences. International Conference on Discrete Mathematics and Applied Sciences, Bangkok, Thailand. https://doi.org/10.13140/2.1.4785.7286 DOI: https://doi.org/10.2139/ssrn.2710455

Louangrath, P. I. (2017). Minimum Sample Size Method Based On Survey Scales. International Journal of Research & Methodology in Social Science, 3(3), 44–54. https://doi.org/10.5281/ZENODO.1322593

Mangal, S. K., & Mangal, S. (2019). Assessment for Learning. PHI Learning Private Limited.

Mantovani, A. P. K., Duanaiko, A., Haryanto, J., Putri, T. E., & Angendari, D. A. D. (2021). Higher Education 4.0 and the Readiness of Indonesia’s Future Workforce. Center for Digital Society, Universitas Gadjah Mada.

Masyhura, N., & Ramadan, Z. H. (2021). Implementation of Digital Literacy in Elementary Schools. International Journal of Elementary Education, 5(4), 639. https://doi.org/10.23887/ijee.v5i4.39480 DOI: https://doi.org/10.23887/ijee.v5i4.39480

McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 276–282. https://doi.org/10.11613/BM.2012.031 DOI: https://doi.org/10.11613/BM.2012.031

Meyer, J. P. (2014). Applied Measurement with jMetrik. Routledge. DOI: https://doi.org/10.4324/9780203115190

Mouha, R. A. (2021). Internet of Things (IoT). Journal of Data Analysis and Information Processing, 09(02), 77–101. https://doi.org/10.4236/jdaip.2021.92006 DOI: https://doi.org/10.4236/jdaip.2021.92006

Nurcahyo, E., Agung S, L., & Djono, D. (2018). The Implementation of Discovery Learning Model with Scientific Learning Approach to Improve Students’ Critical Thinking in Learning History. International Journal of Multicultural and Multireligious Understanding, 5(3), 106. https://doi.org/10.18415/ijmmu.v5i3.234 DOI: https://doi.org/10.18415/ijmmu.v5i3.234

Orts-Cortés, M. I., Moreno-Casbas, T., Squires, A., Fuentelsaz-Gallego, C., Maciá-Soler, L., & González-María, E. (2013). Content validity of the Spanish version of the Practice Environment Scale of the Nursing Work Index. Applied Nursing Research, 26(4), e5–e9. https://doi.org/10.1016/j.apnr.2013.08.006 DOI: https://doi.org/10.1016/j.apnr.2013.08.006

Patel, C., & Doshi, N. (2020). ”A Novel MQTT Security framework In Generic IoT Model”. Procedia Computer Science, 171, 1399–1408. https://doi.org/10.1016/j.procs.2020.04.150 DOI: https://doi.org/10.1016/j.procs.2020.04.150

Phuapan, P., Viriyavejakul, C., & Pimdee, P. (2015). Elements of digital literacy skill: A conceptual analysis. Asian International Journal of Social Sciences, 15(4), 88–99. https://doi.org/10.29139/aijss.20150406 DOI: https://doi.org/10.29139/aijss.20150406

Pogoh, D. S., Natanael Pinangkaan, S., Saputra Bawimbang, D. E., Jiferson Takaendengan, D., Ladi, J. K., & Torar, M. (2025). The Implementation of Internet of Things (IOT) In Education to Improve The Quality of Learning. Jurnal Syntax Admiration, 5(12), 5980–5986. https://doi.org/10.46799/jsa.v6i1.1978 DOI: https://doi.org/10.46799/jsa.v6i1.1978

Serpanos, D., & Wolf, M. (2018). Internet-of-Things (IoT) Systems. Springer International Publishing. https://doi.org/10.1007/978-3-319-69715-4 DOI: https://doi.org/10.1007/978-3-319-69715-4

Setyawarno, D., Rosana, D., Widodo, E., Maryati, & Rahayu, D. P. (2024). The impact of hybrid model science practicum based on IoT and VR on prospective science teacher students’ creative thinking skills. International Journal of Innovative Research and Scientific Studies, 7(3), 936–950. https://doi.org/10.53894/ijirss.v7i3.2979 DOI: https://doi.org/10.53894/ijirss.v7i3.2979

Simeon, M. I., Samsudin, M. A., & Yakob, N. (2022). Effect of design thinking approach on students’ achievement in some selected physics concepts in the context of STEM learning. International Journal of Technology and Design Education, 32(1), 185–212. https://doi.org/10.1007/s10798-020-09601-1 DOI: https://doi.org/10.1007/s10798-020-09601-1

Sudaryono, Rahardja, U., Aini, Q., Isma Graha, Y., & Lutfiani, N. (2019). Validity of Test Instruments. Journal of Physics: Conference Series, 1364(1), 012050. https://doi.org/10.1088/1742-6596/1364/1/012050 DOI: https://doi.org/10.1088/1742-6596/1364/1/012050

Sultan, T. (2019). INTERNET OF THINGS-IOT: DEFINITION, ARCHITECTURE AND APPLICATIONS. Egyptian Journal of Applied Science, 34(1), 81–95. https://doi.org/10.21608/ejas.2019.151723 DOI: https://doi.org/10.21608/ejas.2019.151723

Suryadarma, I., Kadarisman, N., & Dwandaru, W. (2020). The increase of stomata opening area in corn plant stimulated by Dundubia manifera insect sound. Int. J. Eng. Technol. Manag. Res, 6(5), 107–116. DOI: https://doi.org/10.29121/ijetmr.v6.i5.2019.377

Tedeschini, B. C., Savazzi, S., Stoklasa, R., Barbieri, L., Stathopoulos, I., Nicoli, M., & Serio, L. (2022). Decentralized Federated Learning for Healthcare Networks: A Case Study on Tumor Segmentation. IEEE Access, 10, 8693–8708. https://doi.org/10.1109/ACCESS.2022.3141913 DOI: https://doi.org/10.1109/ACCESS.2022.3141913

Teo, T. (2013). Handbook of Quantitative Methods for Educational Research. Sense Publishers. DOI: https://doi.org/10.1007/978-94-6209-404-8

Timotheou, S., Miliou, O., Dimitriadis, Y., Sobrino, S. V., Giannoutsou, N., Cachia, R., Monés, A. M., & Ioannou, A. (2023). Impacts of digital technologies on education and factors influencing schools’ digital capacity and transformation: A literature review. Education and Information Technologies, 28(6), 6695–6726. https://doi.org/10.1007/s10639-022-11431-8 DOI: https://doi.org/10.1007/s10639-022-11431-8

Tutkyshbayeva, S., & Zakirova, A. (2024). Analysing IoT Digital Education: Fostering Students’ Understanding and Digital Literacy. International Journal of Engineering Pedagogy (iJEP), 14(4), 4–23. https://doi.org/10.3991/ijep.v14i4.45489 DOI: https://doi.org/10.3991/ijep.v14i4.45489

Voogt, J., Fisser, P., Pareja Roblin, N., Tondeur, J., & Van Braak, J. (2013). Technological pedagogical content knowledge – a review of the literature. Journal of Computer Assisted Learning, 29(2), 109–121. https://doi.org/10.1111/j.1365-2729.2012.00487.x DOI: https://doi.org/10.1111/j.1365-2729.2012.00487.x

Vysotskaya, E., Khrebtova, S., & Rekhtman, I. (2015). Linking macro and micro through element cycle: Desing research approach for introdutory chemistry course for 6-7 grades. Lumat: International Journal of Math, Science and Technology Education, 3(3), 409–428. https://doi.org/10.31129/lumat.v3i3.1038 DOI: https://doi.org/10.31129/lumat.v3i3.1038

Wahyudi, A. K., Kairupan, Y. J., & Masengi, Y. C. (2018). Alat Peraga Jantung Manusia Berbasis Augmented Reality dengan Menggunakan Teknik 3D Object Tracking. CogITo Smart Journal, 4(1), 46–59. https://doi.org/10.31154/cogito.v4i1.101.46-59 DOI: https://doi.org/10.31154/cogito.v4i1.101.46-59

Xhomara, V., & Uka, A. (2023). Creativity in Education: Fostering Creativity in the Classroom Using Creative Teaching Methods. Beder Journal of Educational Sciences, 26(2). https://doi.org/10.5281/ZENODO.8068813

Zahra, N. (2023). Enhancing Inclusion in the National Digital Literacy Index: From Measurement to Empowermen. Center for Indonesian Policy Studies. https://repository.cips-indonesia.org/media/publications/567714-enhancing-inclusion-in-the-national-digi-843210f3.pdf

Zhang, H., Cao, H., Zhou, Y., Gu, C., & Li, D. (2023). Hybrid deep learning model for accurate classification of solid waste in the society. Urban Climate, 49, 101485. https://doi.org/10.1016/j.uclim.2023.101485 DOI: https://doi.org/10.1016/j.uclim.2023.101485