Exploring students’ perceptions of self-assessment in the context of problem solving in STEM
DOI:
https://doi.org/10.31129/LUMAT.11.2.2028Keywords:
assessment, higher education, problem solving, self-assessment, STEMAbstract
Central goals of higher education in STEM domains include learning of problem solving and self-assessment skills. To achieve these goals, we propose a novel self-assessment method called the Solve-Correct-Assess-Negotiate (SCAN) method of assessing problem solving that includes both formative and summative elements. We study students’ learning experiences in courses involving different methods of assessing problem solving (Course 1 including teacher-led assessment, Ntrad = 53; Course 2 including SCAN method, NSCAN = 56) and specifically associations between these learning experiences and students' perceptions of the SCAN method. We found that the students relied on teacher-led assessment more than the self-assessment. The perceived utility of the self-assessment was positively associated with a deeper approach to learning in Course 2 than in Course 1. Students who found the self-assessment less beneficial also perceived less support from the learning environment. Our findings suggest that the successful implementation of novel self-assessment-based practices for problem-solving requires personalized support for self-assessment, teachers’ awareness of the different perceptions that students have towards these practices, and discussion among teachers and students on the rationale, utility, and reliability of the different practices.
References
Andrade, H. L. (2019). A Critical Review of Research on Student Self-Assessment. Frontiers in Education, 4(87), 1–13. https://doi.org/10.3389/feduc.2019.00087 DOI: https://doi.org/10.3389/feduc.2019.00087
Andrade, H. L., & Du, Y. (2007). Student responses to criteria‐referenced self‐assessment. Assessment & Evaluation in Higher Education, 32(2), 159–181. https://doi.org/10.1080/02602930600801928 DOI: https://doi.org/10.1080/02602930600801928
Andrade, H. L., & Valtcheva, A. (2009). Promoting Learning and Achievement Through Self-Assessment. Theory Into Practice, 48(1), 12–19. https://doi.org/10.1080/00405840802577544 DOI: https://doi.org/10.1080/00405840802577544
Ashenafi, M. M. (2017). Peer-assessment in higher education – twenty-first century practices, challenges and the way forward. Assessment & Evaluation in Higher Education, 42(2), 226–251. https://doi.org/10.1080/02602938.2015.1100711 DOI: https://doi.org/10.1080/02602938.2015.1100711
Biggs, J. B., & Tang, C. S. (2011). Teaching for quality learning at university: What the student does (4th edition). McGraw-Hill, Society for Research into Higher Education & Open University Press.
Børte, K., Nesje, K., & Lillejord, S. (2023). Barriers to student active learning in higher education. Teaching in Higher Education, 28(3), 597–615. https://doi.org/10.1080/13562517.2020.1839746 DOI: https://doi.org/10.1080/13562517.2020.1839746
Boud, D., & Falchikov, N. (1989). Quantitative Studies of Student Self-Assessment in Higher Education: A Critical Analysis of Findings. Higher Education, 18(5), 529–549. https://doi.org/10.1007/BF00138746 DOI: https://doi.org/10.1007/BF00138746
Boud, D., & Falchikov, N. (2006). Aligning assessment with long‐term learning. Assessment & Evaluation in Higher Education, 31(4), 399–413. https://doi.org/10.1080/02602930600679050 DOI: https://doi.org/10.1080/02602930600679050
Bourke, R. (2018). Self-assessment to incite learning in higher education: Developing ontological awareness. Assessment & Evaluation in Higher Education, 43(5), 827–839. https://doi.org/10.1080/02602938.2017.1411881 DOI: https://doi.org/10.1080/02602938.2017.1411881
Broadbent, J., Panadero, E., & Boud, D. (2018). Implementing summative assessment with a formative flavour: A case study in a large class. Assessment & Evaluation in Higher Education, 43(2), 307–322. https://doi.org/10.1080/02602938.2017.1343455 DOI: https://doi.org/10.1080/02602938.2017.1343455
Candel, C., Vidal-Abarca, E., Cerdán, R., Lippmann, M., & Narciss, S. (2020). Effects of timing of formative feedback in computer-assisted learning environments. Journal of Computer Assisted Learning, 36(5), 718–728. https://doi.org/10.1111/jcal.12439 DOI: https://doi.org/10.1111/jcal.12439
Carroll, D. (2020). Observations of student accuracy in criteria-based self-assessment. Assessment & Evaluation in Higher Education, 45(8), 1088–1105. https://doi.org/10.1080/02602938.2020.1727411 DOI: https://doi.org/10.1080/02602938.2020.1727411
de Jong, T. (2019). Moving towards engaged learning in STEM domains; there is no simple answer, but clearly a road ahead. Journal of Computer Assisted Learning, 35(2), 153–167. https://doi.org/10.1111/jcal.12337 DOI: https://doi.org/10.1111/jcal.12337
Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019). Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences, 116(39), 19251–19257. https://doi.org/10.1073/pnas.1821936116 DOI: https://doi.org/10.1073/pnas.1821936116
Docktor, J. L., Dornfeld, J., Frodermann, E., Heller, K., Hsu, L., Jackson, K. A., Mason, A., Ryan, Q. X., & Yang, J. (2016). Assessing student written problem solutions: A problem-solving rubric with application to introductory physics. Physical Review Physics Education Research, 12(1), 010130. https://doi.org/10.1103/PhysRevPhysEducRes.12.010130 DOI: https://doi.org/10.1103/PhysRevPhysEducRes.12.010130
Entwistle, N., & McCune, V. (2004). The Conceptual Bases of Study Strategy Inventories. Educational Psychology Review, 16(4), 325–345. https://doi.org/10.1007/s10648-004-0003-0 DOI: https://doi.org/10.1007/s10648-004-0003-0
Entwistle, N., McCune, V., & Hounsell, J. (2003). Investigating ways of enhancing university teaching-learning environments: Measuring students’ approaches to studying and perceptions of teaching. In Powerful learning environments: Unravelling basic components and dimensions (pp. 89–108). Elsevier Science Limited. https://www.research.ed.ac.uk/en/publications/investigating-ways-of-enhancing-university-teaching-learning-envi
Fryer, L. K., & Vermunt, J. D. (2018). Regulating approaches to learning: Testing learning strategy convergences across a year at university. British Journal of Educational Psychology, 88(1), 21–41. https://doi.org/10.1111/bjep.12169 DOI: https://doi.org/10.1111/bjep.12169
Häsä, J., Rämö, J., & Nieminen, J. H. (2021). Supporting quality of learning by letting students give their own grades: An innovative self-assessment model in university mathematics. In Z. Yan & L. Yang (Eds.), Assessment as Learning: Maximising Opportunities for Student Learning and Achievement (1st edition, pp. 232–243). Routledge. DOI: https://doi.org/10.4324/9781003052081-16
Jax, J., Ahn, J. N., & Lin-Siegler, X. (2019). Using contrasting cases to improve self-assessment in physics learning. Educational Psychology, 39(6), 815–838. https://doi.org/10.1080/01443410.2019.1577360 DOI: https://doi.org/10.1080/01443410.2019.1577360
Kangaslampi, R., Asikainen, H., & Virtanen, V. (2022). Students’ perceptions of self-assessment and their approaches to learning in university mathematics. LUMAT: International Journal on Math, Science and Technology Education, 10(1), Article 1. https://doi.org/10.31129/LUMAT.10.1.1604 DOI: https://doi.org/10.31129/LUMAT.10.1.1604
Kearney, S. (2013). Improving engagement: The use of ‘Authentic self-and peer-assessment for learning’ to enhance the student learning experience. Assessment & Evaluation in Higher Education, 38(7), 875–891. https://doi.org/10.1080/02602938.2012.751963 DOI: https://doi.org/10.1080/02602938.2012.751963
Koskinen, P. (2012). Tietokone avuksi pienryhmien ripeään muodostamiseen (engl. Computer assistance for the rapid formation of small groups). Yliopistopedagogiikka, 19(1), 26–27. https://lehti.yliopistopedagogiikka.fi/2012/05/03/tietokone-avuksi-pienryhmien-ripeaan-muodostamiseen/
Koskinen, P., & Lämsä, J. (2019). Ruotiminen: Toimintamalli harjoitustehtävien läpikäyntiin. Yliopistopedagogiikka, 26(2), 52–55.
Koskinen, P., Lämsä, J., Maunuksela, J., Hämäläinen, R., & Viiri, J. (2018). Primetime learning: Collaborative and technology-enhanced studying with genuine teacher presence. International Journal of STEM Education, 5(20), 1–13. https://doi.org/10.1186/s40594-018-0113-8 DOI: https://doi.org/10.1186/s40594-018-0113-8
Leung, A. C. K., Hashemi Pour, B., Reynolds, D., & Jerzak, S. (2017). New assessment process in an introductory undergraduate physics laboratory: An exploration on collaborative learning. Assessment & Evaluation in Higher Education, 42(2), 169–181. https://doi.org/10.1080/02602938.2015.1089977 DOI: https://doi.org/10.1080/02602938.2015.1089977
Lindblom-Ylänne, S., Parla, A., & Postareff, L. (2004). Challenges in analysing change in students’ approaches to learning. In D. Gijbels, V. Donche, J. T. E. Richardson, & J. D. Vermunt (Eds.), Learning Patterns in Higher Education (pp. 232–248). Routledge.
Lindblom-Ylänne, S., Parpala, A., & Postareff, L. (2019). What constitutes the surface approach to learning in the light of new empirical evidence? Studies in Higher Education, 44(12), 2183–2195. https://doi.org/10.1080/03075079.2018.1482267 DOI: https://doi.org/10.1080/03075079.2018.1482267
Marton, F., & Säljö, R. (1979). On qualitative differences in learning: I—Outcome and process. British Journal of Educational Psychology, 46(1), 4–11. https://doi.org/10.1111/j.2044-8279.1976.tb02980.x DOI: https://doi.org/10.1111/j.2044-8279.1976.tb02980.x
McCune, V., & Entwistle, N. (2011). Cultivating the disposition to understand in 21st century university education. Learning and Individual Differences, 21(3), 303–310. https://doi.org/10.1016/j.lindif.2010.11.017 DOI: https://doi.org/10.1016/j.lindif.2010.11.017
McNeish, D., & Wolf, M. G. (2020). Thinking twice about sum scores. Behavior Research Methods, 52(6), 2287–2305. https://doi.org/10.3758/s13428-020-01398-0 DOI: https://doi.org/10.3758/s13428-020-01398-0
Nieminen, J. H., Asikainen, H., & Rämö, J. (2021). Promoting deep approach to learning and self-efficacy by changing the purpose of self-assessment: A comparison of summative and formative models. Studies in Higher Education, 46(7), 1296–1311. https://doi.org/10.1080/03075079.2019.1688282 DOI: https://doi.org/10.1080/03075079.2019.1688282
Panadero, E., Brown, G. T. L., & Strijbos, J.-W. (2016). The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2 DOI: https://doi.org/10.1007/s10648-015-9350-2
Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 74–98. https://doi.org/10.1016/j.edurev.2017.08.004 DOI: https://doi.org/10.1016/j.edurev.2017.08.004
Parpala, A., Lindblom-Ylänne, S., Komulainen, E., & Entwistle, N. (2013). Assessing students’ experiences of teaching–learning environments and approaches to learning: Validation of a questionnaire in different countries and varying contexts. Learning Environments Research, 16(2), 201–215. https://doi.org/10.1007/s10984-013-9128-8 DOI: https://doi.org/10.1007/s10984-013-9128-8
Parpala, A., Lindblom-Ylänne, S., Komulainen, E., Litmanen, T., & Hirsto, L. (2010). Students’ approaches to learning and their experiences of the teaching–learning environment in different disciplines. British Journal of Educational Psychology, 80(2), 269–282. https://doi.org/10.1348/000709909X476946 DOI: https://doi.org/10.1348/000709909X476946
Paulhus, D. L. (2002). Socially desirable responding: The evolution of a construct. In The role of constructs in psychological and educational measurement (pp. 49–69). Lawrence Erlbaum Associates Publishers.
Postareff, L., Parpala, A., & Lindblom-Ylänne, S. (2015). Factors contributing to changes in a deep approach to learning in different learning environments. Learning Environments Research, 18(3), 315–333. https://doi.org/10.1007/s10984-015-9186-1 DOI: https://doi.org/10.1007/s10984-015-9186-1
Randles, C., Overton, T., Galloway, R., & Wallace, M. (2018). How do approaches to solving open-ended problems vary within the science disciplines? International Journal of Science Education, 40(11), 1367–1390. https://doi.org/10.1080/09500693.2018.1503432 DOI: https://doi.org/10.1080/09500693.2018.1503432
Struyven, K., Dochy, F., Janssens, S., & Gielen, S. (2006). On the dynamics of students’ approaches to learning: The effects of the teaching/learning environment. Learning and Instruction, 16(4), 279–294. https://doi.org/10.1016/j.learninstruc.2006.07.001 DOI: https://doi.org/10.1016/j.learninstruc.2006.07.001
Taras, M. (2016). Situating power potentials and dynamics of learners and tutors within self-assessment models. Journal of Further and Higher Education, 40(6), 846–863. https://doi.org/10.1080/0309877X.2014.1000283 DOI: https://doi.org/10.1080/0309877X.2014.1000283
Tremblay, K., Lalancette, D., & Roseveare, D. (2012). Assessment of Higher Education Learning Outcomes—AHELO. Feasibility study report. Volume 1: Design and Implementation. OECD. https://www.oecd.org/education/skills-beyond-school/AHELOFSReportVolume1.pdf
Tynjälä, P., Virtanen, A., Klemola, U., Kostiainen, E., & Rasku-Puttonen, H. (2016). Developing social competence and other generic skills in teacher education: Applying the model of integrative pedagogy. European Journal of Teacher Education, 39(3), 368–387. https://doi.org/10.1080/02619768.2016.1171314 DOI: https://doi.org/10.1080/02619768.2016.1171314
Utriainen, J., Tynjälä, P., Kallio, E., & Marttunen, M. (2018). Validation of a modified version of the Experiences of Teaching and Learning Questionnaire. Studies in Educational Evaluation, 56, 133–143. https://doi.org/10.1016/j.stueduc.2017.12.007 DOI: https://doi.org/10.1016/j.stueduc.2017.12.007
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003). Taking the Load Off a Learner’s Mind: Instructional Design for Complex Learning. Educational Psychologist, 38(1), 5–13. https://doi.org/10.1207/S15326985EP3801_2 DOI: https://doi.org/10.1207/S15326985EP3801_2
Vermunt, J. D., & Donche, V. (2017). A Learning Patterns Perspective on Student Learning in Higher Education: State of the Art and Moving Forward. Educational Psychology Review, 29(2), 269–299. https://doi.org/10.1007/s10648-017-9414-6 DOI: https://doi.org/10.1007/s10648-017-9414-6
Virtanen, A., & Tynjälä, P. (2019). Factors explaining the learning of generic skills: A study of university students’ experiences. Teaching in Higher Education, 24(7), 880–894. https://doi.org/10.1080/13562517.2018.1515195 DOI: https://doi.org/10.1080/13562517.2018.1515195
Virtanen, A., Tynjälä, P., & Collin, K. (2009). Characteristics of Workplace Learning Among Finnish Vocational Students. Vocations and Learning, 2(3), 153–175. https://doi.org/10.1007/s12186-009-9022-9 DOI: https://doi.org/10.1007/s12186-009-9022-9
Wancham, K., & Tangdhanakanond, K. (2022). Effects of Feedback Types and Opportunities to Change Answers on Achievement and Ability to Solve Physics Problems. Research in Science Education, 52(2), 427–444. https://doi.org/10.1007/s11165-020-09956-4 DOI: https://doi.org/10.1007/s11165-020-09956-4
Yan, Z., & Carless, D. (2021). Self-assessment is about more than self: The enabling role of feedback literacy. Assessment & Evaluation in Higher Education, 1–13. https://doi.org/10.1080/02602938.2021.2001431 DOI: https://doi.org/10.1080/02602938.2021.2001431
Yan, Z., Wang, X., Boud, D., & Lao, H. (2021). The effect of self-assessment on academic performance and the role of explicitness: A meta-analysis. Assessment & Evaluation in Higher Education, 0(0), 1–15. https://doi.org/10.1080/02602938.2021.2012644
Yan, Z., Wang, X., Boud, D., & Lao, H. (2023). The effect of self-assessment on academic performance and the role of explicitness: A meta-analysis. Assessment & Evaluation in Higher Education, 48(1), 1–15. https://doi.org/10.1080/02602938.2021.2012644 DOI: https://doi.org/10.1080/02602938.2021.2012644
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 Joni Lämsä, Anne Virtanen, Päivi Tynjälä, Jussi Maunuksela, Pekka Koskinen
This work is licensed under a Creative Commons Attribution 4.0 International License.
