Exploring students’ perceptions of self-assessment in the context of problem solving in STEM

Authors

DOI:

https://doi.org/10.31129/LUMAT.11.2.2028

Keywords:

assessment, higher education, problem solving, self-assessment, STEM

Abstract

Central goals of higher education in STEM domains include learning of problem solving and self-assessment skills. To achieve these goals, we propose a novel self-assessment method called the Solve-Correct-Assess-Negotiate (SCAN) method of assessing problem solving that includes both formative and summative elements. We study students’ learning experiences in courses involving different methods of assessing problem solving (Course 1 including teacher-led assessment, Ntrad = 53; Course 2 including SCAN method, NSCAN = 56) and specifically associations between these learning experiences and students' perceptions of the SCAN method. We found that the students relied on teacher-led assessment more than the self-assessment. The perceived utility of the self-assessment was positively associated with a deeper approach to learning in Course 2 than in Course 1. Students who found the self-assessment less beneficial also perceived less support from the learning environment. Our findings suggest that the successful implementation of novel self-assessment-based practices for problem-solving requires personalized support for self-assessment, teachers’ awareness of the different perceptions that students have towards these practices, and discussion among teachers and students on the rationale, utility, and reliability of the different practices.

References

Andrade, H. L. (2019). A Critical Review of Research on Student Self-Assessment. Frontiers in Education, 4(87), 1–13. https://doi.org/10.3389/feduc.2019.00087 DOI: https://doi.org/10.3389/feduc.2019.00087

Andrade, H. L., & Du, Y. (2007). Student responses to criteria‐referenced self‐assessment. Assessment & Evaluation in Higher Education, 32(2), 159–181. https://doi.org/10.1080/02602930600801928 DOI: https://doi.org/10.1080/02602930600801928

Andrade, H. L., & Valtcheva, A. (2009). Promoting Learning and Achievement Through Self-Assessment. Theory Into Practice, 48(1), 12–19. https://doi.org/10.1080/00405840802577544 DOI: https://doi.org/10.1080/00405840802577544

Ashenafi, M. M. (2017). Peer-assessment in higher education – twenty-first century practices, challenges and the way forward. Assessment & Evaluation in Higher Education, 42(2), 226–251. https://doi.org/10.1080/02602938.2015.1100711 DOI: https://doi.org/10.1080/02602938.2015.1100711

Biggs, J. B., & Tang, C. S. (2011). Teaching for quality learning at university: What the student does (4th edition). McGraw-Hill, Society for Research into Higher Education & Open University Press.

Børte, K., Nesje, K., & Lillejord, S. (2023). Barriers to student active learning in higher education. Teaching in Higher Education, 28(3), 597–615. https://doi.org/10.1080/13562517.2020.1839746 DOI: https://doi.org/10.1080/13562517.2020.1839746

Boud, D., & Falchikov, N. (1989). Quantitative Studies of Student Self-Assessment in Higher Education: A Critical Analysis of Findings. Higher Education, 18(5), 529–549. https://doi.org/10.1007/BF00138746 DOI: https://doi.org/10.1007/BF00138746

Boud, D., & Falchikov, N. (2006). Aligning assessment with long‐term learning. Assessment & Evaluation in Higher Education, 31(4), 399–413. https://doi.org/10.1080/02602930600679050 DOI: https://doi.org/10.1080/02602930600679050

Bourke, R. (2018). Self-assessment to incite learning in higher education: Developing ontological awareness. Assessment & Evaluation in Higher Education, 43(5), 827–839. https://doi.org/10.1080/02602938.2017.1411881 DOI: https://doi.org/10.1080/02602938.2017.1411881

Broadbent, J., Panadero, E., & Boud, D. (2018). Implementing summative assessment with a formative flavour: A case study in a large class. Assessment & Evaluation in Higher Education, 43(2), 307–322. https://doi.org/10.1080/02602938.2017.1343455 DOI: https://doi.org/10.1080/02602938.2017.1343455

Candel, C., Vidal-Abarca, E., Cerdán, R., Lippmann, M., & Narciss, S. (2020). Effects of timing of formative feedback in computer-assisted learning environments. Journal of Computer Assisted Learning, 36(5), 718–728. https://doi.org/10.1111/jcal.12439 DOI: https://doi.org/10.1111/jcal.12439

Carroll, D. (2020). Observations of student accuracy in criteria-based self-assessment. Assessment & Evaluation in Higher Education, 45(8), 1088–1105. https://doi.org/10.1080/02602938.2020.1727411 DOI: https://doi.org/10.1080/02602938.2020.1727411

de Jong, T. (2019). Moving towards engaged learning in STEM domains; there is no simple answer, but clearly a road ahead. Journal of Computer Assisted Learning, 35(2), 153–167. https://doi.org/10.1111/jcal.12337 DOI: https://doi.org/10.1111/jcal.12337

Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019). Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences, 116(39), 19251–19257. https://doi.org/10.1073/pnas.1821936116 DOI: https://doi.org/10.1073/pnas.1821936116

Docktor, J. L., Dornfeld, J., Frodermann, E., Heller, K., Hsu, L., Jackson, K. A., Mason, A., Ryan, Q. X., & Yang, J. (2016). Assessing student written problem solutions: A problem-solving rubric with application to introductory physics. Physical Review Physics Education Research, 12(1), 010130. https://doi.org/10.1103/PhysRevPhysEducRes.12.010130 DOI: https://doi.org/10.1103/PhysRevPhysEducRes.12.010130

Entwistle, N., & McCune, V. (2004). The Conceptual Bases of Study Strategy Inventories. Educational Psychology Review, 16(4), 325–345. https://doi.org/10.1007/s10648-004-0003-0 DOI: https://doi.org/10.1007/s10648-004-0003-0

Entwistle, N., McCune, V., & Hounsell, J. (2003). Investigating ways of enhancing university teaching-learning environments: Measuring students’ approaches to studying and perceptions of teaching. In Powerful learning environments: Unravelling basic components and dimensions (pp. 89–108). Elsevier Science Limited. https://www.research.ed.ac.uk/en/publications/investigating-ways-of-enhancing-university-teaching-learning-envi

Fryer, L. K., & Vermunt, J. D. (2018). Regulating approaches to learning: Testing learning strategy convergences across a year at university. British Journal of Educational Psychology, 88(1), 21–41. https://doi.org/10.1111/bjep.12169 DOI: https://doi.org/10.1111/bjep.12169

Häsä, J., Rämö, J., & Nieminen, J. H. (2021). Supporting quality of learning by letting students give their own grades: An innovative self-assessment model in university mathematics. In Z. Yan & L. Yang (Eds.), Assessment as Learning: Maximising Opportunities for Student Learning and Achievement (1st edition, pp. 232–243). Routledge. DOI: https://doi.org/10.4324/9781003052081-16

Jax, J., Ahn, J. N., & Lin-Siegler, X. (2019). Using contrasting cases to improve self-assessment in physics learning. Educational Psychology, 39(6), 815–838. https://doi.org/10.1080/01443410.2019.1577360 DOI: https://doi.org/10.1080/01443410.2019.1577360

Kangaslampi, R., Asikainen, H., & Virtanen, V. (2022). Students’ perceptions of self-assessment and their approaches to learning in university mathematics. LUMAT: International Journal on Math, Science and Technology Education, 10(1), Article 1. https://doi.org/10.31129/LUMAT.10.1.1604 DOI: https://doi.org/10.31129/LUMAT.10.1.1604

Kearney, S. (2013). Improving engagement: The use of ‘Authentic self-and peer-assessment for learning’ to enhance the student learning experience. Assessment & Evaluation in Higher Education, 38(7), 875–891. https://doi.org/10.1080/02602938.2012.751963 DOI: https://doi.org/10.1080/02602938.2012.751963

Koskinen, P. (2012). Tietokone avuksi pienryhmien ripeään muodostamiseen (engl. Computer assistance for the rapid formation of small groups). Yliopistopedagogiikka, 19(1), 26–27. https://lehti.yliopistopedagogiikka.fi/2012/05/03/tietokone-avuksi-pienryhmien-ripeaan-muodostamiseen/

Koskinen, P., & Lämsä, J. (2019). Ruotiminen: Toimintamalli harjoitustehtävien läpikäyntiin. Yliopistopedagogiikka, 26(2), 52–55.

Koskinen, P., Lämsä, J., Maunuksela, J., Hämäläinen, R., & Viiri, J. (2018). Primetime learning: Collaborative and technology-enhanced studying with genuine teacher presence. International Journal of STEM Education, 5(20), 1–13. https://doi.org/10.1186/s40594-018-0113-8 DOI: https://doi.org/10.1186/s40594-018-0113-8

Leung, A. C. K., Hashemi Pour, B., Reynolds, D., & Jerzak, S. (2017). New assessment process in an introductory undergraduate physics laboratory: An exploration on collaborative learning. Assessment & Evaluation in Higher Education, 42(2), 169–181. https://doi.org/10.1080/02602938.2015.1089977 DOI: https://doi.org/10.1080/02602938.2015.1089977

Lindblom-Ylänne, S., Parla, A., & Postareff, L. (2004). Challenges in analysing change in students’ approaches to learning. In D. Gijbels, V. Donche, J. T. E. Richardson, & J. D. Vermunt (Eds.), Learning Patterns in Higher Education (pp. 232–248). Routledge.

Lindblom-Ylänne, S., Parpala, A., & Postareff, L. (2019). What constitutes the surface approach to learning in the light of new empirical evidence? Studies in Higher Education, 44(12), 2183–2195. https://doi.org/10.1080/03075079.2018.1482267 DOI: https://doi.org/10.1080/03075079.2018.1482267

Marton, F., & Säljö, R. (1979). On qualitative differences in learning: I—Outcome and process. British Journal of Educational Psychology, 46(1), 4–11. https://doi.org/10.1111/j.2044-8279.1976.tb02980.x DOI: https://doi.org/10.1111/j.2044-8279.1976.tb02980.x

McCune, V., & Entwistle, N. (2011). Cultivating the disposition to understand in 21st century university education. Learning and Individual Differences, 21(3), 303–310. https://doi.org/10.1016/j.lindif.2010.11.017 DOI: https://doi.org/10.1016/j.lindif.2010.11.017

McNeish, D., & Wolf, M. G. (2020). Thinking twice about sum scores. Behavior Research Methods, 52(6), 2287–2305. https://doi.org/10.3758/s13428-020-01398-0 DOI: https://doi.org/10.3758/s13428-020-01398-0

Nieminen, J. H., Asikainen, H., & Rämö, J. (2021). Promoting deep approach to learning and self-efficacy by changing the purpose of self-assessment: A comparison of summative and formative models. Studies in Higher Education, 46(7), 1296–1311. https://doi.org/10.1080/03075079.2019.1688282 DOI: https://doi.org/10.1080/03075079.2019.1688282

Panadero, E., Brown, G. T. L., & Strijbos, J.-W. (2016). The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2 DOI: https://doi.org/10.1007/s10648-015-9350-2

Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 74–98. https://doi.org/10.1016/j.edurev.2017.08.004 DOI: https://doi.org/10.1016/j.edurev.2017.08.004

Parpala, A., Lindblom-Ylänne, S., Komulainen, E., & Entwistle, N. (2013). Assessing students’ experiences of teaching–learning environments and approaches to learning: Validation of a questionnaire in different countries and varying contexts. Learning Environments Research, 16(2), 201–215. https://doi.org/10.1007/s10984-013-9128-8 DOI: https://doi.org/10.1007/s10984-013-9128-8

Parpala, A., Lindblom-Ylänne, S., Komulainen, E., Litmanen, T., & Hirsto, L. (2010). Students’ approaches to learning and their experiences of the teaching–learning environment in different disciplines. British Journal of Educational Psychology, 80(2), 269–282. https://doi.org/10.1348/000709909X476946 DOI: https://doi.org/10.1348/000709909X476946

Paulhus, D. L. (2002). Socially desirable responding: The evolution of a construct. In The role of constructs in psychological and educational measurement (pp. 49–69). Lawrence Erlbaum Associates Publishers.

Postareff, L., Parpala, A., & Lindblom-Ylänne, S. (2015). Factors contributing to changes in a deep approach to learning in different learning environments. Learning Environments Research, 18(3), 315–333. https://doi.org/10.1007/s10984-015-9186-1 DOI: https://doi.org/10.1007/s10984-015-9186-1

Randles, C., Overton, T., Galloway, R., & Wallace, M. (2018). How do approaches to solving open-ended problems vary within the science disciplines? International Journal of Science Education, 40(11), 1367–1390. https://doi.org/10.1080/09500693.2018.1503432 DOI: https://doi.org/10.1080/09500693.2018.1503432

Struyven, K., Dochy, F., Janssens, S., & Gielen, S. (2006). On the dynamics of students’ approaches to learning: The effects of the teaching/learning environment. Learning and Instruction, 16(4), 279–294. https://doi.org/10.1016/j.learninstruc.2006.07.001 DOI: https://doi.org/10.1016/j.learninstruc.2006.07.001

Taras, M. (2016). Situating power potentials and dynamics of learners and tutors within self-assessment models. Journal of Further and Higher Education, 40(6), 846–863. https://doi.org/10.1080/0309877X.2014.1000283 DOI: https://doi.org/10.1080/0309877X.2014.1000283

Tremblay, K., Lalancette, D., & Roseveare, D. (2012). Assessment of Higher Education Learning Outcomes—AHELO. Feasibility study report. Volume 1: Design and Implementation. OECD. https://www.oecd.org/education/skills-beyond-school/AHELOFSReportVolume1.pdf

Tynjälä, P., Virtanen, A., Klemola, U., Kostiainen, E., & Rasku-Puttonen, H. (2016). Developing social competence and other generic skills in teacher education: Applying the model of integrative pedagogy. European Journal of Teacher Education, 39(3), 368–387. https://doi.org/10.1080/02619768.2016.1171314 DOI: https://doi.org/10.1080/02619768.2016.1171314

Utriainen, J., Tynjälä, P., Kallio, E., & Marttunen, M. (2018). Validation of a modified version of the Experiences of Teaching and Learning Questionnaire. Studies in Educational Evaluation, 56, 133–143. https://doi.org/10.1016/j.stueduc.2017.12.007 DOI: https://doi.org/10.1016/j.stueduc.2017.12.007

van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003). Taking the Load Off a Learner’s Mind: Instructional Design for Complex Learning. Educational Psychologist, 38(1), 5–13. https://doi.org/10.1207/S15326985EP3801_2 DOI: https://doi.org/10.1207/S15326985EP3801_2

Vermunt, J. D., & Donche, V. (2017). A Learning Patterns Perspective on Student Learning in Higher Education: State of the Art and Moving Forward. Educational Psychology Review, 29(2), 269–299. https://doi.org/10.1007/s10648-017-9414-6 DOI: https://doi.org/10.1007/s10648-017-9414-6

Virtanen, A., & Tynjälä, P. (2019). Factors explaining the learning of generic skills: A study of university students’ experiences. Teaching in Higher Education, 24(7), 880–894. https://doi.org/10.1080/13562517.2018.1515195 DOI: https://doi.org/10.1080/13562517.2018.1515195

Virtanen, A., Tynjälä, P., & Collin, K. (2009). Characteristics of Workplace Learning Among Finnish Vocational Students. Vocations and Learning, 2(3), 153–175. https://doi.org/10.1007/s12186-009-9022-9 DOI: https://doi.org/10.1007/s12186-009-9022-9

Wancham, K., & Tangdhanakanond, K. (2022). Effects of Feedback Types and Opportunities to Change Answers on Achievement and Ability to Solve Physics Problems. Research in Science Education, 52(2), 427–444. https://doi.org/10.1007/s11165-020-09956-4 DOI: https://doi.org/10.1007/s11165-020-09956-4

Yan, Z., & Carless, D. (2021). Self-assessment is about more than self: The enabling role of feedback literacy. Assessment & Evaluation in Higher Education, 1–13. https://doi.org/10.1080/02602938.2021.2001431 DOI: https://doi.org/10.1080/02602938.2021.2001431

Yan, Z., Wang, X., Boud, D., & Lao, H. (2021). The effect of self-assessment on academic performance and the role of explicitness: A meta-analysis. Assessment & Evaluation in Higher Education, 0(0), 1–15. https://doi.org/10.1080/02602938.2021.2012644

Yan, Z., Wang, X., Boud, D., & Lao, H. (2023). The effect of self-assessment on academic performance and the role of explicitness: A meta-analysis. Assessment & Evaluation in Higher Education, 48(1), 1–15. https://doi.org/10.1080/02602938.2021.2012644 DOI: https://doi.org/10.1080/02602938.2021.2012644

Cover image for the article.

Downloads

Published

2023-09-15

How to Cite

Lämsä, J., Virtanen, A., Tynjälä, P., Maunuksela, J., & Koskinen, P. (2023). Exploring students’ perceptions of self-assessment in the context of problem solving in STEM. LUMAT: International Journal on Math, Science and Technology Education, 11(2), 35–59. https://doi.org/10.31129/LUMAT.11.2.2028

Similar Articles

<< < 1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.