PHYGITAL INTERFACE DESIGN FOR SOCIOEMOTIONAL: A QUALITATIVE CHILD-COMPUTER INTERACTION STUDY
Article Sidebar
Published:
May 31, 2026
Keywords:
Phygital, Physical-digital, Interface, Socioemotional, Children
Main Article Content
Abstract
Phygital learning environments, which merge tangible play with real-time digital feedback, are gaining attention in early childhood education, yet their socioemotional impact remains underexplored. Existing studies on phygital systems primarily emphasize cognitive or usability outcomes, leaving limited empirical evidence on how interface design shapes children’s emotional and social behaviours. This study investigated how phygital interface design supports socioemotional competencies among Malaysian preschoolers. Fifteen children aged 5-6 from two preschools engaged with Osmo phygital games involving both individual and collaborative play. Video recordings, observation checklists, and field notes were analysed using reflexive thematic analysis, supported by triangulation and peer debriefing to ensure credible behavioural interpretation. Findings show socioemotional behaviours like self-awareness, self-control, self-concept, self-confidence, and social skills with empathy emerge from design features such as hybridization, tangibility, interactivity, multisensory feedback, contextual relevance, personalization, and collaboration. Embodied emotional feedback enhanced self-regulation, hybrid tangible-digital play promoted motivation and confidence, and collaborative interaction strengthened empathy and peer support. This study positions phygital interfaces as emotionally responsive systems that integrate affective, cognitive, and social learning, offering evidence-based design implications for child-centred educational technologies.
Article Details
Section
Articles
References
Aslan, S., Agrawal, A., Alyuz, N., Chierichetti, R., Durham, L. M., Manuvinakurike, R., Okur, E., Sahay, S., Sharma, S., Sherry, J., Raffa, G., & Nachman, L. (2022). Exploring Kid Space in the wild: a preliminary study of multimodal and immersive collaborative play-based learning experiences. Educational Technology Research and Development, 70(1), 205–230. https://doi.org/10.1007/s11423-021-10072-x
Banzon, A. M., Beever, J., & Taub, M. (2024). Facial Expression Recognition in Classrooms: Ethical Considerations and Proposed Guidelines for Affect Detection in Educational Settings. IEEE Transactions on Affective Computing, 15(1), 93–104. https://doi.org/10.1109/TAFFC.2023.3275624
Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589–597. https://doi.org/10.1080/2159676X.2019.1628806
CASEL. (2017). What is the CASEL Framework? Collaborative for Academic, Social, and Emotional Learning (CASEL). https://casel.org/fundamentals-of-sel/what-is-the-casel-framework/
Chaturvedi, S., Purohit, S., & Verma, M. (2021). Effective Teaching Practices for Success During COVID 19 Pandemic: Towards Phygital Learning. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.646557
Clifft, S., & Assiouras, I. (2023). The transformation of post pandemic hybrid teaching and learning through experiences of remote digital learning in French business schools. Innovations in Education and Teaching International, 60(6), 810–823. https://doi.org/10.1080/14703297.2022.2132982
Cong-Lem, N. (2023). Emotion and its relation to cognition from Vygotsky’s perspective. European Journal of Psychology of Education, 38(2), 865–880. https://doi.org/10.1007/s10212-022-00624-x
Coninx, S., & Stephan, A. (2021). A Taxonomy of Environmentally Scaffolded Affectivity. Danish Yearbook of Philosophy, 54(1), 38–64. https://doi.org/10.1163/24689300-bja10019
Del Vecchio, P., Secundo, G., & Garzoni, A. (2023). Phygital technologies and environments for breakthrough innovation in customers’ and citizens’ journey. A critical literature review and future agenda. Technological Forecasting and Social Change, 189, 122342. https://doi.org/10.1016/j.techfore.2023.122342
Della Longa, L., Carnevali, L., & Farroni, T. (2023). The role of affective touch in modulating emotion processing among preschool children. Journal of Experimental Child Psychology, 235, 105726. https://doi.org/10.1016/j.jecp.2023.105726
Denik Arofah S, & Thorik Aziz. (2024). PENDEKATAN HYBRID SELF TRAINING DALAM PENGEMBANGAN SOSIAL-EMOSIONAL ANAK USIA DINI. Early Childhood: Jurnal Pendidikan, 8(2), 1–17. https://doi.org/10.35568/earlychildhood.v8i2.5406
Garaigordobil, M., Berrueco, L., & Celume, M.-P. (2022). Developing Children’s Creativity and Social-Emotional Competencies through Play: Summary of Twenty Years of Findings of the Evidence-Based Interventions “Game Program.” Journal of Intelligence, 10(4), 77. https://doi.org/10.3390/jintelligence10040077
Gelsomini, M., Spitale, M., & Garzotto, F. (2021). Phygital Interfaces for People with Intellectual Disability: An Exploratory Study at A Social Care Center. Multimedia Tools and Applications, 80(26–27), 34843–34874. https://doi.org/10.1007/s11042-021-11164-9
Guo Nyuhuan. (2024). Beyond rewards and punishments: enhancing children’s intrinsic motivation through self-determination theory. World Journal of Advanced Research and Reviews, 21(2), 1576–1583. https://doi.org/10.30574/wjarr.2024.21.2.0457
Hatira, A., & Sarac, M. (2024). Touch to Learn: A Review of Haptic Technology’s Impact on Skill Development and Enhancing Learning Abilities for Children. Advanced Intelligent Systems, 6(6). https://doi.org/10.1002/aisy.202300731
Hauke, G., Lohr-Berger, C., & Shafir, T. (2024). Emotional activation in a cognitive behavioral setting: extending the tradition with embodiment. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1409373
Huang, X., & Lajoie, S. P. (2023). Social emotional interaction in collaborative learning: Why it matters and how can we measure it? Social Sciences & Humanities Open, 7(1), 100447. https://doi.org/10.1016/j.ssaho.2023.100447
Kim, D., Kim, S. L., & Barnett, M. (2021). “That Makes Sense Now!": Bicultural Middle School Students’ Learning in a Culturally Relevant Science Classroom. International Journal of Multicultural Education, 23(2), 145–172. https://doi.org/10.18251/ijme.v23i2.2595
Kim, S., & Bong, M. (2023). Producing confident learners using specific tasks, competent models, and credible messages. Theory Into Practice, 62(3), 219–231. https://doi.org/10.1080/00405841.2023.2226555
Kleppang, A. L., Steigen, A. M., & Finbråten, H. S. (2023). Explaining variance in self-efficacy among adolescents: the association between mastery experiences, social support, and self-efficacy. BMC Public Health, 23(1), 1665. https://doi.org/10.1186/s12889-023-16603-w
KPM. (2016). Dokumen Standard Kurikulum Dan Pentaksiran Semakan 2017.
Lee, D., & Lee, B. (2025). From Control to Connection: A Child-Centred User Experience Approach to Promoting Digital Self-Regulation in Preschool-Aged Children. Applied Sciences, 15(14), 7929. https://doi.org/10.3390/app15147929
Lehnert, F. K., Niess, J., Lallemand, C., Markopoulos, P., Fischbach, A., & Koenig, V. (2022). Child–Computer Interaction: From a systematic review towards an integrated understanding of interaction design methods for children. International Journal of Child-Computer Interaction, 32, 100398. https://doi.org/10.1016/j.ijcci.2021.100398
Linge, A. D., Bjørkly, S. K., Jensen, C., & Hasle, B. (2021). Bandura’s Self-Efficacy Model Used to Explore Participants’ Experiences of Health, Lifestyle, and Work After Attending a Vocational Rehabilitation Program with Lifestyle Intervention – A Focus Group Study. Journal of Multidisciplinary Healthcare, Volume 14, 3533–3548. https://doi.org/10.2147/JMDH.S334620
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016). Sample Size in Qualitative Interview Studies. Qualitative Health Research, 26(13), 1753–1760. https://doi.org/10.1177/1049732315617444
Mejeh, M., Sarbach, L., & Hascher, T. (2024). Effects of adaptive feedback through a digital tool – a mixed-methods study on the course of self-regulated learning. Education and Information Technologies, 29(14), 1–43. https://doi.org/10.1007/s10639-024-12510-8
Motz, B. A., Quick, J. D., & Morrone, A. S. (2022). When online courses became the student union: Technologies for peer interaction and their association with improved outcomes during COVID-19. Technology, Mind, and Behavior, 3(1). https://doi.org/10.1037/tmb0000061
Nilfyr, K., & Ewe, L. P. (2025). Thriving Children’s Emotional Self-Regulation in Preschool: A Systematic Review Discussed from an Interactionist Perspective. Education Sciences, 15(2), 137. https://doi.org/10.3390/educsci15020137
Niu, S. J., Niemi, H., Yang, J., Wang, J., Wang, H., Li, J., & Liu, F. (2025). From Play to Progress: Student Learning of Social Skills with a Solution-Focused Approach. Education Sciences, 15(2), 218. https://doi.org/10.3390/educsci15020218
Nonnis, A., & Bryan-Kinns, N. (2024). Unmasking the Power of Play Through TUI Designs. ACM Transactions on Computer-Human Interaction, 31(4), 1–43. https://doi.org/10.1145/3648619
Oliveira, V. H., Martins, P. C., & Carvalho, G. S. (2024). Children’s Daily Activities and Well-being during the COVID-19 Lockdown: Associations with Child and Family Characteristics. Current Psychology, 43(9), 8346–8357. https://doi.org/10.1007/s12144-022-02759-y
Papadakis, S. (2021). The Impact of Coding Apps to Support Young Children in Computational Thinking and Computational Fluency. A Literature Review. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.657895
Pardini, S., Gabrielli, S., Dianti, M., Novara, C., Zucco, G., Mich, O., & Forti, S. (2022). The Role of Personalization in the User Experience, Preferences and Engagement with Virtual Reality Environments for Relaxation. International Journal of Environmental Research and Public Health, 19(12), 7237. https://doi.org/10.3390/ijerph19127237
Quinn, M. F., Caudle, L. A., & Harper, F. K. (2025). Embracing Culturally Relevant Computational Thinking in the Preschool Classroom: Leveraging Familiar Contexts for New Learning. Early Childhood Education Journal, 53(2), 393–403. https://doi.org/10.1007/s10643-023-01581-w
Richard, S., Baud‐Bovy, G., Clerc‐Georgy, A., & Gentaz, E. (2021). The effects of a ‘pretend play‐based training’ designed to promote the development of emotion comprehension, emotion regulation, and prosocial behaviour in 5‐ to 6‐year‐old Swiss children. British Journal of Psychology, 112(3), 690–719. https://doi.org/10.1111/bjop.12484
Rudolph, K. D., Li, Y., Li, X., & Cai, T. (2023). Social goals as predictors of children’s in vivo emotional responses to social challenges. Child Development, 94(2), 424–438. https://doi.org/10.1111/cdev.13869
Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860. https://doi.org/10.1016/j.cedpsych.2020.101860
Schmidt, J. A., Beymer, P. N., Rosenberg, J. M., Naftzger, N. N., & Shumow, L. (2020). Experiences, activities, and personal characteristics as predictors of engagement in STEM ‐focused summer programs. Journal of Research in Science Teaching, 57(8), 1281–1309. https://doi.org/10.1002/tea.21630
Silva, L., Mendes, A., Gomes, A., & Fortes, G. (2023). Fostering regulatory processes using computational scaffolding. International Journal of Computer-Supported Collaborative Learning, 18(1), 67–100. https://doi.org/10.1007/s11412-023-09388-y
Speer, S., Haney, M., Tasota, M., & Hamner, E. (2025). Beyond Screens: Tangible User Interfaces Impact Engagement with Emotion Regulation Activities for Preschool Children. Proceedings of the 24th Interaction Design and Children, 556–564. https://doi.org/10.1145/3713043.3728862
Tikkanen, R., & Iivari, N. (2023). Nature and Natural Rhythm in the Digital World - What’s in It for Child–Computer Interaction?: A narrative literature review and an initial design framework. 26th International Academic Mindtrek Conference, 119–132. https://doi.org/10.1145/3616961.3616989
Toh, W., & Kirschner, D. (2023). Developing Social-Emotional Concepts for Learning with Video Games. Computers and Education, 194. https://doi.org/10.1016/j.compedu.2022.104708
Watts, R., & Pattnaik, J. (2022). Perspectives of Parents and Teachers on the Impact of the COVID-19 Pandemic on Children’s Socio-Emotional Well-Being. Early Childhood Education Journal. https://doi.org/10.1007/s10643-022-01405-3
Winkielman, P., Davis, J. D., & Coulson, S. (2023). Moving thoughts: emotion concepts from the perspective of context dependent embodied simulation. Language, Cognition and Neuroscience, 38(10), 1531–1553. https://doi.org/10.1080/23273798.2023.2236731
Zhong, B., Su, S., Liu, X., & Zhan, Z. (2023). A literature review on the empirical studies of technology-based embodied learning. Interactive Learning Environments, 31(8), 5180–5199. https://doi.org/10.1080/10494820.2021.1999274