Ethical Risks and Governance Frameworks: Exploring the Boundaries of Artificial Intelligence in Educational Applications
Article Sidebar
Main Article Content
Abstract
Artificial Intelligence in educational applications has become a critical issue in global educational development, with its technological potential continuously unfolding. However, this process is accompanied by complex challenges and ethical risks, making systematic ecosystem governance urgently necessary. This study firstly identified the boundaries of AI educational applications, spanning from knowledge acquisition to competency development, and extending to emotional and values cultivation. Secondly, it explored three categories of ethical risks in AI educational applications (including agency risks, safety risks, and development risks) and conducted an attribution analysis focusing on four ecosystem actors (government, AI technology developers, educational institutions, and enterprises). This revealed multi-layered causal chains for the three risk categories, involving four logics: institutional logic, reflecting deficiencies in legal and professional constraints; technical logic, highlighting inherent limitations of algorithms and systems; educational logic, addressing practical challenges of upholding principles versus clinging to tradition; commercial logic, where efficiency and profit distort values. To address these issues, the study proposed an ecosystem governance framework for AI education applications, aiming to provide policy guidance for the symbiotic and sustainable development of AI and education.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
Andrejevic, M., & Gates, K. (2014). Big data surveillance: Introduction. Surveillance & Society, 12(2), 185-196.
Bamber, V. (2004). An Exploration of Policy Enactment, through the study of the introduction of lecturer development programmes. Lancaster University (United Kingdom).
Brusilovsky, P. (2024). AI in education, learner control, and human-AI collaboration. International Journal of Artificial Intelligence in Education, 34(1), 122-135.
Cameron, F., Bequette, B. W., Wilson, D. M., Buckingham, B. A., Lee, H., & Niemeyer, G. (2011). A closed-loop artificial pancreas based on risk management. Journal of diabetes science and technology, 5(2), 368-379.
Chee, H., Ahn, S., & Lee, J. (2025). A competency framework for AI literacy: Variations by different learner groups and an implied learning pathway. British Journal of Educational Technology, 56(5), 2146-2182.
Chen, P., Wu, L., & Wang, L. (2023). AI fairness in data management and analytics: A review on challenges, methodologies and applications. Applied sciences, 13(18), 10258.
Corso, A., Moss, R., Koren, M., Lee, R., & Kochenderfer, M. (2021). A survey of algorithms for black-box safety validation of cyber-physical systems. Journal of Artificial Intelligence Research, 72, 377-428.
Ganiyu, T. O. (2025). Academic integrity in the AI era: Battling cheating with innovation. AI and Ethics, Academic Integrity and the Future of Quality Assurance in Higher Education.
Gulson, K. N., Sellar, S., & Webb, P. T. (2022). Algorithms of education: How datafication and artificial intelligence shape policy. U of Minnesota Press.
Harry, A. (2023). Role of AI in education. Interdiciplinary Journal & Hummanity (INJURITY), 2(3).
Herath, H. M. S. S., Herath, H. M. K. K. M. B., Madhusanka, B. G. D. A., & Guruge, L. G. P. K. (2024). Data protection challenges in the processing of sensitive data. In Data Protection: The Wake of AI and Machine Learning (pp. 155-179). Cham: Springer Nature Switzerland.
Herschel, R. T., Nemati, H., & Steiger, D. (2001). Tacit to explicit knowledge conversion: knowledge exchange protocols. Journal of knowledge management, 5(1), 107-116.
Hollmann, S., Regierer, B., D'Elia, D., Kisslinger, A., & Liguori, G. L. (2022). Toward the definition of common strategies for improving reproducibility, standardization, management, and overall impact of academic research. In Advances in Biomembranes and Lipid Self-Assembly (Vol. 35, pp. 1-24). Academic Press.
Jonassen, D. H., Yacci, M., & Beissner, K. (2013). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Routledge.
Khanagha, S., Volberda, H., Sidhu, J., & Oshri, I. (2013). Management innovation and adoption of emerging technologies: The case of cloud computing. European Management Review, 10(1).
Liu, L. (2025, May). Advancing Teachers' Digital Competence in Western China's Inclusive Kindergartens Through Human-Machine Collaboration: An Intelligent Diagnosis-Driven Pathway for Integrating Local Resources. In 2025 5th International Conference on Artificial Intelligence and Education (ICAIE) (pp. 299-303). IEEE.
Martinez, M. E. (2014). Education as the cultivation of intelligence. Routledge.
Molnar, A. (2006). The commercial transformation of public education. Journal of Education Policy, 21(5), 621-640.
Mouta, A., Pinto-Llorente, A. M., & Torrecilla-Sánchez, E. M. (2025). “Where is Agency Moving to?”: Exploring the Interplay between AI Technologies in Education and Human Agency. Digital Society, 4(2), 49.
O’Neill, S. (2008). Approaching Interaction. Interactive Media: The Semiotics of Embodied Interaction, 1-21.
Palmquist, A., Sigurdardottir, H. D. I., & Myhre, H. (2025). Exploring interfaces and implications for integrating social-emotional competencies into AI literacy for education: a narrative review. Journal of Computers in Education, 1-37.
Papa, R., & Jackson, K. M. (Eds.). (2021). Artificial intelligence, human agency and the educational leader. Springer Nature.
Potocky, M. (2021). The role of digital skills in refugee integration: a state-of-the-art review. The International Journal of Information, Diversity, & Inclusion (IJIDI).
Sanyal, S., Sharma, P., & Dudani, C. (2024). A complex adaptive system framework to regulate artificial intelligence (No. 26). Working paper.
Tierney, K. (2012). Disaster governance: Social, political, and economic dimensions. Annual review of Environment and Resources, 37(1), 341-363.
Tomassi, A., Falegnami, A., & Romano, E. (2024). Mapping automatic social media information disorder. The role of bots and AI in spreading misleading information in society. Plos one, 19(5), e0303183.
Tuomi, I. (2022). Artificial intelligence, 21st century competences, and socio‐emotional learning in education: More than high‐risk?. European Journal of Education, 57(4), 601-619.
Yang, S. J., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008.
Yingzhe, L. I. (2025). Addressing “Hallucinations” in AI-Generated Content: Strategies for Developing Student Fact-Checking and Information Evaluation Skills. Artificial Intelligence Education Studies, 1(2), 48-62.