Understanding the privacy concerns of AI and LLMs in schools

The use of Large Language Models (LLMs) and AI tools that rely on prompting is becoming increasingly popular in educational settings. These tools can generate content, answer questions, and even assist with complex subjects, such as ChatGPT. However, their functioning often involves collecting personal data from users, especially when inputs include sensitive information like names, locations, or personal thoughts. This data, although used to improve responses, may expose students to unintended privacy risks.