Staff will have different levels of confidence and experience with different types of technology and need time to learn how to use the available artificial intelligence tools.
NEU members have told us that teachers are using GenAI tools to:
- Quickly produce content such as presentations which they then review and adjust if needed.
- Develop resources for lessons such as quizzes.
- Aid in the development of lesson plans.
- To aid in summarising or differentiating texts for different resources.
We advise that if you create learning resources using GenAI tools, that you always carefully check, and consider the output, as GenAI will produce factually inaccurate content and will tend to recreate biases in its results.
Think of what AI tools produce as a 'first draft' and use your professional judgement, subject knowledge, and expertise to review and critique the content to create a final resource.
Where GenAI is used to summarise or produce different versions of texts, we advise that you check that what it has composed accords with your understanding of the meaning of the original text.
Data protection and privacy
AI systems require the continuous and ongoing collection of user data (in education this would primarily be pupil data, but could also be the data of staff, parents or other stakeholders). The amount of data processed and the centrality of the data to developing GenAI mean there are more risks in relation to data privacy and the potential exploitation of data for commercial purposes.
Campaigning organisations such as Defend Digital Me have highlighted that there are significant gaps in governance of data processing in education contexts, with a lack of accountability for staff, learners and parents in the system as a whole. Therefore, there is a need to improve these systems and the legal framework for protecting pupil data as AI is adopted more widely.
Bias and prejudice
GenAI systems will replicate biases which exist in their training data. Most GenAI products have been trained on the internet, and their output will likely reproduce “opinions that are most common or dominant”. There are also risks that use of GenAI will make “writing more homogeneous, as its suggestions by definition reproduce standard ways of expressing ideas and normative values”.
There are potentially very serious implications if AI systems are involved in decisions that will have an impact on students, including assessing student outcomes or progress and recommending interventions or support.