A chance to share experiences, ask questions and explore the role of AI in evaluation together.
From practical questions about AI tools to privacy, trust and professional judgement, our first AI in Evaluation Community of Practice meet-up raised some important issues for evaluation practice.
AI is becoming part of everyday working life, but knowing when and how to use it in evaluation isn’t always straightforward. These were some of the questions discussed at the first meeting of the UK Evaluation Society’s AI in Evaluation Community of Practice on 15 October.
The community provides a space for evaluators to discuss these issues openly, question assumptions and learn from each other’s experiences. That includes those who are uncertain about AI or have reservations about its use.
What did we discuss?
Making better use of existing AI tools
Several participants already have access to tools such as Microsoft Copilot and Google Gemini through their organisations. But having access doesn’t necessarily mean knowing how best to use them, particularly for evaluation tasks.
This raised an important question: how can we make the most of the tools we already have access to, particularly for evaluation work?
Privacy, security and affordability
Choosing the right AI tools isn’t always straightforward. Different licences offer different features and levels of privacy and information security. For smaller organisations and independent evaluators, navigating these choices without dedicated IT support or a large budget can be particularly challenging.
AI, productivity and professional judgement
An interesting discussion emerged around how AI might be changing expectations of productivity and why people can sometimes feel uncomfortable discussing its use at work.
We also considered the complexities of public sector evaluation, where ethics, accountability and competing priorities influence decisions about AI.
Knowing how to use AI is only part of the picture. Evaluators also need to judge when its use is appropriate, recognise its limitations and be able to explain their decisions. There won’t always be a straightforward answer, which makes hearing different perspectives particularly valuable.
Learning from real-world examples
Participants expressed interest in practical case studies, particularly exploring AI agents and their use in evaluative tasks. Sharing real experiences can help us understand what works, what doesn’t, and where AI can add value.
A member shared this resource from Technopolis Group on their experience developing an AI application for public policy:
Embracing AI in Public Policy: The Journey of Technopolis Group
Join the next AI in Evaluation Community of Practice meet-up
These conversations will help shape future meet-ups, alongside the questions and experiences that participants bring. The aim isn’t to encourage everyone to use AI. It’s to help evaluators make informed decisions about its place in their work, drawing on professional judgement and shared learning.
You don’t need previous knowledge or experience of AI to take part. Just bring your questions, experiences and willingness to learn from others.
Visit our events page to book for the next meet-up. If there are no events listed, please contact us for more information.Â
Please note: The Community of Practice is open to everyone for an introductory three-month period from its launch in October 2026. After this, the meet-ups and online community will be a UK Evaluation Society member benefit.
Member events may not always appear in the events listings if the next session hasn’t yet been scheduled. Do check back for new dates or look out for upcoming member events in our newsletter.
