Evaluating AI Agents

About Craig

Craig West

I am an Agentic Pythonista specialising in Evaluating AI Agents, living in Brighton, UK.

I was a Business Information Architect as well as managing a web/database farm for a major recycling company.

As a former Microsoft Certified DBA (SQL 2000), I have a strong interest in data integrity and data quality.

I originally trained as an Accountant Technician, working freelance for a range of SMEs. This enables me to speak both business and development, bridging the gap between these two worlds, leading to a role as a Business Information Architect, working with both clients and developers.

I have a scientific and analytical approach to problem solving having studied Chemistry at University.

I am currently working on AI Powered Knowledge Systems that has three main elements of AI Search, Agentic RAG and AI Agents in the Data Pipeline.

I was a developer in the JS and WordPress space for a number of years.

I feel my previous business and finance careers along with running my own business are skills that complement my AI focused Python skills.

I am a volunteer coach at codebar.io/brighton.

My Github CV

Manuals

I have written a number of manuals to help others. These contain both original work and curated links that I have found useful

  1. https://evaluating-ai-agents.com/
  2. https://ai-powered-knowledge-systems.netlify.app/
  3. https://pytest-cookbook.com/
  4. https://django-fullstack-testing.netlify.app/

Speaking

I enjoy giving talks and workshops on AI Agents and other subjects.

Talks and workshops given:

Python

  • Breaking the Black Box - How to Evaluate Your Agents... in Real Time Too! - 30 minute talk, PyData London Meetup, Sep 2025 resources..
  • AI Agents in the Data Pipeline - 90 minute workshop, PyData Southampton Meetup, June 2025, resources.
  • DjangoConEurope April 2025: Implementing Agentic AI solutions in Django from scratch - 90 minute workshop, resources.
  • Brighton Py Feb 2025: AI as API in everyday Python apps - 60 minute talk and demo, resources.
  • Django Japan Congress Feb 2025 (online): Implementing Agentic AI solutions in Django from scratch - 45 minute talk, resources.
  • Conf42 Feb 2025 (online): Implementing Agentic AI Solutions in Python from scratch - 50 minute talk, resources.
  • PyCon Ireland Nov 2024: Getting started with Pytest - 2 hr workshop, resources.
  • Next..
  • Breaking the Black Box - How to Evaluate Your Agents... in Real Time Too! - 30 minute talk, PyData Southampton, 16th September 2025 Meetup, Sep 2025 resources..
  • AI Agents in the Data Pipeline - 30 minute talk, EARL Conference, Brighton, October 2025.

  • Other

  • TALK: Offline and instant websites, aka Progressive Web Apps - AsyncJS, Brighton, September 2021.
  • LIGHTNING TALK: WordPress as a Micro Service to any framework - WordFest, July 2021.
  • TALK: WP REST API and Web Components => 100% Internet - WordCamp Santa Clarita, July 2021.
  • TALK: Web Components in WP, Gutenberg and as HTML plugins. - WordCamp North East Ohio, May 2021.
  • TALK: Leveraging the power or the WordPress REST API - WP Leeds, April 2021
  • WORKSHOP: WP REST API and you -> Best Friends Forever - WordCamp Greece, April 2021.
  • WORKSHOP: Progressive Web Apps Workshop (3hrs) - NDC 2021 (PAID) .
  • WORKSHOP: Web Components Workshop (3hrs) - NDC 2021 (PAID).
  • TALK: Web Components as Micro Apps - NDC London, Jan 2021.
  • TALK: Unifying frameworks with Web Components - Brighton AsyncJS, Nov 2020.
  • WORKSHOP: Progressive Web Apps Workshop (2hrs) - NDC Oslo, June 2020.
  • WORKSHOP: Progressive Web Apps Workshop (2hrs) - NDC Oslo, June 2020.
  • WORKSHOP: Web Components Workshop (2hrs) - NDC Oslo, June 2020.
  • WORKSHOP: Progressive Web Apps Workshop (2hrs) - Brighton WordUp, June 2020.
  • WORKSHOP: WordPress REST API with AJAX Forms and Pages - WordCamp Denver, June 2020.
  • WORKSHOP: WordPress REST API with AJAX Forms and Pages - WordCamp Kent, Ohio May 2020.
  • WORKSHOP: What is the WP REST API and how can I use it to make forms and pages that don’t need to do be reloaded? - WordUp Brighton May 2020.
  • WORKSHOP: WordPress REST API and AJAX Forms - WordCamp Geneva, March 2020 [EVENT CANCELLED due to virus concerns :( ]
  • TALK: WP-HTML: The marriage of WP and JS Frameworks for expansion, ubiquity and profit - WordCamp Vienna February 2020.
  • WORKSHOP: WordPress REST API - WordCamp Vienna, February 2020.
  • TALK: Progressive Web Apps - Brighton WordUp, November 2019.
  • TALK: Decoupled WordPress (code along style) - WordCamp Dublin, October 2019.
  • TALK: JWT and Authentication - WPHooked London, September 2019
  • TALK: Decoupled WordPress and WP Components - WordCamp Brighton, August 2019.
  • Seeking

    I am looking to robustly test the Evaluation Framework to create trust for customers and ROI for companies.

    Contact

    LinkedIn: https://www.linkedin.com/in/craig-west-0914b230b/

    Email: mrcraigwest@hotmail.com

    mrcraigwest@hotmail.com