Evaluating AI Agents

About Craig

Craig West

I am an Agentic Pythonista specialising in Evaluating AI Agents, living in Brighton, UK.

I was a Business Information Architect as well as managing a web/database farm for a major recycling company.

As a former Microsoft Certified DBA (SQL 2000), I have a strong interest in data integrity and data quality.

I originally trained as an Accountant Technician, working freelance for a range of SMEs. This enables me to speak both business and development, bridging the gap between these two worlds, leading to a role as a Business Information Architect, working with both clients and developers.

I am working on developing the manual on Evals and its associated 'framework' - https://evaluating-ai-agents.com/.

I am currently working on AI Powered Knowledge Systems that has three main elements of AI Search, Agentic RAG and AI Agents in the Data Pipeline.

I was a developer in the JS and WordPress space for a number of years.

I feel my previous business and finance careers along with running my own business are skills that complement my AI focused Python skills.

I am a volunteer coach at codebar.io/brighton.

My Github CV

Manuals

I have written a number of manuals to help others. These contain both original work and curated links that I have found useful

  1. https://evaluating-ai-agents.com/
  2. https://ai-powered-knowledge-systems.netlify.app/
  3. https://pytest-cookbook.com/
  4. https://django-fullstack-testing.netlify.app/

Speaking

I enjoy giving talks and workshops on AI Agents and other subjects.

Talks and workshops given:

Python

  • Next...AI Agents and Evals for all languages - Brighton Web Development Meetup, October 29th 2025, resources.
  • AI Agents in the Data Pipeline - 30 minute talk, EARL Conference, Brighton, October 15th 202, resources.
  • Beyond Black Box - How to Evaluate Your Agents... in Real Time Too! - 30 minute talk, PyData Southampton, 16th September 2025 Meetup, Sep 2025, resources.
  • Breaking the Black Box - How to Evaluate Your Agents... in Real Time Too! - 30 minute talk, PyData London Meetup, Sep 2025, resources.
  • AI Agents in the Data Pipeline - 90 minute workshop, PyData Southampton Meetup, June 2025, resources.
  • DjangoConEurope April 2025: Implementing Agentic AI solutions in Django from scratch - 90 minute workshop, resources.
  • Brighton Py Feb 2025: AI as API in everyday Python apps - 60 minute talk and demo, resources.
  • Django Japan Congress Feb 2025 (online): Implementing Agentic AI solutions in Django from scratch - 45 minute talk, resources.
  • Conf42 Feb 2025 (online): Implementing Agentic AI Solutions in Python from scratch - 50 minute talk, resources.
  • PyCon Ireland Nov 2024: Getting started with Pytest - 2 hr workshop, resources.
  • Everything in this talk is included

    Other

  • TALK: Offline and instant websites, aka Progressive Web Apps - AsyncJS, Brighton, September 2021.
  • LIGHTNING TALK: WordPress as a Micro Service to any framework - WordFest, July 2021.
  • TALK: WP REST API and Web Components => 100% Internet - WordCamp Santa Clarita, July 2021.
  • TALK: Web Components in WP, Gutenberg and as HTML plugins. - WordCamp North East Ohio, May 2021.
  • TALK: Leveraging the power or the WordPress REST API - WP Leeds, April 2021
  • WORKSHOP: WP REST API and you -> Best Friends Forever - WordCamp Greece, April 2021.
  • WORKSHOP: Progressive Web Apps Workshop (3hrs) - NDC 2021 (PAID) .
  • WORKSHOP: Web Components Workshop (3hrs) - NDC 2021 (PAID).
  • TALK: Web Components as Micro Apps - NDC London, Jan 2021.
  • TALK: Unifying frameworks with Web Components - Brighton AsyncJS, Nov 2020.
  • WORKSHOP: Progressive Web Apps Workshop (2hrs) - NDC Oslo, June 2020.
  • WORKSHOP: Web Components Workshop (2hrs) - NDC Oslo, June 2020.
  • WORKSHOP: Progressive Web Apps Workshop (2hrs) - Brighton WordUp, June 2020.
  • WORKSHOP: WordPress REST API with AJAX Forms and Pages - WordCamp Denver, June 2020.
  • WORKSHOP: WordPress REST API with AJAX Forms and Pages - WordCamp Kent, Ohio May 2020.
  • WORKSHOP: What is the WP REST API and how can I use it to make forms and pages that don’t need to do be reloaded? - WordUp Brighton May 2020.
  • WORKSHOP: WordPress REST API and AJAX Forms - WordCamp Geneva, March 2020 [EVENT CANCELLED due to virus concerns :( ]
  • TALK: WP-HTML: The marriage of WP and JS Frameworks for expansion, ubiquity and profit - WordCamp Vienna February 2020.
  • WORKSHOP: WordPress REST API - WordCamp Vienna, February 2020.
  • TALK: Progressive Web Apps - Brighton WordUp, November 2019.
  • TALK: Decoupled WordPress (code along style) - WordCamp Dublin, October 2019.
  • TALK: JWT and Authentication - WPHooked London, September 2019
  • TALK: Decoupled WordPress and WP Components - WordCamp Brighton, August 2019.
  • Services

    I offer guidance and implementation of AI Agents and Evals.

    I am also able to offer this 'by the hour' so that you can get started quickly and not worry about the costs or get an insiders view of how to get going prior to engaging a consultancy firm.

    Contact

    LinkedIn: https://www.linkedin.com/in/craig-west-0914b230b/

    Email: mrcraigwest@hotmail.com

    mrcraigwest@hotmail.com