Hands-On Assessment

Lab Tests

Six real engineering challenges. No multiple-choice questions. Every lab produces something you built — an artifact that proves capability, not just comprehension.

Primary Lab Test 1

Generative AI with ChatGPT & Groq

Experience the full GenAI production cycle — from prompt to structured output to analysis.

📄 Download Lab PDF

This lab immerses you in the practical reality of working with Generative AI tools at a production level. You'll move from simple prompt-and-response to systematic experimentation — testing how different phrasings, system messages, and model parameters (temperature, top_p) produce meaningfully different outputs.

Using both ChatGPT (OpenAI) and Groq's fast inference API, you'll compare output quality, speed, and cost across platforms for the same task — exactly the kind of decision engineering teams face when selecting AI infrastructure.

What You'll Deliver

A structured comparison report showing prompt variations, temperature experiments, cross-platform comparisons, and your analysis of output quality, hallucination risk, and production suitability.

Related Sessions

Sessions 1, 2 & 3 — AI fundamentals, LLM mechanics, prompt engineering

Skills Tested
Prompt Design Temperature Tuning Model Comparison Output Analysis API Usage
Tools

ChatGPT (OpenAI), Groq API, Python or no-code interface

Primary Lab Test 2

AI Agents with n8n & Llama

Build your first autonomous AI agent — no hand-holding, real automation.

📄 Download Lab PDF

This lab takes you from talking to AI to building AI that acts. Using n8n (a visual workflow automation tool) and Llama (Meta's open-source LLM family), you'll design and deploy an AI agent that can execute a multi-step workflow autonomously — without you pressing each button.

The shift from "GenAI as a chat tool" to "AI as an automated worker" is one of the most significant in the field. This lab gives you hands-on experience with that shift, including the debugging, edge cases, and design decisions that come with building agentic systems.

What You'll Deliver

A working n8n workflow that uses Llama to autonomously process inputs and produce structured outputs, with documentation of design decisions and observed failure modes.

Related Sessions

Sessions 3, 4 & 11 — Prompt engineering, structured outputs, multi-agent systems

Skills Tested
Workflow Design Agent Architecture Open-Source LLMs Tool Integration Error Handling
Tools

n8n, Llama (via Ollama or Groq), optional: LangChain

Primary Lab Test 3

End-to-End AI Application

Architect and ship a complete AI system — retrieval, generation, structure, all connected.

📄 Download Lab PDF

This is where everything from Sessions 1–8 converges. You'll build a complete, end-to-end AI application — not a demo, not a single prompt, but a system with distinct components that work together: a retrieval layer, a generation layer, structured output parsing, and basic error handling.

The hiring AI running project provides a natural template: a system that takes a candidate profile and a job description, retrieves the most relevant criteria via RAG, generates a structured assessment, and returns a formatted, machine-readable result. You may adapt this to any domain you choose.

What You'll Deliver

A working application (script, notebook, or simple API) with architecture documentation, test cases demonstrating correct behaviour, and a documented failure analysis.

Related Sessions

Sessions 4, 5, 6, 7 & 8 — Structured outputs, RAG, fine-tuning, evaluation, deployment

Skills Tested
System Architecture RAG Pipeline JSON Parsing End-to-End Testing Documentation
Tools

Python, OpenAI/Anthropic API, Chroma or Pinecone, any vector embedding model

Primary Lab Test 4

Production AI System Design

Design, document, and defend a production-ready AI system from first principles.

📄 Download Lab PDF

The final lab is a capstone engineering design challenge. You'll design a complete production AI system — from architecture and data pipeline through to deployment strategy, monitoring plan, safety audit, and cost model. This is what senior AI engineers and architects do before a single line of code is written.

Your design will cover: model selection rationale, infrastructure choices, scaling strategy (to 100K+ requests/day), caching plan, safety and bias testing approach, and cost optimisation. You'll also identify failure modes and document your mitigation strategies.

What You'll Deliver

A production system design document (10–20 pages or equivalent) covering architecture, infrastructure, deployment, monitoring, safety, cost, and scaling — ready for stakeholder review.

Related Sessions

Sessions 8, 9, 10, 11 & 12 — Production, optimisation, safety, advanced architectures, capstone

Skills Tested
System Design Infra Planning Safety Audit Cost Modelling Stakeholder Comms
Format

Design document + optional architectural diagram. Defend your choices.

Primary Lab Test 5

Personal AI Assistant

Connect five real tools — Telegram, n8n, Llama, ChromaDB, and Gmail — into one working AI agent.

🤖 Open Interactive Lab 📄 Download Lab PDF ⬇️ Starter Template ⬇️ n8n Workflow

In this lab you will build a fully connected personal AI assistant from scratch. The system uses Telegram as the user-facing interface, n8n as the automation and routing backbone, Llama 3.2 3B running locally via Ollama for language understanding, ChromaDB as a persistent vector memory store, and Gmail for taking real-world actions.

Unlike previous labs that focus on a single component, this one is about integration — making five tools work together reliably. You'll handle intent routing (question vs. remember vs. search vs. email), debug inter-service communication, and experience the design tradeoffs of local-first AI versus cloud APIs. An interactive prototype is included to let you visualise the live pipeline before you build it.

What You'll Deliver

A working n8n workflow with all five integrations connected, a short screen recording demonstrating each intent type, and a written reflection on the architectural decisions and failure modes you encountered.

Related Sessions

Sessions 5, 6 & 11 — RAG, fine-tuning, multi-agent systems, vector databases

Skills Tested
Agent Integration Vector Memory Workflow Automation Local LLMs Intent Routing API Auth (OAuth)
Tools

Telegram Bot API, n8n, Ollama + Llama 3.2 3B, ChromaDB, Gmail API

Primary Lab Test 6

Word Counter Agent with Apify

Build and deploy your first cloud-based AI agent that reads web pages and analyses language.

📄 Download Lab PDF

In this lab you will create a Word Counter Agent as an Apify Actor. The actor accepts a web page URL and a word to search for, crawls the page, counts the word, and returns useful context about what it found.

You will work in Apify's browser-based Web IDE, update the actor's JavaScript source and configuration files, and deploy it to the cloud. The result is a reusable web agent that produces a count, page title, case-sensitive comparison, match positions, and sample context from any page.

What You'll Deliver

A deployed Apify Word Counter Actor with configured URL, word, and case-sensitivity inputs, plus a successful run and documented output showing the count and sample sentences.

Related Sessions

Sessions 1, 2, 4, 5 & 11 — AI fundamentals, LLM behaviour, structured outputs, web data, and agent architecture

Skills Tested
Web Crawling JavaScript Actor Design Regex Matching Structured Output Cloud Deployment
Tools

Apify, JavaScript, Crawlee, CheerioCrawler, and a Google account

Secondary Lab Tests

Session-Integrated Assessments

In addition to the six primary lab tests, each session includes a focused 12-minute hands-on exercise. Four of these are designated as secondary lab tests with formal deliverables.

Secondary Lab 1

Prompt Variations & Output Behaviour

From Session 2 — test your Session 1 resume with 3 prompt variations and 1 temperature experiment. Document and analyse the differences.

View Session 2 →
Secondary Lab 2

RAG System Construction

From Session 5 — build a functioning RAG system using your resume as the knowledge base. Answer questions with citations and compare RAG vs non-RAG.

View Session 5 →
Secondary Lab 3

Rigorous Evaluation Report

From Session 7 — benchmark your hiring AI against a baseline, run statistical significance tests, and produce a formal evaluation report.

View Session 7 →
Secondary Lab 4

Safety & Bias Audit

From Session 10 — conduct a comprehensive safety and fairness audit of your hiring AI, identifying biases, testing for them, and proposing mitigations.

View Session 10 →
Ready to Start

Begin with Session 1

The lab tests build progressively. Start at the beginning — each session prepares you for the next lab.

Begin Session 1 → Full Curriculum