Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Understanding layers, boundaries, and separation of concerns
  • Applying ports and adapters to AI components
  • Defining quality attribute scenarios for AI features
  • Using architecture decision records for governance

Evolving Existing Applications

  • Incremental modernisation as an alternative to full rewrites
  • Positioning AI services alongside existing monoliths
  • Utilising Strangler and anti-corruption layer patterns
  • Identifying integration seams for existing APIs and data

LLM Integration Architecture Patterns

  • Establishing a model gateway as an abstraction boundary
  • Managing synchronous, asynchronous, and streaming integrations
  • Implementing fallback, degradation, and provider failover strategies
  • Treating prompt and model configuration as versioned assets

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules
  • Managing idempotency, retries, and rate limiting
  • Orchestrating latency budgets and timeouts
  • Treating cost per request as an architectural constraint

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines
  • Managing index, retrieval, reranking, and generation stages
  • Positioning retrieval relative to application services
  • Analysing trade-offs and failure modes at each stage

Vector Databases and Retrieval Design

  • Comparing managed versus self-hosted vector stores
  • Implementing dense, sparse, and hybrid search methods
  • Applying metadata filtering and tenant isolation
  • Planning re-embedding strategies for model changes

Retrieval Quality, Grounding, and Evaluation

  • Constructing evaluation sets from real-world queries
  • Measuring retrieval and answer quality metrics
  • Managing citation, grounding, and hallucination containment
  • Incorporating feedback loops into the index

Agent Architectures

  • Understanding the agent loop and tool invocation
  • Distinguishing deterministic workflows from autonomous planners
  • Identifying cases where agents are not the optimal solution
  • Scoping agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies
  • Defining handoff protocols and message contracts
  • Managing shared memory and context
  • Comparing frameworks based on architectural merit

Service Communication and Tool Protocols

  • Coordinating via event-driven and queue-based systems
  • Exposing tools through standard protocols
  • Managing sagas, compensation, and long-running transactions
  • Ensuring observability across service hops

AI Agents in Development Workflows

  • Integrating coding agents into the delivery pipeline
  • Implementing spec-driven development and review gates
  • Utilising test generation and automated quality checks
  • Maintaining architectural control through guardrails

Governance and Software Quality

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation as a pipeline stage
  • Defining ownership, policy, and approval paths

Security, Privacy, and Data Governance

  • Addressing prompt injection and implementing defence in depth
  • Managing secrets, access control, and least privilege
  • Ensuring data residency, personal data handling, and retention compliance
  • Establishing auditability and human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing operations across agent chains
  • Monitoring token and cost telemetry
  • Optimising caching and latency
  • Defining service levels and incident response for AI services

Capstone: Architecting an AI-Powered Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration
  • Planning for security, governance, and cost
  • Conducting peer reviews, critiques, and migration roadmapping

Requirements

  • Practical experience in designing and maintaining production-grade software systems
  • Proficiency with REST APIs and service integration practices
  • Working familiarity with relational databases and data modelling
  • Basic exposure to LLM-based tools or APIs

Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers overseeing architecture decisions

Testimonials (1)

Related Categories