Get in Touch
 Duration 21 hours

Course Outline

Architectural Foundations for AI Systems

  • Layers, boundaries, and separation of concerns.
  • Applying ports and adapters to AI components.
  • Defining quality attribute scenarios for AI features.
  • Using architecture decision records as a governance tool.

Modernizing Existing Applications

  • Incremental modernization versus complete rewrites.
  • Integrating AI services alongside existing monoliths.
  • Utilizing strangler and anti-corruption layer patterns.
  • Creating integration points for existing APIs and data.

LLM Integration Architecture Patterns

  • Model gateways as abstraction boundaries.
  • Synchronous, asynchronous, and streaming integration strategies.
  • Fallback mechanisms, degradation, and provider failover.
  • Managing prompt and model configuration as versioned assets.

Contracts, APIs, and Data Exchange

  • Structured output schemas and validation processes.
  • Implementing idempotency, retries, and rate limiting.
  • Managing latency budgets and timeout orchestration.
  • Considering cost per request as an architectural constraint.

End-to-End RAG Architecture

  • Ingestion, chunking, and embedding pipelines.
  • Stages of indexing, retrieval, reranking, and generation.
  • Positioning retrieval relative to application services.
  • Evaluating trade-offs and failure modes at each stage.

Vector Databases and Retrieval Design

  • Managed versus self-hosted vector stores.
  • Dense, sparse, and hybrid search techniques.
  • Metadata filtering and tenant isolation.
  • Re-embedding strategies when models change.

Retrieval Quality, Grounding, and Evaluation

  • Building evaluation sets from real-world queries.
  • Metrics for retrieval and answer quality.
  • Managing citations, grounding, and hallucination containment.
  • Implementing feedback loops back into the index.

Agent Architectures

  • The agent loop and tool invocation processes.
  • Deterministic workflows versus autonomous planners.
  • Identifying cases where agents are not the appropriate solution.
  • Defining agent responsibilities and state management.

Multi-Agent Systems and Orchestration

  • Supervisor and orchestrator topologies.
  • Handoff protocols and message contracts.
  • Managing shared memory and context.
  • Comparing frameworks based on architectural principles.

Service Communication and Tool Protocols

  • Event-driven and queue-based coordination.
  • Exposing tools through standard protocols.
  • Handling sagas, compensation, and long-running transactions.
  • Ensuring observability across service interactions.

AI Agents in the Development Workflow

  • Integrating coding agents into the delivery pipeline.
  • Spec-driven development and review gates.
  • Generating tests and automated quality checks.
  • Establishing guardrails to maintain architectural control.

Governance and Software Quality

  • Design reviews for AI features.
  • Managing changes to models and prompts.
  • Incorporating regression evaluation into the pipeline.
  • Defining ownership, policies, and approval pathways.

Security, Privacy, and Data Governance

  • Mitigating prompt injection through defense in depth.
  • Managing secrets, access control, and least privilege.
  • Data residency, personal data handling, and retention policies.
  • Ensuring auditability and human-in-the-loop controls.

Scalability, Cost, and Observability

  • Tracing across agent chains.
  • Monitoring token usage and cost telemetry.
  • Optimizing caching and latency.
  • Defining service levels and incident response for AI services.

Capstone: Architecture for an AI-Powered Solution

  • Context, component, and deployment views.
  • Designing retrieval and agent orchestration.
  • Planning for security, governance, and cost.
  • Conducting peer reviews, critique, and migration roadmaps.

Requirements

  • Experience in designing and maintaining production software systems.
  • Proficiency with REST APIs and service integration.
  • Familiarity with relational databases and data modeling.
  • Basic exposure to LLM-based tools or APIs.

Target Audience

  • Software architects.
  • Technical leads and senior engineers.
  • Engineering managers responsible for architectural decisions.

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories