# aws-samples/sample-amazon-cloudwatch-generative-ai-observability architecture

> Architecture diagram of the GitHub repository aws-samples/sample-amazon-cloudwatch-generative-ai-observability, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-04). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability
- Repository: https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability

## Overview

This repository is a set of deployable weather-agent samples, not a shared application: users can run the agent on EC2, ECS, EKS, or Bedrock AgentCore. Each agent uses Strands with a Bedrock model and National Weather Service HTTP tools; OpenTelemetry instrumentation sends telemetry to CloudWatch. The EC2 custom-span sample adds location extraction and application-level spans. Deployment templates and the EKS chart represent the host-specific infrastructure. Links between unsampled deployment resources and applications reflect README documentation; no shared runtime pipeline is implied.

Main entry points: [`ec2-genAI-observability/app/app-customspan.py`](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app-customspan.py) (Custom Span Agent), [`ecs-genAI-observability/docker/app/app.py`](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ecs-genAI-observability/docker/app/app.py) (ECS Weather Agent), [`eks-genAI-observability/docker/app/app.py`](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/eks-genAI-observability/docker/app/app.py) (EKS Weather Agent), [`ec2-genAI-observability/app/app.py`](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app.py) (EC2 Weather Agent)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_agentcore["AgentCore Sample"]
  node_invoke["Runtime Invoker<br/>[invoke.py]"]
  node_agentcore_host["AgentCore Runtime"]
  node_agentcore_agent["Weather Agent<br/>[agent.py]"]
end

subgraph group_containers["Container Samples"]
  node_ecs_app["ECS Weather Agent<br/>[app.py]"]
  node_ecs_stack["ECS Infrastructure"]
  node_eks_app["EKS Weather Agent<br/>[app.py]"]
  node_eks_chart["EKS Helm Chart"]
end

subgraph group_ec2["EC2 Samples"]
  node_ec2_app["EC2 Weather Agent<br/>[app.py]"]
  node_ec2_custom["Custom Span Agent<br/>[app-customspan.py]"]
  node_ec2_stack["EC2 Infrastructure"]
end

subgraph group_observability["Observability"]
  node_bedrock["Amazon Bedrock"]
  node_weather_api["Weather API"]
  node_adot["ADOT Instrumentation"]
  node_cloudwatch[("CloudWatch")]
end

node_user(("User"))

node_user -->|"submits prompt"| node_invoke
node_invoke -->|"invokes runtime"| node_agentcore_host
node_agentcore_host -->|"dispatches to"| node_agentcore_agent
node_user -->|"asks weather"| node_ecs_app
node_user -->|"asks weather"| node_eks_app
node_user -->|"asks weather"| node_ec2_app
node_user -->|"asks weather"| node_ec2_custom
node_agentcore_agent -->|"infers with"| node_bedrock
node_agentcore_agent -->|"requests forecasts"| node_weather_api
node_ecs_app -->|"infers with"| node_bedrock
node_ecs_app -->|"requests forecasts"| node_weather_api
node_eks_app -->|"infers with"| node_bedrock
node_eks_app -->|"requests forecasts"| node_weather_api
node_ec2_app -->|"infers with"| node_bedrock
node_ec2_app -->|"requests forecasts"| node_weather_api
node_ec2_custom -->|"infers with"| node_bedrock
node_ec2_custom -->|"requests forecasts"| node_weather_api
node_ec2_custom -->|"creates spans"| node_ec2_custom
node_ecs_stack -->|"deploys"| node_ecs_app
node_eks_chart -->|"deploys"| node_eks_app
node_ec2_stack -->|"deploys"| node_ec2_app
node_agentcore_agent -->|"emits telemetry"| node_adot
node_ecs_app -->|"emits telemetry"| node_adot
node_eks_app -->|"emits telemetry"| node_adot
node_ec2_app -->|"emits telemetry"| node_adot
node_ec2_custom -->|"emits telemetry"| node_adot
node_adot -->|"exports telemetry"| node_cloudwatch

click node_invoke "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/bedrock-agentcore-observability/invoke.py"
click node_agentcore_agent "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/bedrock-agentcore-observability/agent.py"
click node_ecs_app "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ecs-genAI-observability/docker/app/app.py"
click node_ecs_stack "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ecs-genAI-observability/cloudformation/weather-agent-ecs.yaml"
click node_eks_app "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/eks-genAI-observability/docker/app/app.py"
click node_eks_chart "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/tree/main/eks-genAI-observability/chart"
click node_ec2_app "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app.py"
click node_ec2_custom "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app-customspan.py"
click node_ec2_stack "https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/cloudformation/weather-agent-ec2.yaml"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_invoke,node_agentcore_host,node_agentcore_agent,node_user toneBlue
class node_ecs_app,node_ecs_stack,node_eks_app,node_eks_chart toneAmber
class node_ec2_app,node_ec2_custom,node_ec2_stack toneMint
class node_bedrock,node_weather_api,node_adot,node_cloudwatch toneRose
```

## Components

### AgentCore Sample

- [Runtime Invoker](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/bedrock-agentcore-observability/invoke.py): `bedrock-agentcore-observability/invoke.py`
- **AgentCore Runtime**
- [Weather Agent](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/bedrock-agentcore-observability/agent.py): `bedrock-agentcore-observability/agent.py`

### Container Samples

- [ECS Weather Agent](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ecs-genAI-observability/docker/app/app.py): `ecs-genAI-observability/docker/app/app.py`
- [ECS Infrastructure](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ecs-genAI-observability/cloudformation/weather-agent-ecs.yaml): `ecs-genAI-observability/cloudformation/weather-agent-ecs.yaml`
- [EKS Weather Agent](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/eks-genAI-observability/docker/app/app.py): `eks-genAI-observability/docker/app/app.py`
- [EKS Helm Chart](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/tree/main/eks-genAI-observability/chart): `eks-genAI-observability/chart`

### EC2 Samples

- [EC2 Weather Agent](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app.py): `ec2-genAI-observability/app/app.py`
- [Custom Span Agent](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/app/app-customspan.py): `ec2-genAI-observability/app/app-customspan.py`
- [EC2 Infrastructure](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability/blob/main/ec2-genAI-observability/cloudformation/weather-agent-ec2.yaml): `ec2-genAI-observability/cloudformation/weather-agent-ec2.yaml`

### Observability

- **Amazon Bedrock**
- **Weather API**
- **ADOT Instrumentation**
- **CloudWatch**

### Other components

- **User**

## Connections

- User → Runtime Invoker: submits prompt (evidence: `bedrock-agentcore-observability/invoke.py`)
- Runtime Invoker → AgentCore Runtime: invokes runtime (evidence: `bedrock-agentcore-observability/invoke.py`)
- AgentCore Runtime → Weather Agent: dispatches to (evidence: `README.md`)
- User → ECS Weather Agent: asks weather (evidence: `ecs-genAI-observability/docker/app/app.py`)
- User → EKS Weather Agent: asks weather (evidence: `eks-genAI-observability/docker/app/app.py`)
- User → EC2 Weather Agent: asks weather (evidence: `ec2-genAI-observability/app/app.py`)
- User → Custom Span Agent: asks weather (evidence: `ec2-genAI-observability/app/app-customspan.py`)
- Weather Agent → Amazon Bedrock: infers with (evidence: `bedrock-agentcore-observability/agent.py`)
- Weather Agent → Weather API: requests forecasts (evidence: `bedrock-agentcore-observability/agent.py`)
- ECS Weather Agent → Amazon Bedrock: infers with (evidence: `ecs-genAI-observability/docker/app/app.py`)
- ECS Weather Agent → Weather API: requests forecasts (evidence: `ecs-genAI-observability/docker/app/app.py`)
- EKS Weather Agent → Amazon Bedrock: infers with (evidence: `eks-genAI-observability/docker/app/app.py`)
- EKS Weather Agent → Weather API: requests forecasts (evidence: `eks-genAI-observability/docker/app/app.py`)
- EC2 Weather Agent → Amazon Bedrock: infers with (evidence: `ec2-genAI-observability/app/app.py`)
- EC2 Weather Agent → Weather API: requests forecasts (evidence: `ec2-genAI-observability/app/app.py`)
- Custom Span Agent → Amazon Bedrock: infers with (evidence: `ec2-genAI-observability/app/app-customspan.py`)
- Custom Span Agent → Weather API: requests forecasts (evidence: `ec2-genAI-observability/app/app-customspan.py`)
- Custom Span Agent → Custom Span Agent: creates spans (evidence: `ec2-genAI-observability/app/app-customspan.py`)
- ECS Infrastructure → ECS Weather Agent: deploys (evidence: `README.md`)
- EKS Helm Chart → EKS Weather Agent: deploys (evidence: `README.md`)
- EC2 Infrastructure → EC2 Weather Agent: deploys (evidence: `README.md`)
- Weather Agent → ADOT Instrumentation: emits telemetry (evidence: `README.md`)
- ECS Weather Agent → ADOT Instrumentation: emits telemetry (evidence: `README.md`)
- EKS Weather Agent → ADOT Instrumentation: emits telemetry (evidence: `README.md`)
- EC2 Weather Agent → ADOT Instrumentation: emits telemetry (evidence: `README.md`)
- Custom Span Agent → ADOT Instrumentation: emits telemetry (evidence: `README.md`)
- ADOT Instrumentation → CloudWatch: exports telemetry (evidence: `README.md`)
