How aws-samples/aws-cft-digital-preservation-archivematica-on-aws works
Main Components
• CloudFormation Templates: They are the “source code” for deploying the AWS infrastructure. Indicate that there are two variations:
• Deployment in an existing VPC (with an external load balancer)
• Deployment in a new VPC (with a public Application Load Balancer)
• Networking Infrastructure:
• Virtual Private Cloud (VPC), Subnets (public and private), Internet Gateway, NAT Gateways, and Private S3 VPC Endpoint.
• Security Components:
• IAM roles, KMS keys for encryption, and Security Groups.
• Compute:
• A single EC2 instance (CentOS7 on c6i.2xlarge) running Archivematica.
• Block Storage:
• Multiple EBS volumes (Root, MySQL, Elasticsearch, Archivematica Data Volume) with an emphasis on storage performance (IOPS and throughput settings).
• Object Storage:
• Amazon S3 bucket for AIP Storage and Transfer Source with distinct folder structure.
• Load Balancing:
• An Application Load Balancer with two target groups and HTTP listeners (and a mention of HTTPS when configured).
Relationships and Interactions
• ALB as the frontend routing component receiving inbound HTTP/HTTPS traffic and directing it to the EC2 instance.
• From the EC2 instance, illustrate outgoing communications/configuration connections:
• It interacts with the attached EBS volumes (for OS, MySQL, Elasticsearch, Archivematica data) and S3 for object storage.
• Communication between the Archivematica Dashboard (accessed at ALB:81) and the Storage Service (running on port 8001), including creation and usage of super-user credentials and API keys.
• Secure connectivity paths between the components, e.g., how the EC2 instance uses its IAM role to access the S3 bucket, and how security groups manage inbound/outbound traffic.
Architectural Patterns and Technologies
• The deployment follows a well-architected AWS design with visible separation between compute, block storage, and object storage.
• Best practices for securing the deployment with IAM, KMS, and explicit network security (using subnets, NAT gateways, and ALB security rules).
• Mention operational aspects such as bootstrapping of the EC2 instance, dynamic configuration via the archivematica bootstrap process, and the configuration wizard interaction through the browser.
• That it builds on key AWS services: EC2, EBS, S3, VPC, and CloudFormation.
Elements
• Use clear labels and distinguish between:
• Infrastructure provisioning (CloudFormation Templates)
• Networking components (VPC, subnets, NAT Gateway, Internet Gateway, VPC Endpoint)
• Compute resources (EC2 instance with its attached EBS volumes)
• Load Balancing components (ALB, with indication of HTTPS/HTTP listeners)
• Object storage (S3 bucket along with notes on the two key directories: aip_storage and transfer_source)
• Security components (IAM role, KMS key, Security Groups)
• Data flows such as user requests routed by the ALB to the EC2 instance.
• EC2 interactions with the S3 bucket (for archival object storage) and EBS volumes.