How lighteko/infoscribe works
Project Type & Purpose
• This is a full-stack, AI-powered newsletter platform (“Infoscribe”) built with a Next.js frontend, an Express.js API backend, and AWS serverless components.
• It curates and summarizes articles via LangChain/OpenAI, schedules jobs with EventBridge, stores newsletters in S3, delivers emails via SES, and persists user/content data in RDS (MySQL).
Key Directories & Their Roles
– next/: Next.js React-based frontend (mobile-first UI, Zustand)
– express/: Express.js REST API (containerized via Docker, hosted on EC2)
– lambda/: AWS Lambda functions (LangChain summarization & other automation tasks)
Main Components
a. User (browser or mobile)
b. Next.js Frontend (next/)
c. Express API (express/ in Docker on EC2)
d. AWS EventBridge (scheduler)
e. AWS Lambda functions (lambda/)
f. OpenAI API (external LangChain dependency)
g. Amazon RDS (MySQL content & user database)
h. Amazon S3 (newsletter storage)
i. Amazon SES (email delivery)
Relationships & Data Flows
1) User → Next.js Frontend:
– UI requests (e.g., login, preferences, newsletter preview)
2) Frontend → Express API:
– REST calls for CRUD operations on users, keywords, newsletter triggers
3) Express API ↔ RDS:
– Reads/writes user data, content metadata, scheduling info
4) Express API → EventBridge:
– Registers or updates scheduled jobs (e.g., daily newsletter run)
5) EventBridge → Lambda:
– Triggers summarization & generation workflow at scheduled times
6) Lambda → OpenAI (via LangChain):
– Pulls articles, generates summaries
7) Lambda → S3:
– Saves compiled newsletter HTML/PDF
8) Lambda → SES:
– Sends out newsletter emails to subscribers
Architectural Patterns & Principles
• Separation of concerns:
– UI layer (Next.js), API layer (Express), compute layer (Lambda), persistence (RDS/S3), delivery (SES).
• Serverless event-driven scheduling: EventBridge → Lambda.
• Micro-services style: lightweight API + isolated lambdas.
• Containerization for the Express API (Docker on EC2).
• Use of external AI service (OpenAI) abstracted by LangChain.