How aymaan-mulla/ai-powered-financial-linkedin-data-pipeline works
The README describes an AI-powered financial and LinkedIn pipeline, but the tree and sampled source show a collection of separate applications and experiments rather than one verifiable end-to-end runtime. The clearest workflows are LinkedIn profile scraping to JSON, image-to-table OCR, a notes frontend, and contact management. Spark, ELK, MongoDB, Postgres, and financial processing are documented or present in the tree, but their integration is not established by the excerpts; those connections are therefore omitted.
Main entry points: main.js Scraper web app · main.py OCR workflow · App.jsx Frontend routes · Home.jsx Notes page
Components 21
LinkedIn scraper
- Scraper web app
new/app/scrap/main.js - URL input JSON
new/app/scrap/main.js - Profile scraper
new/app/scrap/scraper.js - Profile JSON output
new/app/scrap/main.js
Image table OCR
- OCR workflow
CV engenering/paddleocr/New folder/fnfokasn/main.py - Table extraction
CV engenering/paddleocr/New folder/fnfokasn/TableExtractor.py - Line removal
CV engenering/paddleocr/New folder/fnfokasn/TableLinesRemover.py - OCR to table
CV engenering/paddleocr/New folder/fnfokasn/OcrToTableTool.py
Notes application
- Frontend routes
react frontend/src/App.jsx - Protected route
react frontend/src/components/ProtectedRoute.jsx - Notes page
react frontend/src/pages/Home.jsx - API client
react frontend/src/api.js - Note component
react frontend/src/components/Note.jsx
Contact API
- Contact service
java backend/backends/src/main/java/io/getarrays/contactapi/service/ContactService.java - Contact repository
java backend/backends/src/main/java/io/getarrays/contactapi/repo/ContactRepo.java - Contact entity
java backend/backends/src/main/java/io/getarrays/contactapi/domain/Contact.java - Photo files
java backend/backends/src/main/java/io/getarrays/contactapi/constant/Constant.java
Other components
- Scraping user
- LinkedIn profiles
- Image analyst
- Notes user
Connections 17
- Scraping user → Scraper web app: triggers scrape
new/app/scrap/main.js - Scraper web app → URL input JSON: reads URLs
new/app/scrap/main.js - Scraper web app → Profile scraper: scrapes profile
new/app/scrap/main.js - Profile scraper → LinkedIn profiles: retrieves profile
- Scraper web app → Profile JSON output: writes profile
new/app/scrap/main.js - Image analyst → OCR workflow: runs workflow
CV engenering/paddleocr/New folder/fnfokasn/main.py - OCR workflow → Table extraction: extracts table
CV engenering/paddleocr/New folder/fnfokasn/main.py - OCR workflow → Line removal: removes lines
CV engenering/paddleocr/New folder/fnfokasn/main.py - OCR workflow → OCR to table: recognizes table
CV engenering/paddleocr/New folder/fnfokasn/main.py - Notes user → Frontend routes: uses app
- Frontend routes → Protected route: routes through
react frontend/src/App.jsx - Frontend routes → Notes page: routes to
react frontend/src/App.jsx - Notes page → API client: requests notes
react frontend/src/pages/Home.jsx - Notes page → Note component: renders notes
react frontend/src/pages/Home.jsx - Contact service → Contact repository: reads and saves
java backend/backends/src/main/java/io/getarrays/contactapi/service/ContactService.java - Contact repository → Contact entity: persists entity
java backend/backends/src/main/java/io/getarrays/contactapi/repo/ContactRepo.java - Contact service → Photo files: stores photos
java backend/backends/src/main/java/io/getarrays/contactapi/service/ContactService.java