How sonphattrandeveloper/it-job-posting works
Project type and purpose
• This is a data analysis and visualization repository built around a single CSV dataset of 3,101 Vietnamese IT job postings.
• Its primary purpose is to store, process, enrich (via LLM‐based extraction of languages/technologies/cities), and render interactive visualizations in a standalone HTML file.
File structure
• Top‐level files only:
• job_descriptions.csv – the raw dataset
• data_analysis_visualization.html – the rendered interactive dashboard
• README.md – project description and data schema
• No “src” or “scripts” directories are present; processing is implied to happen offline (e.g., in notebooks) before generating the HTML.
README for additional insights
• The CSV has columns for title, company, location, raw description, plus fields extracted via LLMs (main_programming_languages, key_technologies, city).
Main components and their interactions
a. Data Storage
b. Data Processing / ETL
• Internals:
– CSV Reader (e.g., pandas)
– LLM Extraction module (e.g., OpenAI API client)
– Cleaner & Transformer
• Outputs a JSON/JS data blob for visualization
c. Visualization Engine
• Consumes the JSON/JS data blob and renders charts, maps, tables
d. End User
Relationships / Data Flow
Architectural patterns and design principles
• ETL Pipeline Pattern: clear separation of Ingestion, Enrichment, and Presentation layers
• Single‐page static visualization: front‐end only, no backend server at runtime
Relevant technologies and libraries
• Data processing: Python (pandas), OpenAI SDK (or other LLM client)
• Visualization: plain HTML, JavaScript libraries (D3.js, Plotly.js, Chart.js, etc.)
• Deployment: serves as a static HTML file—no container or server framework required