How senainspace/news-retrieval-engine works
This is a Java news-retrieval engine: it loads article records and text-cleaning resources, builds a word-to-article index, then supports ID lookup and ranked multi-term search. Its custom hash map underpins article storage and indexing; the README also documents a benchmark comparing hash and collision strategies. A separate debugger implementation is present. The graph follows the supplied excerpts and README; the CNN dataset is not in the tree, and internal details not shown are represented only where documented.
Main entry points: PreProcesser.java Article processor · SearchEngine.java Interactive search · HashMapCustom.java Custom hash map · PreProcesserDebugger.java Debug processor
Components 21
Search workflow
- Interactive search
src/SearchEngine - run this for searching/SearchEngine.java - Article processor
src/PreProcessing/PreProcesser.java - Text filtering
src/PreProcessing/PreProcesser.java - Article ingestion
src/PreProcessing/PreProcesser.java - Article record
src/PreProcessing/Article.java - CNN articles
- Stop words
src/Data/stop_words_en.txt - Delimiters
src/Data/delimiters.txt - ID lookup
src/PreProcessing/PreProcesser.java - Query ranking
src/PreProcessing/PreProcesser.java - Ranked articles
src/PreProcessing/PreProcesser.java
Index and storage
- Word indexing
src/PreProcessing/PreProcesser.java - Word postings
src/PreProcessing/PreProcesser.java - Custom hash map
src/HashMaps/HashMapCustom.java - Map entry
src/PreProcessing/Entry.java
Benchmarking
- Performance matrix
src/PerformanceTesting/PerformanceTesting.java - Benchmark processor
src/PerformanceTesting/PreProcesserPerformanceTesting.java - Search workload
src/Data/search.txt
Debug tooling
- Debugger runner
src/Debuggers/Debugger.java - Debug processor
src/Debuggers/PreProcesserDebugger.java
Other components
- Search user
Connections 24
- Search user → Interactive search: enters query
src/SearchEngine - run this for searching/SearchEngine.java - Interactive search → Article processor: loads and searches
src/SearchEngine - run this for searching/SearchEngine.java - Interactive search → Stop words: loads
src/SearchEngine - run this for searching/SearchEngine.java - Interactive search → Delimiters: loads
src/SearchEngine - run this for searching/SearchEngine.java - Interactive search → CNN articles: loads articles
src/SearchEngine - run this for searching/SearchEngine.java - Article processor → Article ingestion: loads records
README.md - Article ingestion → Article record: creates records
src/PreProcessing/PreProcesser.java - Text filtering → Stop words: filters with
README.md - Text filtering → Delimiters: splits with
README.md - Article processor → Word indexing: indexes articles
src/SearchEngine - run this for searching/SearchEngine.java - Word indexing → Word postings: builds postings
src/PreProcessing/PreProcesser.java - Article processor → ID lookup: retrieves by ID
src/SearchEngine - run this for searching/SearchEngine.java - Article processor → Query ranking: searches query
src/SearchEngine - run this for searching/SearchEngine.java - Query ranking → Word postings: reads postings
src/PreProcessing/PreProcesser.java - Query ranking → Article record: reads fields
src/PreProcessing/PreProcesser.java - Query ranking → Ranked articles: ranks and emits
README.md - Article processor → Custom hash map: uses maps
src/PreProcessing/PreProcesser.java - Custom hash map → Map entry: stores entries
src/HashMaps/HashMapCustom.java - Performance matrix → Benchmark processor: configures runs
src/PerformanceTesting/PerformanceTesting.java - Performance matrix → Search workload: reads workload
src/PerformanceTesting/PerformanceTesting.java - Benchmark processor → Custom hash map: configures map
src/PerformanceTesting/PreProcesserPerformanceTesting.java - Debugger runner → Debug processor: runs searches
src/Debuggers/Debugger.java - Debug processor → Custom hash map: uses maps
src/Debuggers/PreProcesserDebugger.java - Debug processor → Article record: creates records
src/Debuggers/PreProcesserDebugger.java