How manuelparra1/book-summary works
This is a small book-summarization toolchain: text cleanup is a standalone script, while tokenization writes JSON chunks that the summarizer sends to OpenAI and prints as summaries. The excerpts show those file operations and API call. The README describes automatic summarization and configurable settings, but the sampled summarizer uses hard-coded parameters. The tokenizer’s filename filter does not match the chapter filenames listed in the tree, so a connection from those chapters to tokenization is not asserted.
Main entry points: summarizer.py API summarizer · tokenizer.py Text tokenizer · token_chunks.json Token chunks · cleaner.py Text cleaner
Components 8
Text preparation
- Chapter text
chapter_1.txt - Text cleaner
cleaner.py
Chunk generation
- Text tokenizer
tokenizer.py - Token chunks
token_chunks.json
Summary generation
- API summarizer
summarizer.py - Printed summaries
Other components
- spaCy model
- OpenAI API
Connections 6
- Text cleaner → Chapter text: reads and rewrites
cleaner.py - Text tokenizer → spaCy model: loads model
tokenizer.py - Text tokenizer → Token chunks: writes chunks
tokenizer.py - API summarizer → Token chunks: reads chunks
summarizer.py - API summarizer → OpenAI API: requests summaries
summarizer.py - API summarizer → Printed summaries: prints results
summarizer.py