How shivamdevkar/automated-subjective-question-answer-evaluation-system works
This is a DBMS handwritten-answer grading application. Educators or students submit an image or text answer through the Streamlit interface; the evaluator coordinates OCR (for images), text preparation, similarity analysis, grade prediction, and scoring with feedback. The README also describes batch evaluation, PDF-based training-data extraction, model training, and evaluation history. The main pipeline is documented, but excerpts do not expose all runtime calls, so some secondary links are omitted or marked unverified.
Main entry points: evaluator.py Evaluation orchestrator · app.py Streamlit interface · config.py System configuration · ocr_processor.py Handwriting OCR
Components 18
User interface
- Streamlit interface
app.py - Input validation
src/validators.py
Answer ingestion
- Handwriting OCR
src/ocr_processor.py - PDF extraction
src/pdf_processor.py
Answer analysis
- Text processing
src/text_processor.py - Similarity metrics
src/similarity_calculator.py - BERT similarity
src/bert_similarity.py - SimCSE similarity
src/simcse_similarity.py
Grading and feedback
- Evaluation orchestrator
src/evaluator.py - Grade classifier
src/ml_classifier.py - Classifier v2
src/ml_classifier_v2.py - Model ensemble
src/ensemble.py - Scoring and feedback
src/scoring_system.py
Training and configuration
- System configuration
config.py - Training datasets
data/training_data.csv - Sample questions
data/sample_questions.json - DBMS training pairs
data/dbms_training_pairs.json
Other components
- Educator or student
Connections 25
- Educator or student → Streamlit interface: submits answer
README.md - Streamlit interface → Input validation: validates input
app.py - Streamlit interface → Evaluation orchestrator: requests evaluation
README.md - Evaluation orchestrator → Handwriting OCR: extracts handwriting
README.md - Evaluation orchestrator → Text processing: prepares text
README.md - Evaluation orchestrator → Similarity metrics: calculates metrics
README.md - Evaluation orchestrator → Grade classifier: predicts grade
README.md - Evaluation orchestrator → Scoring and feedback: scores answer
README.md - Evaluation orchestrator → PDF extraction: processes training PDFs
src/evaluator.py - PDF extraction → Handwriting OCR: uses OCR
src/pdf_processor.py - Evaluation orchestrator → BERT similarity: may use similarity
src/evaluator.py - Evaluation orchestrator → SimCSE similarity: may use similarity
- Evaluation orchestrator → Classifier v2: may predict grade
src/evaluator.py - Evaluation orchestrator → Model ensemble: may combine models
src/evaluator.py - Evaluation orchestrator → System configuration: reads settings
src/evaluator.py - Grade classifier → System configuration: reads settings
src/ml_classifier.py - Handwriting OCR → System configuration: reads settings
src/ocr_processor.py - Text processing → System configuration: reads settings
src/text_processor.py - Similarity metrics → System configuration: reads settings
src/similarity_calculator.py - Scoring and feedback → System configuration: reads settings
src/scoring_system.py - Streamlit interface → Training datasets: loads training data
- Streamlit interface → Sample questions: loads sample questions
- Evaluation orchestrator → Training datasets: trains from data
- Evaluation orchestrator → DBMS training pairs: may use training pairs
- Streamlit interface → Educator or student: presents results
README.md