How sivaprakash442001/dme-data-matching-engine works
This is a web-based entity-resolution engine. Users upload a dataset or enter two strings, select or auto-detect matching types, and receive scored, categorized results with explanations; dataset matches can be filtered and exported. The graph preserves ingestion, normalization, specialized matching, scoring, and the documented interactive UI and multi-column capabilities. Some routes and matcher implementations were only partially sampled, so their connections rely on the SOURCE INDEX references or README statements rather than claims about unseen details.
Main entry points: engine.py Matching engine · routes.py API routes · cleaner.py Text normalizer · scorer.py Score and explanation
Components 25
Web interface
- FastAPI app
app/main.py - API routes
app/web/routes.py - Web dashboard
app/web/static/js/app.js
Data handling
- File reader
app/utils/file_reader.py - Sample datasets
app/utils/sample_generator.py - Result exporters
app/utils/exporters.py
Normalization
- Text normalizer
app/normalization/cleaner.py - Abbreviation rules
app/normalization/abbreviations.py - Number rules
app/normalization/numbers.py - Address parser
app/normalization/addresses.py - Name parser
app/normalization/names.py
Matching
- Type detector
app/matching/detector.py - Matching engine
app/matching/engine.py - Similarity algorithms
app/matching/algorithms.py - Specialized matchers
app/matching - Address matcher
app/matching/address.py - Company matcher
app/matching/company.py - Person name matcher
app/matching/name.py - Email matcher
app/matching/email.py - Phone matcher
app/matching/phone.py - ID matcher
app/matching/id_code.py - Generic matcher
app/matching/generic.py
Scoring
- Weight profiles
app/scoring/weights.py - Score and explanation
app/scoring/scorer.py
Other components
- User
Connections 48
- User → Web dashboard: uses
README.md - Web dashboard → API routes: calls API
README.md - FastAPI app → API routes: mounts routes
app/main.py - FastAPI app → Sample datasets: generates samples
app/main.py - API routes → File reader: reads uploads
app/web/routes.py - API routes → Type detector: detects types
app/web/routes.py - API routes → Matching engine: runs matching
app/web/routes.py - API routes → Score and explanation: configures thresholds
app/web/routes.py - API routes → Result exporters: exports results
app/web/routes.py - API routes → Sample datasets: serves sample data
app/web/routes.py - API routes → Web dashboard: serves dashboard
README.md - Matching engine → Type detector: detects values
app/matching/engine.py - Matching engine → Generic matcher: dispatches to
app/matching/engine.py - Matching engine → Address matcher: dispatches to
app/matching/engine.py - Matching engine → Company matcher: dispatches to
app/matching/engine.py - Matching engine → Person name matcher: dispatches to
app/matching/engine.py - Matching engine → Email matcher: dispatches to
app/matching/engine.py - Matching engine → Phone matcher: dispatches to
app/matching/engine.py - Matching engine → ID matcher: dispatches to
app/matching/engine.py - Matching engine → Score and explanation: uses scorer
app/matching/engine.py - Address matcher → Address parser: parses addresses
app/matching/address.py - Address matcher → Score and explanation: builds results
app/matching/address.py - Company matcher → Text normalizer: normalizes text
app/matching/company.py - Company matcher → Abbreviation rules: uses abbreviations
app/matching/company.py - Company matcher → Similarity algorithms: compares strings
app/matching/company.py - Company matcher → Weight profiles: gets weights
app/matching/company.py - Company matcher → Score and explanation: builds results
app/matching/company.py - Specialized matchers → Similarity algorithms: uses algorithms
app/matching/__init__.py - Person name matcher → Name parser: parses names
app/matching/name.py - Person name matcher → Text normalizer: normalizes text
app/matching/name.py - Person name matcher → Similarity algorithms: compares strings
app/matching/name.py - Person name matcher → Score and explanation: builds results
app/matching/name.py - Email matcher → Text normalizer: normalizes text
app/matching/email.py - Email matcher → Similarity algorithms: compares strings
app/matching/email.py - Email matcher → Score and explanation: builds results
app/matching/email.py - Phone matcher → Text normalizer: normalizes text
app/matching/phone.py - Phone matcher → Similarity algorithms: compares strings
app/matching/phone.py - Phone matcher → Score and explanation: builds results
app/matching/phone.py - ID matcher → Text normalizer: normalizes text
app/matching/id_code.py - ID matcher → Similarity algorithms: compares strings
app/matching/id_code.py - ID matcher → Score and explanation: builds results
app/matching/id_code.py - Generic matcher → Text normalizer: normalizes text
app/matching/generic.py - Generic matcher → Similarity algorithms: compares strings
app/matching/generic.py - Generic matcher → Score and explanation: builds results
app/matching/generic.py - Address parser → Text normalizer: normalizes text
app/normalization/addresses.py - Address parser → Abbreviation rules: uses abbreviation rules
app/normalization/addresses.py - Name parser → Text normalizer: normalizes names
app/normalization/names.py - Text normalizer → Abbreviation rules: expands abbreviations
app/normalization/cleaner.py