How mimno/mallet works
MALLET is a Java toolkit for turning text into machine-learning representations and applying them to classification, clustering, sequence prediction and extraction, topic modeling, embeddings, and regression. A typical workflow starts with input instances, transforms them through reusable pipes, then trains or applies a task-specific model and evaluates its results. The tree and README establish these product areas; sampled code confirms examples such as CRF decoding, classifier training with L-BFGS, topic inference, and embedding training. Several branches are represented at package level because their central implementations were not sampled.
Main entry points: types Instances and features · fst Sequence models · classify Classifier training · pipe Text processing pipes
Components 19
Data preparation
- Instances and features
src/main/java/cc/mallet/types - Text processing pipes
src/main/java/cc/mallet/pipe - Optimizers
src/main/java/cc/mallet/optimize
Classification
- Classifier models
src/main/java/cc/mallet/classify - Classifier training
src/main/java/cc/mallet/classify - Classification evaluation
src/main/java/cc/mallet/classify/evaluate - Clustering models
src/main/java/cc/mallet/cluster - Clustering evaluation
src/main/java/cc/mallet/cluster/evaluate - Classification tools
src/main/java/cc/mallet/classify/tui - Clustering tools
src/main/java/cc/mallet/cluster/tui
Sequences and extraction
- Sequence models
src/main/java/cc/mallet/fst - Sequence training
src/main/java/cc/mallet/fst - Sequence confidence
src/main/java/cc/mallet/fst/confidence - Information extraction
src/main/java/cc/mallet/extract
Unsupervised learning
- Topic models
src/main/java/cc/mallet/topics - Topic inference
src/main/java/cc/mallet/topics/TopicInferencer.java - Word embeddings
src/main/java/cc/mallet/topics/WordEmbeddings.java
Other learning
- Linear regression
src/main/java/cc/mallet/regression
Other components
- MALLET user
Connections 23
- MALLET user → Text processing pipes: provides text
- Text processing pipes → Instances and features: transforms into
- MALLET user → Instances and features: provides vectors
- Instances and features → Classifier training: training data
- Classifier training → Optimizers: optimizes parameters
- Classifier training → Classifier models: trains
- Instances and features → Classifier models: classifies
- Classifier models → Classification evaluation: evaluated by
- Instances and features → Clustering models: clusters
- Clustering models → Clustering evaluation: evaluated by
- Instances and features → Sequence training: labeled sequences
- Sequence training → Optimizers: optimizes parameters
- Sequence training → Sequence models: trains
- Instances and features → Sequence models: sequence input
- Sequence models → Sequence confidence: estimates confidence
- Sequence models → Information extraction: produces spans
- Instances and features → Topic models: documents
- Topic models → Topic inference: supports inference
- Instances and features → Topic inference: infers topics
- Instances and features → Word embeddings: trains embeddings
- Instances and features → Linear regression: regression data
- MALLET user → Classification tools: runs commands
- MALLET user → Clustering tools: runs commands