How xinyangz/twhin-bert works
Project type and purpose
• TwHIN-BERT is an open-source, pre-trained multilingual tweet language model with a social‐enrichment objective. It is designed to be used as a drop-in replacement for BERT in both NLP tasks (e.g., classification) and social recommendation tasks (e.g., engagement prediction). There is no application‐specific frontend or backend; the “system” is primarily the data‐to‐model training pipeline plus the model deployment interface.
File structure
• At the top level you only have LICENSE and README.md, so code and data pipelines are implied rather than present. The README references:
• Pretraining code and models (hosted on HuggingFace)
• Two datasets (hashtag-prediction, engagement-prediction) with external download links
• A usage snippet that invokes the HuggingFace Transformers library
README for additional insights
• Pretraining occurs over two objectives: MLM (text masking) and a social engagement objective computed on a Twitter Heterogeneous Information Network (TwHIN).
• Downstream usage is via the standard Transformers interface.
• Model artifacts live on HuggingFace, datasets live on HuggingFace Datasets (or external dropbox).