Pre Training Collection
Repositories tagged with "pre-training"
Repositories tagged with "pre-training"
LLMSurvey
RUCAIBox
โThe official GitHub page for the survey paper "A Survey of Large Language Models".โ
data-juicer
datajuicer
โData processing for and with foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ทโ
UER-py
dbiir
โOpen Source Pre-training Model Framework in PyTorch & Pre-trained Model Zooโ
prompt-in-context-learning
EgoAlpha
โAwesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates. โ
awesome-self-supervised-gnn
ChandlerBang
โPapers about pretraining and self-supervised learning on Graph Neural Networks (GNN).โ
uni2ts
SalesforceAIResearch
โUnified Training of Universal Time Series Forecasting Transformersโ
awesome-graph-self-supervised-learning
LirongWu
โCode for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"โ
KnowLM
zjunlp
โAn Open-sourced Knowledgable Large Language Model Framework.โ
Awesome-CLIP
yzhuoning
โAwesome list for research on CLIP (Contrastive Language-Image Pre-Training).โ
Awesome-TimeSeries-SpatioTemporal-LM-LLM
qingsongedu
โA professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.โ
TencentPretrain
Tencent
โTencent Pre-training framework in PyTorch & Pre-trained Model Zoo โ
Oscar
microsoft
โOscar and VinVLโ
bert_language_understanding
brightmart
โPre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNNโ
UNITER
ChenRocks
โResearch code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"โ
Awesome-LLM4RS-Papers
nancheng58
โ Large Language Model-enhanced Recommender System Papersโ
VL-BERT
jackroos
โCode for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".โ
Craw4LLM
cxcscmu
โOfficial repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"โ
LLM-Shearing
princeton-nlp
โ[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningโ