Pre Training Collection
Repositories tagged with "pre-training"
RARE
⭐12.2kHP
◆
◆
◆
◆
🔮Psychic
★★★
LLMSurvey
RUCAIBox
Pythonchain-of-thoughtchatgpt
“The official GitHub page for the survey paper "A Survey of Large Language Models".”
12.2k
935
12.2k
GitPedia Card187/003
RARE
⭐6.5kHP
◆
◆
◆
◆
🔮Psychic
★★★
data-juicer
datajuicer
Pythondatadata-analysis
“Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷”
6.5k
374
6.5k
GitPedia Card910/003
UNCOMMON
⭐3.1kHP
◆
◆
◆
◆
🔮Psychic
★★
UER-py
dbiir
Pythonalbertbart
“Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo”
3.1k
520
3.1k
GitPedia Card953/002
UNCOMMON
⭐2.2kHP
◆
◆
◆
◆
📦Normal
★★
prompt-in-context-learning
EgoAlpha
Jupyter Notebookai-agentchain-of-thought
“Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates. ”
2.2k
191
2.2k
GitPedia Card527/002
UNCOMMON
⭐1.7kHP
◆
◆
◆
◆
🔮Psychic
★★
awesome-self-supervised-gnn
ChandlerBang
Pythondeep-learninggraph-mining
“Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).”
1.7k
166
1.7k
GitPedia Card803/002
UNCOMMON
⭐1.5kHP
◆
◆
◆
◆
📦Normal
★★
uni2ts
SalesforceAIResearch
Jupyter Notebookdeep-learningforecasting
“Unified Training of Universal Time Series Forecasting Transformers”
1.5k
197
1.5k
GitPedia Card399/002
UNCOMMON
⭐1.4kHP
◆
◆
◆
◆
📦Normal
★★
awesome-graph-self-supervised-learning
LirongWu
data-augmentationdeep-learning
“Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"”
1.4k
165
1.4k
GitPedia Card008/002
UNCOMMON
⭐1.4kHP
◆
◆
◆
◆
🔮Psychic
★★
KnowLM
zjunlp
Pythonbilingualchinese
“An Open-sourced Knowledgable Large Language Model Framework.”
1.4k
133
1.4k
GitPedia Card626/002
UNCOMMON
⭐1.2kHP
◆
◆
◆
◆
📦Normal
★★
Awesome-CLIP
yzhuoning
clipcontrastive-learning
“Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).”
1.2k
59
1.2k
GitPedia Card829/002
UNCOMMON
⭐1.2kHP
◆
◆
◆
◆
📦Normal
★★
Awesome-TimeSeries-SpatioTemporal-LM-LLM
qingsongedu
anomalydetectionautoscaling
“A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.”
1.2k
90
1.2k
GitPedia Card256/002
UNCOMMON
⭐1.1kHP
◆
◆
◆
◆
🔮Psychic
★★
TencentPretrain
Tencent
Pythonalbertbart
“Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo ”
1.1k
147
1.1k
GitPedia Card183/002
UNCOMMON
⭐1.1kHP
◆
◆
◆
◆
🔮Psychic
★★
Oscar
microsoft
Pythonimage-captioningimage-text-search
“Oscar and VinVL”
1.1k
248
1.1k
GitPedia Card410/002
UNCOMMON
⭐965HP
◆
◆
◆
◆
🔮Psychic
★★
bert_language_understanding
brightmart
Pythonattention-is-all-you-needbert-model
“Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN”
965
211
965
GitPedia Card593/002
UNCOMMON
⭐800HP
◆
◆
◆
◆
🔮Psychic
★★
UNITER
ChenRocks
Pythonpre-trainingpytorch
“Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"”
800
112
800
GitPedia Card961/002
UNCOMMON
⭐762HP
◆
◆
◆
◆
📦Normal
★★
Awesome-LLM4RS-Papers
nancheng58
awesome-listgpt
“ Large Language Model-enhanced Recommender System Papers”
762
65
762
GitPedia Card835/002
UNCOMMON
⭐745HP
◆
◆
◆
◆
📦Normal
★★
VL-BERT
jackroos
Jupyter Notebookberticlr2020
“Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".”
745
110
745
GitPedia Card169/002
UNCOMMON
⭐654HP
◆
◆
◆
◆
🔮Psychic
★★
Craw4LLM
cxcscmu
Pythoncrawlercrawling
“Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"”
654
60
654
GitPedia Card119/002
UNCOMMON
⭐643HP
◆
◆
◆
◆
🔮Psychic
★★
LLM-Shearing
princeton-nlp
Pythonefficiencyllama
“[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning”
643
59
643
GitPedia Card389/002