Chinese Nlp Collection

◆

◆

◆

◆

📦Normal

★★★

“AirLLM 70B inference with single 4GB GPU”

◆

◆

◆

◆

🔮Psychic

★★★

“:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。”

◆

◆

◆

◆

📦Normal

★★★

“大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP”

◆

◆

◆

◆

🔥Flame

★★★

“BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）”

◆

◆

◆

◆

📦Normal

★★★

“A curated list of resources for Chinese NLP 中文自然语言处理相关资料”

◆

◆

◆

◆

🔮Psychic

★★★

“Language Technology Platform”

◆

◆

◆

◆

📦Normal

★★

“MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。”

◆

◆

◆

◆

🔮Psychic

★★

“Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。”

◆

◆

◆

◆

🔥Fire

★★

“百度NLP：分词，词性标注，命名实体识别，词重要性”

◆

◆

◆

◆

🔮Psychic

★★

“fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.”

◆

◆

◆

◆

🔮Psychic

★★

“Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集”

◆

◆

◆

◆

🔮Psychic

★★

“Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取”

◆

◆

◆

◆

🔮Psychic

★★

“An Efficient Lexical Analyzer for Chinese”

◆

◆

◆

◆

🔥Flame

★★

“Datasets, SOTA results of every fields of Chinese NLP”

◆

◆

◆

◆

🔮Psychic

★★

“百度开源的依存句法分析系统”

◆

◆

◆

◆

📦Normal

★★

“An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM”

◆

◆

◆

◆

⚡Thunder

★★

“Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch”

◆

◆

◆

◆

🔮Psychic

★★

“Collections of Chinese NLP corpus”