Search Results - RepositoryStats

LoRA microsoft

732

11.6k

mit

69

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

lora gpt-2 gpt-3 deberta pytorch roberta low-rank adaptation deep-learning language-model

Created 2021-06-18

46 commits to main branch, last one 3 months ago

Chinese-BERT-wwm ymcui

1.4k

9.9k

apache-2.0

141

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

nlp rbt bert pytorch roberta bert-wwm tensorflow roberta-wwm bert-wwm-ext chinese-bert

Created 2019-06-19

110 commits to master branch, last one about a year ago

bertviz jessevig

805

7.3k

apache-2.0

72

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

nlp bert gpt2 pytorch roberta transformer transformers visualization neural-network machine-learning natural-language-processing

Created 2018-12-16

307 commits to master branch, last one about a year ago

awesome-pretrained-chinese-nlp-models lonePatient

491

5.2k

mit

94

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

gpt llm nlp bert ernie gpt-2 nezha pangu xlnet chinese dataset nlu-nlg roberta simbert multimodel pretrained-models large-language-models

Created 2019-05-25

428 commits to main branch, last one 8 days ago

CLUE CLUEbenchmark

547

4.1k

unknown

89

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

nlu bert glue albert corpus chinese dataset pytorch roberta benchmark tensorflow chineseglue transformers language-model pretrained-models

Created 2019-11-22

527 commits to master branch, last one 10 months ago

albert_zh brightmart

753

4.0k

unknown

101

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

bert xlnet albert pytorch roberta tensorflow pre-trained chinese-corpus pre-trained-model

Created 2019-09-26

107 commits to master branch, last one 2 years ago

UER-py dbiir

524

3.0k

apache-2.0

74

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Created 2019-04-10

1,058 commits to master branch, last one 10 months ago

rust-bert guillaume-be

222

2.8k

apache-2.0

40

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

gpt ner nlp bart bert rust gpt-2 electra roberta rust-lang transformer translation deep-learning machine-learning question-answering sentiment-analysis language-generation

Created 2020-01-25

1,118 commits to main branch, last one 6 months ago

roberta_zh brightmart

413

2.7k

unknown

52

RoBERTa中文预训练模型: RoBERTa for Chinese

bert gpt2 chinese roberta pre-trained pre-trained-language-models

Created 2019-09-02

41 commits to master branch, last one 2 years ago

news-please fhamborg

431

2.2k

apache-2.0

52

news-please - an integrated web crawler and information extractor for news that just works

Created 2016-12-18

810 commits to master branch, last one 5 days ago

DeBERTa microsoft

233

2.1k

mit

40

The implementation of DeBERTa

bert roberta deeplearning language-model self-attention transformer-encoder representation-learning natural-language-understanding

Created 2020-06-08

55 commits to master branch, last one 2 years ago

FARM deepset-ai

249

1.8k

apache-2.0

53

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

ner nlp bert pytorch roberta germanbert nlp-library deep-learning nlp-framework xlnet-pytorch language-models pretrained-models transfer-learning question-answering

Created 2019-07-17

594 commits to master branch, last one 2 years ago

TurboTransformers Tencent

200

1.5k

other

40

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

gpu nlp bert gpt2 albert decoder pytorch roberta inference transformer machine-translation huggingface-transformers

Created 2020-04-20

870 commits to master branch, last one 3 years ago

CLUENER2020 CLUEbenchmark

303

1.5k

unknown

19

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

ner bert albert chinese dataset roberta seq2seq chinesener chinese-ner fine-grained-ner sequence-labeling sequence-to-sequence named-entity-recognition

Created 2020-01-05

69 commits to master branch, last one 2 years ago

bert_seq2seq 920232796

209

1.3k

apache-2.0

12

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

crf ner bert gpt2 unilm pytorch roberta seq2seq t5-model autotitle text-classification

Created 2020-03-13

230 commits to master branch, last one 2 years ago

TencentPretrain Tencent

147

1.1k

other

20

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Created 2022-09-26

110 commits to main branch, last one 11 months ago

CLUECorpus2020 CLUEbenchmark

81

946

mit

19

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

nlp bert albert corpus chinese roberta datasets pretrain chinese-corpus

Created 2020-01-25

25 commits to master branch, last one 2 years ago

gector grammarly

219

917

apache-2.0

21

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

nlp bert xlnet roberta transformers sequence-labeling text-simplification natural-language-processing grammatical-error-correction

Created 2020-05-21

52 commits to master branch, last one 2 years ago

curated-transformers explosion

34

884

mit

13

🤖 A PyTorch library of curated Transformer models and their composable components

llm nlp bert llms llama albert dolly2 falcon gptneox pytorch roberta camembert transformer xlm-roberta transformers

Created 2022-09-14

390 commits to main branch, last one 11 months ago

texar-pytorch asyml

115

745

apache-2.0

24

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

bert gpt-2 texar xlnet python pytorch roberta text-data casl-project deep-learning texar-pytorch dialog-systems data-processing text-generation machine-learning machine-translation natural-language-processing

Created 2019-03-08

496 commits to master branch, last one 2 years ago

PhoBERT VinAIResearch

102

704

mit

22

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Created 2020-03-03

46 commits to master branch, last one 8 months ago

PromptCLUE clue-ai

67

662

other

9

PromptCLUE, 全中文任务支持零样本学习模型

bert gpt-3 chinese roberta t5-model prompt-tuning few-shot-learning pretrained-models transfer-learning multitask-learning zero-shot-learning

Created 2022-09-29

84 commits to main branch, last one about a year ago

BERTweet VinAIResearch

52

589

mit

11

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

ner bert covid covid19 english fairseq python3 roberta bertweet covid-19 transformers english-tweets language-model irony-detection bertweet-covid19 sentiment-analysis text-classification part-of-speech-tagging named-entity-recognition

Created 2020-05-06

39 commits to master branch, last one 8 months ago

japanese-pretrained-models rinnakk

41

582

apache-2.0

13

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

nlp gpt2 roberta japanese

Created 2021-04-06

21 commits to master branch, last one 2 years ago

KLUE KLUE-benchmark

56

565

cc-by-sa-4.0

19

📖 Korean NLU Benchmark

bert korean roberta benchmark korean-nlp

Created 2020-11-16

33 commits to main branch, last one 3 years ago

happy-transformer EricFillion

67

530

apache-2.0

6

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

ai nlp bert python roberta transformers deep-learning language-models machine-learning question-answering text-classification artificial-intelligence natural-language-processing

Created 2019-10-06

1,220 commits to master branch, last one 7 days ago

CLUENER2020 hemingkx

109

493

unknown

5

A PyTorch implementation of a BiLSTM\BERT\Roberta(+CRF) model for Named Entity Recognition.

ner bert pytorch roberta bert-crf bilstm-crf named-entity-recognition

Created 2020-11-13

59 commits to main branch, last one 4 years ago

TransformerSum HHousen

58

429

gpl-3.0

5

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

bert albert roberta distilbert summarization machine-learning pytorch-lightning text-summarization transformer-models summarization-dataset automatic-summarization extractive-summarization

Created 2020-04-07

240 commits to master branch, last one about a year ago

BOND cliang1453

34

291

apache-2.0

7

BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision

ner nlp bert dataset roberta fine-tuning open-domain pre-trained self-training weak-supervision weakly-supervised distant-supervision named-entity-recognition weakly-supervised-learning natural-language-processing

Created 2020-06-05

42 commits to master branch, last one 3 years ago

MiniRBT iflytek

17

269

apache-2.0

7

MiniRBT (中文小型预训练模型系列)

bert pytorch roberta tensorflow pre-trained-model

Created 2022-11-15

10 commits to main branch, last one about a year ago