Search Results - RepositoryStats

LoRA microsoft

613

9.6k

mit

64

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

lora gpt-2 gpt-3 deberta pytorch roberta low-rank adaptation deep-learning language-model

Created 2021-06-18

45 commits to main branch, last one 5 months ago

Chinese-BERT-wwm ymcui

1.4k

9.4k

apache-2.0

142

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

nlp rbt bert pytorch roberta bert-wwm tensorflow roberta-wwm bert-wwm-ext chinese-bert

Created 2019-06-19

110 commits to master branch, last one 11 months ago

bertviz jessevig

756

6.5k

apache-2.0

70

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

nlp bert gpt2 pytorch roberta transformer transformers visualization neural-network machine-learning natural-language-processing

Created 2018-12-16

307 commits to master branch, last one 10 months ago

awesome-pretrained-chinese-nlp-models lonePatient

439

4.5k

mit

89

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

gpt llm nlp bert ernie gpt-2 nezha pangu xlnet chinese dataset nlu-nlg roberta simbert multimodel pretrained-models large-language-models

Created 2019-05-25

379 commits to main branch, last one 10 days ago

albert_zh brightmart

758

3.9k

unknown

103

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

bert xlnet albert pytorch roberta tensorflow pre-trained chinese-corpus pre-trained-model

Created 2019-09-26

107 commits to master branch, last one about a year ago

CLUE CLUEbenchmark

541

3.9k

unknown

89

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

nlu bert glue albert corpus chinese dataset pytorch roberta benchmark tensorflow chineseglue transformers language-model pretrained-models

Created 2019-11-22

527 commits to master branch, last one about a month ago

UER-py dbiir

525

2.9k

apache-2.0

75

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Created 2019-04-10

1,058 commits to master branch, last one about a month ago

roberta_zh brightmart

405

2.6k

unknown

52

RoBERTa中文预训练模型: RoBERTa for Chinese

bert gpt2 chinese roberta pre-trained pre-trained-language-models

Created 2019-09-02

41 commits to master branch, last one 2 years ago

rust-bert guillaume-be

207

2.5k

apache-2.0

39

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

gpt ner nlp bart bert rust gpt-2 electra roberta rust-lang transformer translation deep-learning machine-learning question-answering sentiment-analysis language-generation

Created 2020-01-25

1,108 commits to main branch, last one 6 days ago

news-please fhamborg

412

2.0k

apache-2.0

52

news-please - an integrated web crawler and information extractor for news that just works

Created 2016-12-18

736 commits to master branch, last one 3 days ago

DeBERTa microsoft

215

1.9k

mit

42

The implementation of DeBERTa

bert roberta deeplearning language-model self-attention transformer-encoder representation-learning natural-language-understanding

Created 2020-06-08

55 commits to master branch, last one about a year ago

FARM deepset-ai

245

1.7k

apache-2.0

54

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

ner nlp bert pytorch roberta germanbert nlp-library deep-learning nlp-framework xlnet-pytorch language-models pretrained-models transfer-learning question-answering

Created 2019-07-17

594 commits to master branch, last one about a year ago

TurboTransformers Tencent

194

1.4k

other

41

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

gpu nlp bert gpt2 albert decoder pytorch roberta inference transformer machine-translation huggingface-transformers

Created 2020-04-20

870 commits to master branch, last one 2 years ago

CLUENER2020 CLUEbenchmark

299

1.4k

unknown

20

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

ner bert albert chinese dataset roberta seq2seq chinesener chinese-ner fine-grained-ner sequence-labeling sequence-to-sequence named-entity-recognition

Created 2020-01-05

69 commits to master branch, last one about a year ago

bert_seq2seq 920232796

207

1.3k

apache-2.0

13

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

crf ner bert gpt2 unilm pytorch roberta seq2seq t5-model autotitle text-classification

Created 2020-03-13

230 commits to master branch, last one 2 years ago

TencentPretrain Tencent

139

998

other

20

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Created 2022-09-26

110 commits to main branch, last one about a month ago

CLUECorpus2020 CLUEbenchmark

80

894

mit

21

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

nlp bert albert corpus chinese roberta datasets pretrain chinese-corpus

Created 2020-01-25

25 commits to master branch, last one about a year ago

gector grammarly

214

875

apache-2.0

21

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

nlp bert xlnet roberta transformers sequence-labeling text-simplification natural-language-processing grammatical-error-correction

Created 2020-05-21

52 commits to master branch, last one about a year ago

curated-transformers explosion

33

852

mit

14

🤖 A PyTorch library of curated Transformer models and their composable components

llm nlp bert llms llama albert dolly2 falcon gptneox pytorch roberta camembert transformer xlm-roberta transformers

Created 2022-09-14

390 commits to main branch, last one 2 months ago

texar-pytorch asyml

118

744

apache-2.0

24

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

bert gpt-2 texar xlnet python pytorch roberta text-data casl-project deep-learning texar-pytorch dialog-systems data-processing text-generation machine-learning machine-translation natural-language-processing

Created 2019-03-08

496 commits to master branch, last one 2 years ago

PromptCLUE clue-ai

68

644

other

9

PromptCLUE, 全中文任务支持零样本学习模型

bert gpt-3 chinese roberta t5-model prompt-tuning few-shot-learning pretrained-models transfer-learning multitask-learning zero-shot-learning

Created 2022-09-29

84 commits to main branch, last one about a year ago

PhoBERT VinAIResearch

92

635

mit

22

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Created 2020-03-03

44 commits to master branch, last one 4 months ago

japanese-pretrained-models rinnakk

41

571

apache-2.0

14

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

nlp gpt2 roberta japanese

Created 2021-04-06

21 commits to master branch, last one about a year ago

BERTweet VinAIResearch

52

565

mit

12

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

ner bert covid covid19 english fairseq python3 roberta bertweet covid-19 transformers english-tweets language-model irony-detection bertweet-covid19 sentiment-analysis text-classification part-of-speech-tagging named-entity-recognition

Created 2020-05-06

37 commits to master branch, last one 6 months ago

KLUE KLUE-benchmark

54

550

cc-by-sa-4.0

20

📖 Korean NLU Benchmark

bert korean roberta benchmark korean-nlp

Created 2020-11-16

33 commits to main branch, last one 2 years ago

happy-transformer EricFillion

67

513

apache-2.0

7

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

ai nlp bert python roberta transformers deep-learning language-models machine-learning question-answering text-classification artificial-intelligence natural-language-processing

Created 2019-10-06

1,216 commits to master branch, last one 3 months ago

CLUENER2020 hemingkx

107

462

unknown

5

A PyTorch implementation of a BiLSTM\BERT\Roberta(+CRF) model for Named Entity Recognition.

ner bert pytorch roberta bert-crf bilstm-crf named-entity-recognition

Created 2020-11-13

59 commits to main branch, last one 3 years ago

TransformerSum HHousen

59

424

gpl-3.0

6

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

bert albert roberta distilbert summarization machine-learning pytorch-lightning text-summarization transformer-models summarization-dataset automatic-summarization extractive-summarization

Created 2020-04-07

240 commits to master branch, last one about a year ago

BOND cliang1453

34

289

apache-2.0

7

BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision

ner nlp bert dataset roberta fine-tuning open-domain pre-trained self-training weak-supervision weakly-supervised distant-supervision named-entity-recognition weakly-supervised-learning natural-language-processing

Created 2020-06-05

42 commits to master branch, last one 3 years ago

mint dpressel

15

245

unknown

8

MinT: Minimal Transformer Library and Tutorials

t5 gpt opt bart bert gpt2 pytorch roberta tutorials transformer transformers transformer-models sentence-transformers

Created 2022-03-23

44 commits to main branch, last one 2 years ago