Search Results - RepositoryStats

YAYI2 wenge-research

15

3.6k

apache-2.0

7

YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)

gpt chat yayi chinese artificial-intelligence pretrained-language-model natural-language-generation

Created 2023-12-15

33 commits to main branch, last one about a month ago

torchscale microsoft

198

2.9k

mit

46

Foundation Architecture for (M)LLMs

multimodal transformer translation computer-vision machine-learning speech-processing pretrained-language-model natural-language-processing

Created 2022-11-17

123 commits to main branch, last one about a month ago

awesome-sentence-embedding Separius

259

2.2k

gpl-3.0

77

A curated list of pretrained sentence and word embedding models

nlp bert awesome awesome-list cross-lingual wordembedding language-model subword-models word-embeddings embedding-models natural-language pretrained-models sentence-embeddings pretrained-embedding unsupervised-learning sentence-representations pretrained-language-model contextualized-representation

This repository has been archived (exclude archived)

Created 2018-12-10

200 commits to master branch, last one 3 years ago

P-tuning-v2 THUDM

189

1.9k

apache-2.0

30

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

p-tuning prompt-tuning pretrained-language-model natural-language-processing parameter-efficient-learning

Created 2021-10-14

37 commits to main branch, last one 7 months ago

Summarization-Papers xcfcode

143

975

unknown

23

Summarization Papers

nlp chatgpt summarization text-generation pretrained-language-model natural-language-processing

This repository has been archived (exclude archived)

Created 2020-10-14

457 commits to main branch, last one 10 months ago

OpenDelta thunlp

76

948

apache-2.0

17

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

nlp nlp-library deep-learning pretrained-language-model parameter-efficient-learning

Created 2022-02-14

158 commits to main branch, last one 9 months ago

lawyer-llama AndrewZhe

99

782

apache-2.0

11

中文法律LLaMA (LLaMA for Chinese legel domain)

llm nlp plm llama alpaca legal-ai pretrained-models large-language-models pretrained-language-model

Created 2023-04-12

39 commits to main branch, last one about a month ago

dont-stop-pretraining allenai

72

521

unknown

9

Code associated with the Don't Stop Pretraining ACL 2020 paper

pretrained-language-model natural-language-processing

Created 2020-04-09

61 commits to master branch, last one 2 years ago

CPM-Live OpenBMB

40

509

unknown

21

Live Training for Open-source Big Models

nlp deep-learning multi-task-learning pretrained-language-model natural-language-generation natural-language-processing parameter-efficient-learning natural-language-understanding

Created 2022-05-21

525 commits to master branch, last one about a year ago

NLP-Projects gaoisbest

149

504

unknown

22

word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, informati...

word2vec sentence2vec knowledge-graph text-generation dialogue-systems network-embedding sequence-labeling text-classification information-retrieval information-extraction pretrained-language-model machine-reading-comprehension

Created 2017-07-10

641 commits to master branch, last one 3 years ago

awesome-instruction-learning RenzeLou

21

413

mit

7

Papers and Datasets on Instruction Tuning and Following. ✨✨✨

prompt survey datasets paper-list instruction awesome-list instruction-tuning in-context-learning instruction-learning large-language-models pretrained-language-model

Created 2023-02-21

190 commits to main branch, last one about a month ago

Diffusion-BERT Hzfinfdu

21

276

apache-2.0

13

ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

bert text-generation diffusion-models conditional-generation unconditional-generation pretrained-language-model

Created 2022-11-29

13 commits to main branch, last one about a year ago

MWPToolkit LYH-YF

36

157

mit

3

MWPToolkit is an open-source framework for math word problem(MWP) solvers.

pytorch deep-learning graph-to-tree sequence-to-tree math-word-problem sequence-to-sequence pretrained-language-model

Created 2021-01-26

564 commits to master branch, last one about a year ago

ATPapers ZhengZixiang

13

129

unknown

7

Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合

bert awesome transformer attention-mechanism pretrained-language-model

Created 2019-11-02

96 commits to master branch, last one 3 years ago

AttrPrompt yueyu1030

9

121

apache-2.0

3

[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.

attributed-text data-centric-ai zero-shot-learning text-classification large-language-models training-data-generation pretrained-language-model natural-language-processing

Created 2023-05-31

26 commits to main branch, last one 7 months ago

COCO-LM microsoft

12

120

mit

5

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

pretraining transformers deep-learning language-model contrastive-learning representation-learning pretrained-language-model natural-language-processing natural-language-understanding

Created 2021-10-21

33 commits to main branch, last one about a year ago

awesome-refreshing-llms hyintell

8

115

mit

5

EMNLP'23 survey: a curation of awesome papers and resources on refreshing large language models (LLMs) without expensive retraining.

llm nlp llms paper review survey refreshing update-llm awesome-list knowledge-editing continual-learning large-language-models pretrained-language-model natural-language-processing retrieval-augmented-generation

Created 2023-10-08

14 commits to main branch, last one 5 months ago

BERT4ETH git-disl

14

93

unknown

7

BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)

bert www2023 ethereum blockchain transformer deanonymization fraud-detection phishing-detection pretrained-language-model

Created 2023-02-05

70 commits to master branch, last one 6 months ago

Prompt-Transferability thunlp

11

89

mit

7

On Transferability of Prompt Tuning for Natural Language Processing

nlp prompt pytorch prompt-tuning pretrained-models transfer-learning pretrained-language-model parameter-efficient-tuning pretrained-language-models parameter-efficient-learning

Created 2021-05-29

689 commits to main branch, last one 28 days ago

Bamboo SJTU-IPADS

2

85

apache-2.0

10

Bamboo-7B Large Language Model

llm powerinfer sparse-llm pretrained-models large-language-models pretrained-language-model

Created 2024-03-25

35 commits to main branch, last one 2 months ago

TopClus yumeng5

8

81

apache-2.0

2

[WWW 2022] Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations

clustering language-model topic-modeling topic-discovery pretrained-language-model

Created 2022-01-29

9 commits to main branch, last one 2 years ago

CODER GanjinZero

5

68

unknown

2

CODER: Knowledge infused cross-lingual medical term embedding for term normalization. [JBI, ACL-BioNLP 2022]

nlp umls medical embeddings multi-language pretrained-language-model

Created 2020-08-12

32 commits to master branch, last one about a year ago

SuperGen yumeng5

13

59

apache-2.0

2

[NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding

text-generation zero-shot-learning text-classification pretrained-language-model natural-language-processing natural-language-understanding

Created 2022-02-10

15 commits to main branch, last one about a year ago

PoincareProbe FranxYao

5

54

unknown

6

Implementation of ICLR 21 paper: Probing BERT in Hyperbolic Spaces

bert probing bertology bert-model hyperbolic probing-tasks bert-embeddings hyperbolic-geometry hyperbolic-embeddings pretrained-language-model

Created 2021-03-17

12 commits to main branch, last one 3 years ago

Dialog-KoELECTRA SKplanet

6

53

apache-2.0

8

ELECTRA기반 한국어 대화체 언어모델

dialog electra-models korean-language pretrained-language-model

Created 2021-04-13

40 commits to master branch, last one 2 years ago

BioBART GanjinZero

4

50

unknown

3

BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model [ACL-BioNLP 2022]

biomedical generative pretrained-language-model

Created 2022-03-02

25 commits to main branch, last one about a year ago

Scientific-Inspiration-Machines-Optimized-for-Novelty EagleW

9

49

apache-2.0

2

Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty

llm gpt4 acl2024 pytorch text-generation hypothesis-generation pretrained-language-model retrieval-augmented-generation

Created 2023-05-17

21 commits to main branch, last one about a month ago

COCO-DR OpenMatch

4

46

mit

4

[EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning".

nlp bert zero-shot transformer dense-retrieval distributionally zero-shot-retrieval contrastive-learning information-retrieval distributionally-robust pretrained-language-model

Created 2022-10-26

30 commits to main branch, last one 7 months ago

TransPolymer ChangwenXu98

16

46

mit

2

Implementation of "TransPolymer: a Transformer-based language model for polymer property predictions" in PyTorch

polymer pytorch transformer deep-learning self-supervised-learning pretrained-language-model

Created 2022-08-31

40 commits to master branch, last one 11 months ago

NLP2SPARQL heraclex12

12

43

unknown

4

Translate Natural Language Processing to SPARQL Query and vice versa

sparql spbert bert2bert knowledge-base question-answering machine-translation pretrained-language-model

Created 2020-10-27

61 commits to main branch, last one about a year ago