83 results found Sort:

RUCAIBox
LLMSurvey RUCAIBox
732
9.4k
unknown
141
The official GitHub page for the survey paper "A Survey of Large Language Models".
llm llms rlhf chatgpt pre-training chain-of-thought instruction-tuning in-context-learning large-language-models natural-language-processing pre-trained-language-models
Created 2023-03-14
138 commits to main branch, last one about a month ago
dbiir
UER-py dbiir
525
2.9k
apache-2.0
75
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2019-04-10
1,058 commits to master branch, last one about a month ago
modelscope
swift modelscope
203
2.1k
apache-2.0
19
ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Phi3-Vision, ...)
awq dpo llm sft glm4 lora peft qwen agent llama llava qwen2 deploy llama3 minicpm unsloth internvl modelscope multimodal pre-training
Created 2023-08-01
667 commits to main branch, last one a day ago
modelscope
data-juicer modelscope
109
1.7k
apache-2.0
14
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！
gpt llm nlp llms sora gpt-4 llama llava chinese dataset pytorch opendata streamlit multi-modal data-science pre-training data-analysis data-visualization instruction-tuning large-language-models
Created 2023-08-01
173 commits to main branch, last one a day ago
ChandlerBang
awesome-self-supervised-gnn ChandlerBang
165
1.5k
unknown
52
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
pretraining graph-mining pre-training deep-learning machine-learning graph-neural-networks self-supervised-learning graph-self-supervised-learning
Created 2020-05-27
259 commits to master branch, last one 4 months ago
EgoAlpha
prompt-in-context-learning EgoAlpha
89
1.4k
mit
35
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
cot llm prompt chatbot chatgpt chatgpt-api pre-training prompt-design prompt-tuning prompt-toolkit prompt-learning chain-of-thought language-modeling prompt-engineering in-context-learning large-language-model prompt-based-learning language-understanding
Created 2023-03-08
680 commits to main branch, last one 6 days ago
LirongWu
awesome-graph-self-supervised-learning LirongWu
162
1.3k
unknown
16
Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"
pre-training pretext-task deep-learning machine-learning data-augmentation transfer-learning graph-neural-networks unsupervised-learning representation-learning self-supervised-learning
Created 2019-05-24
44 commits to main branch, last one 3 months ago
zjunlp
KnowLM zjunlp
117
1.1k
mit
10
An Open-sourced Knowledgable Large Language Model Framework.
lora gpt-3 llama knowlm models chinese english bilingual deepspeed reasoning instructie instructions pre-training deep-learning language-model pre-trained-model instruction-tuning instruction-following large-language-models pre-trained-language-models
Created 2023-04-01
537 commits to main branch, last one a day ago
yzhuoning
Awesome-CLIP yzhuoning
54
1.1k
unknown
20
Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
clip pre-training contrastive-learning
Created 2021-09-05
56 commits to main branch, last one about a year ago
microsoft
Oscar microsoft
247
1.0k
mit
25
Oscar and VinVL
vqa oscar vinvl pre-training image-captioning image-text-search vision-and-language
Created 2020-05-14
28 commits to master branch, last one 10 months ago
Tencent
TencentPretrain Tencent
139
997
other
20
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2022-09-26
110 commits to main branch, last one about a month ago
brightmart
bert_language_understanding brightmart
211
959
unknown
49
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 5 years ago
qingsongedu
Awesome-TimeSeries-SpatioTemporal-LM-LLM qingsongedu
54
816
unknown
27
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
rca timeseries autoscaling forecasting deeplearning large-models pre-training machinelearning anomalydetection foundation-models large-language-models
Created 2023-06-10
42 commits to main branch, last one about a month ago
ChenRocks
UNITER ChenRocks
109
772
unknown
18
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
pytorch pre-training transformers vision-and-language
Created 2020-01-28
70 commits to master branch, last one 2 years ago
jackroos
VL-BERT jackroos
110
736
mit
14
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
bert pytorch vl-bert iclr2020 pre-training vision-and-language representation-learning self-supervised-learning
Created 2019-11-22
25 commits to master branch, last one 3 years ago
SalesforceAIResearch
uni2ts SalesforceAIResearch
49
600
apache-2.0
8
[ICML2024] Unified Training of Universal Time Series Forecasting Transformers
forecasting time-series pre-training transformers deep-learning machine-learning pre-trained-models universal-forecasting representation-learning time-series-forecasting
Created 2024-02-07
76 commits to main branch, last one 2 days ago
Shen-Lab
GraphCL Shen-Lab
103
534
mit
10
[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen
pre-training contrastive-learning graph-neural-network self-supervised-learning
Created 2020-09-25
116 commits to master branch, last one about a year ago
princeton-nlp
LLM-Shearing princeton-nlp
38
485
mit
24
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
llm nlp llama llama2 pruning efficiency pre-training
Created 2023-10-16
71 commits to main branch, last one 3 months ago
acbull
GPT-GNN acbull
89
476
mit
12
Code for KDD'20 "Generative Pre-Training of Graph Neural Networks"
pre-training graph-neural-networks self-supervised-learning graph-representation-learning
Created 2020-06-26
97 commits to master branch, last one about a year ago
nancheng58
Awesome-LLM4RS-Papers nancheng58
39
451
unknown
9
Large Language Model-enhanced Recommender System Papers
gpt llm papers survey awesome-list pre-training prompt-tuning recommender-system large-language-models
Created 2023-05-11
123 commits to main branch, last one 22 days ago
microsoft
XPretrain microsoft
34
451
other
14
Multi-modality pre-training
nlp multimedia pre-training computer-vision multimodal-learning
Created 2022-03-15
104 commits to main branch, last one about a month ago
GAIR-NLP
MathPile GAIR-NLP
19
354
apache-2.0
7
Generative AI for Math: MathPile
math corpus pre-training language-model large-language-models
Created 2023-11-27
30 commits to main branch, last one 3 days ago
google-research-datasets
conceptual-12m google-research-datasets
17
332
other
13
Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
pre-training multimodal-dataset vision-and-language
Created 2021-03-03
16 commits to main branch, last one about a year ago
zezhishao
STEP zezhishao
34
323
apache-2.0
5
Code for our SIGKDD'22 paper Pre-training-Enhanced Spatial-Temporal Graph Neural Network For Multivariate Time Series Forecasting.
pre-training traffic-forecasting graph-neural-networks multivariate-time-series
Created 2022-02-08
71 commits to github branch, last one 6 months ago
THUDM
GCC THUDM
53
322
mit
15
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training @ KDD 2020
pre-training contrastive-learning graph-neural-networks
Created 2020-06-16
242 commits to master branch, last one 3 years ago
sayakpaul
probing-vits sayakpaul
17
304
apache-2.0
10
Probing the representations of Vision Transformers.
vits keras attention tensorflow pre-training transformers explaining-vits self-supervision image-recognition
Created 2022-03-12
36 commits to main branch, last one about a year ago
linwhitehat
ET-BERT linwhitehat
72
302
mit
4
The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.
pytorch pre-training burst-analysis mask-burst-modeling transformer-architecture encrypted-traffic-analysis same-origin-burst-prediction
Created 2022-02-09
124 commits to main branch, last one 5 months ago
showlab
all-in-one showlab
16
274
unknown
6
[CVPR2023] All in One: Exploring Unified Video-Language Pre-training
pytorch codebase pre-training video-language
Created 2022-03-14
29 commits to main branch, last one about a year ago
Lupin1998
Awesome-MIM Lupin1998
14
266
apache-2.0
7
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
gpt mae bert awesome-mim awesome-list pre-training deep-learning computer-vision masked-modeling generative-models masked-autoencoder vision-transformer masked-image-modeling representation-learning self-supervised-learning
Created 2022-07-30
72 commits to master branch, last one about a month ago
mczhuge
Kaleido-BERT mczhuge
19
264
mit
3
💐Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
bert fashion e-commerce multimodal pre-training vision-language
Created 2021-03-05
153 commits to main branch, last one about a year ago