89 results found Sort:

RUCAIBox
LLMSurvey RUCAIBox
821
10.5k
unknown
158
The official GitHub page for the survey paper "A Survey of Large Language Models".
llm llms rlhf chatgpt pre-training chain-of-thought instruction-tuning in-context-learning large-language-models natural-language-processing pre-trained-language-models
Created 2023-03-14
139 commits to main branch, last one 3 months ago
modelscope
ms-swift modelscope
379
4.3k
apache-2.0
24
Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...
dpo llm sft lora peft agent liger llama llava qwen2 deploy llama3 internvl megatron qwen2-vl minicpm-v modelscope multimodal reflection pre-training
Created 2023-08-01
1,169 commits to main branch, last one a day ago
dbiir
UER-py dbiir
526
3.0k
apache-2.0
76
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2019-04-10
1,058 commits to master branch, last one 6 months ago
modelscope
data-juicer modelscope
178
3.0k
apache-2.0
19
A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！
gpt llm nlp llms sora gpt-4 llama llava chinese dataset pytorch opendata streamlit multi-modal data-science pre-training data-analysis data-visualization instruction-tuning large-language-models
Created 2023-08-01
245 commits to main branch, last one 6 days ago
ChandlerBang
awesome-self-supervised-gnn ChandlerBang
164
1.6k
unknown
54
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
pretraining graph-mining pre-training deep-learning machine-learning graph-neural-networks self-supervised-learning graph-self-supervised-learning
Created 2020-05-27
259 commits to master branch, last one 9 months ago
EgoAlpha
prompt-in-context-learning EgoAlpha
92
1.5k
mit
37
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
cot llm prompt chatbot chatgpt chatgpt-api pre-training prompt-design prompt-tuning prompt-toolkit prompt-learning chain-of-thought language-modeling prompt-engineering in-context-learning large-language-model prompt-based-learning language-understanding
Created 2023-03-08
706 commits to main branch, last one 4 days ago
LirongWu
awesome-graph-self-supervised-learning LirongWu
168
1.4k
unknown
17
Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"
pre-training pretext-task deep-learning machine-learning data-augmentation transfer-learning graph-neural-networks unsupervised-learning representation-learning self-supervised-learning
Created 2019-05-24
45 commits to main branch, last one 3 months ago
zjunlp
KnowLM zjunlp
125
1.2k
mit
11
An Open-sourced Knowledgable Large Language Model Framework.
lora gpt-3 llama knowlm models chinese english bilingual deepspeed reasoning instructie instructions pre-training deep-learning language-model pre-trained-model instruction-tuning instruction-following large-language-models pre-trained-language-models
Created 2023-04-01
537 commits to main branch, last one 4 months ago
yzhuoning
Awesome-CLIP yzhuoning
55
1.1k
unknown
19
Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
clip pre-training contrastive-learning
Created 2021-09-05
56 commits to main branch, last one about a year ago
microsoft
Oscar microsoft
252
1.0k
mit
25
Oscar and VinVL
vqa oscar vinvl pre-training image-captioning image-text-search vision-and-language
This repository has been archived (exclude archived)
Created 2020-05-14
28 commits to master branch, last one about a year ago
Tencent
TencentPretrain Tencent
142
1.0k
other
21
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2022-09-26
110 commits to main branch, last one 6 months ago
brightmart
bert_language_understanding brightmart
211
959
unknown
49
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 6 years ago
qingsongedu
Awesome-TimeSeries-SpatioTemporal-LM-LLM qingsongedu
69
923
unknown
29
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
rca timeseries autoscaling forecasting deeplearning large-models pre-training machinelearning anomalydetection foundation-models large-language-models
Created 2023-06-10
42 commits to main branch, last one 5 months ago
SalesforceAIResearch
uni2ts SalesforceAIResearch
97
885
apache-2.0
9
Unified Training of Universal Time Series Forecasting Transformers
forecasting time-series pre-training transformers deep-learning machine-learning pre-trained-models universal-forecasting representation-learning time-series-forecasting
Created 2024-02-07
93 commits to main branch, last one 9 days ago
ChenRocks
UNITER ChenRocks
109
784
unknown
18
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
pytorch pre-training transformers vision-and-language
Created 2020-01-28
70 commits to master branch, last one 3 years ago
jackroos
VL-BERT jackroos
110
738
mit
14
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
bert pytorch vl-bert iclr2020 pre-training vision-and-language representation-learning self-supervised-learning
Created 2019-11-22
25 commits to master branch, last one 4 years ago
nancheng58
Awesome-LLM4RS-Papers nancheng58
52
588
unknown
11
Large Language Model-enhanced Recommender System Papers
gpt llm papers survey awesome-list pre-training prompt-tuning recommender-system large-language-models
Created 2023-05-11
140 commits to main branch, last one about a month ago
princeton-nlp
LLM-Shearing princeton-nlp
47
560
mit
23
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
llm nlp llama llama2 pruning efficiency pre-training
Created 2023-10-16
71 commits to main branch, last one 8 months ago
Shen-Lab
GraphCL Shen-Lab
103
557
mit
10
[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen
pre-training contrastive-learning graph-neural-network self-supervised-learning
Created 2020-09-25
117 commits to master branch, last one 4 months ago
acbull
GPT-GNN acbull
87
487
mit
13
Code for KDD'20 "Generative Pre-Training of Graph Neural Networks"
pre-training graph-neural-networks self-supervised-learning graph-representation-learning
Created 2020-06-26
99 commits to master branch, last one 3 months ago
microsoft
XPretrain microsoft
36
471
other
14
Multi-modality pre-training
nlp multimedia pre-training computer-vision multimodal-learning
Created 2022-03-15
104 commits to main branch, last one 6 months ago
GAIR-NLP
MathPile GAIR-NLP
21
394
apache-2.0
7
[NeurlPS D&B 2024] Generative AI for Math: MathPile
math corpus pre-training language-model large-language-models
Created 2023-11-27
33 commits to main branch, last one 24 days ago
linwhitehat
ET-BERT linwhitehat
81
384
mit
4
The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.
pytorch pre-training burst-analysis mask-burst-modeling transformer-architecture encrypted-traffic-analysis same-origin-burst-prediction
Created 2022-02-09
128 commits to main branch, last one 20 days ago
google-research-datasets
conceptual-12m google-research-datasets
21
368
other
13
Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
pre-training multimodal-dataset vision-and-language
Created 2021-03-03
16 commits to main branch, last one about a year ago
GestaltCogTeam
STEP GestaltCogTeam
36
341
apache-2.0
7
Code for our SIGKDD'22 paper Pre-training-Enhanced Spatial-Temporal Graph Neural Network For Multivariate Time Series Forecasting.
pre-training traffic-forecasting graph-neural-networks multivariate-time-series
Created 2022-02-08
71 commits to github branch, last one 11 months ago
THUDM
GCC THUDM
55
324
mit
15
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training @ KDD 2020
pre-training contrastive-learning graph-neural-networks
Created 2020-06-16
242 commits to master branch, last one 3 years ago
sayakpaul
probing-vits sayakpaul
18
316
apache-2.0
10
Probing the representations of Vision Transformers.
vits keras attention tensorflow pre-training transformers explaining-vits self-supervision image-recognition
Created 2022-03-12
36 commits to main branch, last one 2 years ago
westlake-repl
Recommendation-Systems-without-Explicit-ID-Features-A-Literature-Review westlake-repl
25
311
unknown
10
Paper List of Pre-trained Foundation Recommender Models
llm chatgpt gpt4rec llm4rec chatgpt3 multimodal chatgpt4rec pre-training transferable language-model foundation-model transfer-learning llm-recommendation recommender-system large-language-model recommendation-system multimodal-deep-learning multimodalrecommendation cross-domainrecommendation cross-domain-recommendation
Created 2023-06-25
197 commits to main branch, last one 3 months ago
Lupin1998
Awesome-MIM Lupin1998
14
302
apache-2.0
7
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
gpt mae bert awesome-mim awesome-list pre-training deep-learning computer-vision masked-modeling generative-models masked-autoencoder vision-transformer masked-image-modeling representation-learning self-supervised-learning
Created 2022-07-30
76 commits to master branch, last one about a month ago
ZigeW
data_management_LLM ZigeW
29
287
unknown
5
Collection of training data management explorations for large language models
pretraining pre-training instruction-tuning large-language-models natural-language-processing
Created 2023-12-01
36 commits to main branch, last one 3 months ago