93 results found Sort:

RUCAIBox
LLMSurvey RUCAIBox
877
11.3k
unknown
162
The official GitHub page for the survey paper "A Survey of Large Language Models".
llm llms rlhf chatgpt pre-training chain-of-thought instruction-tuning in-context-learning large-language-models natural-language-processing pre-trained-language-models
Created 2023-03-14
163 commits to main branch, last one 19 days ago
modelscope
data-juicer modelscope
224
4.1k
apache-2.0
20
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
gpt llm nlp llms gpt-4 llama llava chinese dataset pytorch opendata streamlit multi-modal data-science pre-training data-analysis synthetic-data data-visualization instruction-tuning large-language-models
Created 2023-08-01
339 commits to main branch, last one 2 days ago
dbiir
UER-py dbiir
524
3.0k
apache-2.0
74
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2019-04-10
1,058 commits to master branch, last one 10 months ago
ChandlerBang
awesome-self-supervised-gnn ChandlerBang
161
1.7k
unknown
54
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
pretraining graph-mining pre-training deep-learning machine-learning graph-neural-networks self-supervised-learning graph-self-supervised-learning
Created 2020-05-27
259 commits to master branch, last one about a year ago
EgoAlpha
prompt-in-context-learning EgoAlpha
95
1.6k
mit
36
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
cot llm prompt chatbot chatgpt chatgpt-api pre-training prompt-design prompt-tuning prompt-toolkit prompt-learning chain-of-thought language-modeling prompt-engineering in-context-learning large-language-model prompt-based-learning language-understanding
Created 2023-03-08
708 commits to main branch, last one 3 months ago
LirongWu
awesome-graph-self-supervised-learning LirongWu
167
1.4k
unknown
18
Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"
pre-training pretext-task deep-learning machine-learning data-augmentation transfer-learning graph-neural-networks unsupervised-learning representation-learning self-supervised-learning
Created 2019-05-24
45 commits to main branch, last one 7 months ago
zjunlp
KnowLM zjunlp
132
1.3k
mit
11
An Open-sourced Knowledgable Large Language Model Framework.
lora gpt-3 llama knowlm models chinese english bilingual deepspeed reasoning instructie instructions pre-training deep-learning language-model pre-trained-model instruction-tuning instruction-following large-language-models pre-trained-language-models
Created 2023-04-01
540 commits to main branch, last one 2 months ago
yzhuoning
Awesome-CLIP yzhuoning
57
1.2k
unknown
19
Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
clip pre-training contrastive-learning
Created 2021-09-05
56 commits to main branch, last one 2 years ago
SalesforceAIResearch
uni2ts SalesforceAIResearch
123
1.1k
apache-2.0
8
Unified Training of Universal Time Series Forecasting Transformers
forecasting time-series pre-training transformers deep-learning machine-learning pre-trained-models universal-forecasting representation-learning time-series-forecasting
Created 2024-02-07
102 commits to main branch, last one 3 days ago
Tencent
TencentPretrain Tencent
147
1.1k
other
20
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
t5 gpt ner bart bert clue elmo gpt-2 unilm albert chinese pegasus pytorch roberta model-zoo fine-tuning xlm-roberta pre-training classification natural-language-processing
Created 2022-09-26
110 commits to main branch, last one 11 months ago
microsoft
Oscar microsoft
252
1.0k
mit
25
Oscar and VinVL
vqa oscar vinvl pre-training image-captioning image-text-search vision-and-language
This repository has been archived (exclude archived)
Created 2020-05-14
28 commits to master branch, last one about a year ago
qingsongedu
Awesome-TimeSeries-SpatioTemporal-LM-LLM qingsongedu
77
1.0k
unknown
31
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
rca timeseries autoscaling forecasting deeplearning large-models pre-training machinelearning anomalydetection foundation-models large-language-models
Created 2023-06-10
44 commits to main branch, last one 3 months ago
brightmart
bert_language_understanding brightmart
211
962
unknown
47
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 6 years ago
ChenRocks
UNITER ChenRocks
111
792
unknown
17
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
pytorch pre-training transformers vision-and-language
Created 2020-01-28
70 commits to master branch, last one 3 years ago
jackroos
VL-BERT jackroos
111
740
mit
14
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
bert pytorch vl-bert iclr2020 pre-training vision-and-language representation-learning self-supervised-learning
Created 2019-11-22
25 commits to master branch, last one 4 years ago
nancheng58
Awesome-LLM4RS-Papers nancheng58
52
657
unknown
10
Large Language Model-enhanced Recommender System Papers
gpt llm papers survey awesome-list pre-training prompt-tuning recommender-system large-language-models
Created 2023-05-11
141 commits to main branch, last one about a month ago
cxcscmu
Craw4LLM cxcscmu
53
601
mit
4
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
llm crawler crawling pretraining web-crawler pre-training web-crawling large-language-models
Created 2025-02-17
8 commits to main branch, last one about a month ago
princeton-nlp
LLM-Shearing princeton-nlp
51
598
mit
23
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
llm nlp llama llama2 pruning efficiency pre-training
Created 2023-10-16
71 commits to main branch, last one about a year ago
Shen-Lab
GraphCL Shen-Lab
106
583
mit
10
[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen
pre-training contrastive-learning graph-neural-network self-supervised-learning
Created 2020-09-25
117 commits to master branch, last one 8 months ago
acbull
GPT-GNN acbull
89
492
mit
11
Code for KDD'20 "Generative Pre-Training of Graph Neural Networks"
pre-training graph-neural-networks self-supervised-learning graph-representation-learning
Created 2020-06-26
99 commits to master branch, last one 8 months ago
microsoft
XPretrain microsoft
37
489
other
12
Multi-modality pre-training
nlp multimedia pre-training computer-vision multimodal-learning
Created 2022-03-15
104 commits to main branch, last one 10 months ago
linwhitehat
ET-BERT linwhitehat
92
454
mit
5
The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.
pytorch pre-training burst-analysis mask-burst-modeling transformer-architecture encrypted-traffic-analysis same-origin-burst-prediction
Created 2022-02-09
152 commits to main branch, last one 4 days ago
GAIR-NLP
MathPile GAIR-NLP
22
409
apache-2.0
7
[NeurlPS D&B 2024] Generative AI for Math: MathPile
math corpus pre-training language-model large-language-models
Created 2023-11-27
34 commits to main branch, last one 2 days ago
GestaltCogTeam
STEP GestaltCogTeam
41
408
apache-2.0
6
Code for our SIGKDD'22 paper Pre-training-Enhanced Spatial-Temporal Graph Neural Network For Multivariate Time Series Forecasting.
pre-training traffic-forecasting graph-neural-networks multivariate-time-series
Created 2022-02-08
71 commits to github branch, last one about a year ago
google-research-datasets
conceptual-12m google-research-datasets
20
384
other
12
Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
pre-training multimodal-dataset vision-and-language
Created 2021-03-03
16 commits to main branch, last one 2 years ago
westlake-repl
Recommendation-Systems-without-Explicit-ID-Features-A-Literature-Review westlake-repl
27
345
unknown
11
Paper List of Pre-trained Foundation Recommender Models
llm chatgpt gpt4rec llm4rec chatgpt3 multimodal chatgpt4rec pre-training transferable language-model foundation-model transfer-learning llm-recommendation recommender-system large-language-model recommendation-system multimodal-deep-learning multimodalrecommendation cross-domainrecommendation cross-domain-recommendation
Created 2023-06-25
197 commits to main branch, last one 7 months ago
THUDM
GCC THUDM
54
326
mit
12
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training @ KDD 2020
pre-training contrastive-learning graph-neural-networks
Created 2020-06-16
242 commits to master branch, last one 4 years ago
Lupin1998
Awesome-MIM Lupin1998
17
324
apache-2.0
7
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
gpt mae bert awesome-mim awesome-list pre-training deep-learning computer-vision masked-modeling generative-models masked-autoencoder vision-transformer masked-image-modeling representation-learning self-supervised-learning
Created 2022-07-30
76 commits to master branch, last one 5 months ago
sayakpaul
probing-vits sayakpaul
20
321
apache-2.0
9
Probing the representations of Vision Transformers.
vits keras attention tensorflow pre-training transformers explaining-vits self-supervision image-recognition
Created 2022-03-12
36 commits to main branch, last one 2 years ago
ViTAE-Transformer
SAMRS ViTAE-Transformer
14
320
unknown
3
The official repo for [NeurIPS'23] "SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Model"
sam dataset pre-training deep-learning remote-sensing transfer-learning semantic-segmentation segment-anything-model
Created 2023-05-03
77 commits to main branch, last one 7 months ago