108 results found Sort:

salesforce
LAVIS salesforce
979
10.1k
bsd-3-clause
97
LAVIS - A One-stop Library for Language-Vision Intelligence
salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer
Created 2022-08-24
492 commits to main branch, last one about a month ago
Yutong-Zhou-cv
Awesome-Text-to-Image Yutong-Zhou-cv
192
2.2k
mit
76
(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.
survey multimodal awseome-list text-to-face text-to-image image-synthesis image-generation image-manipulation multimodal-deep-learning generative-adversarial-network
Created 2020-10-13
610 commits to 2024-Version-2.0 branch, last one about a month ago
AI4Finance-Foundation
FinRobot AI4Finance-Foundation
285
1.8k
apache-2.0
33
FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀
fingpt aiagent chatgpt finance robo-advisor prompt-engineering large-language-models multimodal-deep-learning
Created 2024-02-27
269 commits to master branch, last one about a month ago
kyegomez
BitNet kyegomez
156
1.7k
mit
42
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
gpt4 multimodal deeplearning machine-learning deep-neural-networks artificial-intelligence multimodal-deep-learning
Created 2023-10-18
172 commits to main branch, last one 5 months ago
KimMeen
Time-LLM KimMeen
270
1.6k
apache-2.0
17
[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
time-series deep-learning prompt-tuning cross-modality language-model machine-learning cross-modal-learning time-series-analysis time-series-forecast large-language-models multimodal-time-series time-series-forecasting multimodal-deep-learning
Created 2024-01-20
39 commits to main branch, last one about a month ago
AlibabaResearch
AdvancedLiterateMachinery AlibabaResearch
180
1.6k
apache-2.0
37
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
ocr document documentai multimodal end-to-end-ocr text-detection computer-vision vision-language text-recognition document-analysis document-recognition scene-text-detection document-intelligence vision-language-model document-understanding scene-text-recognition artificial-intelligence multimodal-deep-learning vision-language-transformer scene-text-detection-recognition
Created 2022-09-28
64 commits to main branch, last one 5 days ago
jrzaurin
pytorch-widedeep jrzaurin
191
1.3k
apache-2.0
25
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
text images python pytorch model-hub pytorch-cv pytorch-nlp tabular-data deep-learning pytorch-tabular-data pytorch-transformers multimodal-deep-learning
Created 2017-10-21
940 commits to master branch, last one about a month ago
DWCTOD
CVPR2024-Papers-with-Code-Demo DWCTOD
146
1.3k
apache-2.0
27
收集 CVPR 最新的成果，包括论文、代码和demo视频等，欢迎大家推荐！Collect the latest CVPR (Conference on Computer Vision and Pattern Recognition) results, including papers, code, and demo videos, etc., and welcome recommendations...
llm cvpr cvpr2021 cvpr2022 cvpr2023 cvpr2024 segmentation computer-vision object-detection segment-anything multimodal-deep-learning
Created 2021-03-13
19 commits to main branch, last one 8 months ago
yuewang-cuhk
awesome-vision-language-pretraining-papers yuewang-cuhk
104
1.1k
unknown
52
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
bert vl-ptms pretraining vision-and-language multimodal-deep-learning
Created 2020-03-25
38 commits to master branch, last one 3 years ago
TheShadow29
awesome-grounding TheShadow29
98
1.0k
mit
29
awesome grounding: A curated list of research papers in visual grounding
arxiv paper papers grounding awesome-list paper-roadmap embodied-agent computer-vision image-grounding video-grounding phrase-grounding visual-grounding captioning-images captioning-videos language-grounding video-understanding multimodal-deep-learning natural-language-processing
Created 2018-09-03
97 commits to master branch, last one about a year ago
declare-lab
multimodal-deep-learning declare-lab
156
775
mit
7
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
multimodal-learning multimodal-interactions multimodal-deep-learning multimodal-sentiment-analysis
Created 2021-08-28
95 commits to main branch, last one 2 years ago
richard-peng-xia
awesome-multimodal-in-medical-imaging richard-peng-xia
61
604
mit
18
A collection of resources on applications of multi-modal learning in medical imaging.
medical-imaging multimodal-learning large-language-models large-multimodal-models multimodal-deep-learning medical-report-generation visual-question-answering multimodal-large-language-models
Created 2022-07-13
151 commits to main branch, last one about a month ago
omriav
blended-latent-diffusion omriav
36
581
mit
48
Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
pytorch diffusion multimodal deep-learning text-to-image computer-vision diffusion-models generative-model image-generation text-driven-editing text-to-image-synthesis multimodal-deep-learning text-guided-manipulation
Created 2022-06-06
10 commits to master branch, last one 6 months ago
jianghaojun
Awesome-Parameter-Efficient-Transfer-Learning jianghaojun
25
392
mit
21
A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
deep-learning computer-vision machine-learning transfer-learning multimodal-deep-learning parameter-efficient-tuning parameter-efficient-learning
Created 2022-12-22
66 commits to main branch, last one 2 months ago
MMMU-Benchmark
MMMU MMMU-Benchmark
29
370
apache-2.0
4
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
llm llms stem evaluation multimodal deep-learning multimodality computer-vision machine-learning foundation-models question-answering multimodal-learning deep-neural-networks large-language-models large-multimodal-models multimodal-deep-learning visual-question-answering natural-language-processing
Created 2023-11-23
131 commits to main branch, last one 11 days ago
theislab
scarches theislab
52
343
bsd-3-clause
12
Reference mapping for single-cell genomics
scrna-seq multiomics single-cell deep-learning batch-correction data-integration human-cell-atlas rna-seq-analysis single-cell-genomics multimodal-deep-learning
Created 2019-08-12
1,175 commits to master branch, last one 6 months ago
kyegomez
Med-PaLM kyegomez
49
336
mit
8
Towards Generalist Biomedical AI
gpt4 biomedical multimodal opensource deep-learning multimodality multimodal-deep-learning
Created 2023-07-31
118 commits to main branch, last one 10 months ago
fcakyon
content-moderation-deep-learning fcakyon
18
321
mit
5
Deep learning based content moderation from text, audio, video & image input modalities.
movie-trailer content-ratings nsfw-recognition nudity-detection content-moderation violence-detection profanity-detection genre-classification movie-content-filter multimodal-deep-learning
Created 2022-09-22
47 commits to main branch, last one 5 days ago
soujanyaporia
MUStARD soujanyaporia
61
321
mit
8
Multimodal Sarcasm Detection Dataset
sarcasm sarcasm-detection multimodal-interactions multimodal-deep-learning
Created 2019-02-20
82 commits to master branch, last one 4 months ago
westlake-repl
Recommendation-Systems-without-Explicit-ID-Features-A-Literature-Review westlake-repl
27
321
unknown
10
Paper List of Pre-trained Foundation Recommender Models
llm chatgpt gpt4rec llm4rec chatgpt3 multimodal chatgpt4rec pre-training transferable language-model foundation-model transfer-learning llm-recommendation recommender-system large-language-model recommendation-system multimodal-deep-learning multimodalrecommendation cross-domainrecommendation cross-domain-recommendation
Created 2023-06-25
197 commits to main branch, last one 4 months ago
Yutong-Zhou-cv
Awesome-Multimodality Yutong-Zhou-cv
22
320
unknown
12
A Survey on multimodal learning research.
awesome-list multimodality multimodal-deep-learning
Created 2021-09-20
79 commits to main branch, last one about a year ago
sail-sg
CLoT sail-sg
15
301
unknown
8
CVPR'24, Official Codebase of our Paper: "Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation".
association leap-of-thought humor-generation large-language-models multimodal-deep-learning
Created 2023-12-01
33 commits to main branch, last one 8 months ago
phellonchen
awesome-Vision-and-Language-Pre-training phellonchen
15
289
apache-2.0
11
Recent Advances in Vision and Language Pre-training (VLP)
vlp pretraining vision-and-language multimodal-deep-learning vision-and-language-pre-training
Created 2021-09-14
56 commits to main branch, last one about a year ago
DWCTOD
ECCV2022-Papers-with-Code-Demo DWCTOD
23
287
unknown
7
收集 ECCV 最新的成果，包括论文、代码和demo视频等，欢迎大家推荐！
ai cv eccv nerf dataset eccv2022 diffusion computer-vision face-recognition image-segmentation vision-transformer objection-detection multimodal-deep-learning
Created 2022-07-04
48 commits to main branch, last one 2 years ago
ilaria-manco
multimodal-ml-music ilaria-manco
12
285
mit
14
List of academic resources on Multimodal ML for Music
music-ai resources awesome-list music-research multimodal-data multimodal-learning academic-publications multimodal-deep-learning music-information-retrieval
Created 2022-12-29
11 commits to main branch, last one about a year ago
yuanze-lin
Learnable_Regions yuanze-lin
22
271
mit
10
[CVPR 2024] Official code for "Text-Driven Image Editing via Learnable Regions"
aigc text-image diffusion-model diffusion-models generative-model text-driven-editing multimodal-deep-learning text-driven-manipulation text-driven-image-editing text-driven-image-manipulation
Created 2023-11-28
130 commits to main branch, last one 2 months ago
MILVLG
prophet MILVLG
27
270
apache-2.0
3
Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
gpt-3 okvqa a-okvqa pytorch prompt-engineering multimodal-deep-learning visual-question-answering
Created 2023-01-09
63 commits to main branch, last one about a year ago
david-yoon
multimodal-speech-emotion david-yoon
70
268
mit
10
TensorFlow implementation of "Multimodal Speech Emotion Recognition using Audio and Text," IEEE SLT-18
paralinguistics multimodal-deep-learning speech-emotion-recognition
Created 2019-01-13
49 commits to master branch, last one 9 months ago
declare-lab
awesome-emotion-recognition-in-conversations declare-lab
43
264
unknown
25
A comprehensive reading list for Emotion Recognition in Conversations
dialogue-systems conversational-ai emotion-recognition multimodal-interactions multimodal-deep-learning natural-language-processing emotion-recognition-in-conversation
Created 2020-07-05
44 commits to master branch, last one 10 months ago
YuanGongND
cav-mae YuanGongND
23
244
bsd-2-clause
5
Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
audio multimodal computer-vision audio-processing multimodal-deep-learning
Created 2023-03-20
44 commits to master branch, last one about a year ago