Search Results - RepositoryStats

903

9.1k

bsd-3-clause

96

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce deep-learning image-captioning vision-framework multimodal-datasets vision-and-language deep-learning-library multimodal-deep-learning visual-question-anwsering vision-language-pretraining vision-language-transformer

Created 2022-08-24

490 commits to main branch, last one 6 months ago

Awesome-Text-to-Image Yutong-Zhou-cv

181

2.0k

mit

71

(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.

survey multimodal awseome-list text-to-face text-to-image image-synthesis image-generation image-manipulation multimodal-deep-learning generative-adversarial-network

Created 2020-10-13

588 commits to 2024-Version-2.0 branch, last one a day ago

BitNet kyegomez

133

1.4k

mit

39

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

gpt4 multimodal deeplearning machine-learning deep-neural-networks artificial-intelligence multimodal-deep-learning

Created 2023-10-18

170 commits to main branch, last one 7 days ago

pytorch-widedeep jrzaurin

186

1.3k

apache-2.0

25

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch

text images python pytorch model-hub pytorch-cv pytorch-nlp tabular-data deep-learning pytorch-tabular-data pytorch-transformers multimodal-deep-learning

Created 2017-10-21

855 commits to master branch, last one 10 days ago

CVPR2024-Papers-with-Code-Demo DWCTOD

142

1.2k

apache-2.0

26

收集 CVPR 最新的成果，包括论文、代码和demo视频等，欢迎大家推荐！Collect the latest CVPR (Conference on Computer Vision and Pattern Recognition) results, including papers, code, and demo videos, etc., and welcome recommendations...

llm cvpr cvpr2021 cvpr2022 cvpr2023 cvpr2024 segmentation computer-vision object-detection segment-anything multimodal-deep-learning

Created 2021-03-13

19 commits to main branch, last one 2 months ago

awesome-vision-language-pretraining-papers yuewang-cuhk

101

1.1k

unknown

52

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

bert vl-ptms pretraining vision-and-language multimodal-deep-learning

Created 2020-03-25

38 commits to master branch, last one 2 years ago

AdvancedLiterateMachinery AlibabaResearch

141

1.1k

apache-2.0

28

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

Created 2022-09-28

54 commits to main branch, last one 2 months ago

FinRobot AI4Finance-Foundation

137

1.1k

apache-2.0

18

FinRobot: An Open-Source AI Agent Platform for Financial Applications using LLMs 🚀 🚀 🚀

fingpt aiagent chatgpt finance robo-advisor prompt-engineering large-language-models multimodal-deep-learning

Created 2024-02-27

172 commits to master branch, last one 2 days ago

awesome-grounding TheShadow29

95

984

mit

28

awesome grounding: A curated list of research papers in visual grounding

arxiv paper papers grounding awesome-list paper-roadmap embodied-agent computer-vision image-grounding video-grounding phrase-grounding visual-grounding captioning-images captioning-videos language-grounding video-understanding multimodal-deep-learning natural-language-processing

Created 2018-09-03

97 commits to master branch, last one about a year ago

Time-LLM KimMeen

164

980

apache-2.0

13

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

time-series deep-learning prompt-tuning cross-modality language-model machine-learning cross-modal-learning time-series-analysis time-series-forecast large-language-models multimodal-time-series time-series-forecasting multimodal-deep-learning

Created 2024-01-20

36 commits to main branch, last one 12 days ago

multimodal-deep-learning declare-lab

142

682

mit

5

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-learning multimodal-interactions multimodal-deep-learning multimodal-sentiment-analysis

Created 2021-08-28

95 commits to main branch, last one 2 years ago

blended-latent-diffusion omriav

32

538

mit

49

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

pytorch diffusion multimodal deep-learning text-to-image computer-vision diffusion-models generative-model image-generation text-driven-editing text-to-image-synthesis multimodal-deep-learning text-guided-manipulation

Created 2022-06-06

10 commits to master branch, last one 22 days ago

awesome-multimodal-in-medical-imaging richard-peng-xia

38

374

mit

14

A collection of resources on applications of multi-modal learning in medical imaging.

medical-imaging multimodal-learning large-language-models large-multimodal-models multimodal-deep-learning medical-report-generation visual-question-answering multimodal-large-language-models

Created 2022-07-13

130 commits to main branch, last one 4 days ago

Awesome-Parameter-Efficient-Transfer-Learning jianghaojun

23

363

mit

21

A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.

deep-learning computer-vision machine-learning transfer-learning multimodal-deep-learning parameter-efficient-tuning parameter-efficient-learning

Created 2022-12-22

63 commits to main branch, last one 14 days ago

scarches theislab

50

319

bsd-3-clause

13

Reference mapping for single-cell genomics

scrna-seq multiomics single-cell deep-learning batch-correction data-integration human-cell-atlas rna-seq-analysis single-cell-genomics multimodal-deep-learning

Created 2019-08-12

1,175 commits to master branch, last one 22 days ago

content-moderation-deep-learning fcakyon

15

291

mit

5

Deep learning based content moderation from text, audio, video & image input modalities.

movie-trailer content-ratings nsfw-recognition nudity-detection content-moderation violence-detection profanity-detection genre-classification movie-content-filter multimodal-deep-learning

Created 2022-09-22

46 commits to main branch, last one about a month ago

ECCV2022-Papers-with-Code-Demo DWCTOD

23

288

unknown

7

收集 ECCV 最新的成果，包括论文、代码和demo视频等，欢迎大家推荐！

ai cv eccv nerf dataset eccv2022 diffusion computer-vision face-recognition image-segmentation vision-transformer objection-detection multimodal-deep-learning

Created 2022-07-04

48 commits to main branch, last one about a year ago

Awesome-Multimodality Yutong-Zhou-cv

19

287

unknown

11

A Survey on multimodal learning research.

awesome-list multimodality multimodal-deep-learning

Created 2021-09-20

79 commits to main branch, last one 10 months ago

MUStARD soujanyaporia

59

285

mit

8

Multimodal Sarcasm Detection Dataset

sarcasm sarcasm-detection multimodal-interactions multimodal-deep-learning

Created 2019-02-20

79 commits to master branch, last one 2 years ago

awesome-Vision-and-Language-Pre-training phellonchen

15

282

apache-2.0

11

Recent Advances in Vision and Language Pre-training (VLP)

vlp pretraining vision-and-language multimodal-deep-learning vision-and-language-pre-training

Created 2021-09-14

56 commits to main branch, last one about a year ago

MMMU MMMU-Benchmark

18

282

apache-2.0

4

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

llm llms stem evaluation multimodal deep-learning multimodality computer-vision machine-learning foundation-models question-answering multimodal-learning deep-neural-networks large-language-models large-multimodal-models multimodal-deep-learning visual-question-answering natural-language-processing

Created 2023-11-23

77 commits to main branch, last one 2 days ago

multimodal-ml-music ilaria-manco

12

273

mit

14

List of academic resources on Multimodal ML for Music

music-ai resources awesome-list music-research multimodal-data multimodal-learning academic-publications multimodal-deep-learning music-information-retrieval

Created 2022-12-29

11 commits to main branch, last one about a year ago

Med-PaLM kyegomez

41

272

mit

7

Towards Generalist Biomedical AI

gpt4 biomedical multimodal opensource deep-learning multimodality multimodal-deep-learning

Created 2023-07-31

118 commits to main branch, last one 4 months ago

prophet MILVLG

27

260

apache-2.0

3

Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".

gpt-3 okvqa a-okvqa pytorch prompt-engineering multimodal-deep-learning visual-question-answering

Created 2023-01-09

63 commits to main branch, last one about a year ago

Recommendation-Systems-without-Explicit-ID-Features-A-Literature-Review westlake-repl

20

255

unknown

9

Paper List of Pre-trained Foundation Recommender Models

Created 2023-06-25

190 commits to main branch, last one 2 months ago

CLoT sail-sg

10

255

unknown

8

CVPR'24, Official Codebase of our Paper: "Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation".

association leap-of-thought humor-generation large-language-models multimodal-deep-learning

Created 2023-12-01

33 commits to main branch, last one 2 months ago

multimodal-speech-emotion david-yoon

69

248

mit

9

TensorFlow implementation of "Multimodal Speech Emotion Recognition using Audio and Text," IEEE SLT-18

paralinguistics multimodal-deep-learning speech-emotion-recognition

Created 2019-01-13

49 commits to master branch, last one 3 months ago

awesome-emotion-recognition-in-conversations declare-lab

43

248

unknown

24

A comprehensive reading list for Emotion Recognition in Conversations

dialogue-systems conversational-ai emotion-recognition multimodal-interactions multimodal-deep-learning natural-language-processing emotion-recognition-in-conversation

Created 2020-07-05

44 commits to master branch, last one 4 months ago

DeepViewAgg drprojects

24

216

other

10

[CVPR'22 Best Paper Finalist] Official PyTorch implementation of the method presented in "Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation"

cvpr image s3dis pytorch cvpr2022 attention kitti-360 multi-view multimodal point-cloud deep-learning torch-points3d pytorch-geometric semantic-segmentation multimodal-deep-learning point-cloud-segmentation

Created 2022-04-15

2,640 commits to release branch, last one 10 months ago

cav-mae YuanGongND

22

212

bsd-2-clause

5

Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".

audio multimodal computer-vision audio-processing multimodal-deep-learning

Created 2023-03-20

44 commits to master branch, last one 7 months ago