Search Results - RepositoryStats

13 results found Sort:

Filter by Primary Language:
Python (10)
Jupyter Notebook (2)
+

awesome-grounding TheShadow29

95

985

mit

28

awesome grounding: A curated list of research papers in visual grounding

arxiv paper papers grounding awesome-list paper-roadmap embodied-agent computer-vision image-grounding video-grounding phrase-grounding visual-grounding captioning-images captioning-videos language-grounding video-understanding multimodal-deep-learning natural-language-processing

Created 2018-09-03

97 commits to master branch, last one about a year ago

Cradle BAAI-Agents

58

608

mit

11

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...

ai gcc llm lmm vlm cradle ai-agent grounding personoid generative-ai multimodality computer-control foundation-agent ai-agents-framework large-language-models vision-language-model general-computer-control

Created 2024-03-03

17 commits to main branch, last one 2 days ago

Groma FoundationVision

55

466

apache-2.0

36

Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 22 days ago

cliport cliport

80

432

apache-2.0

6

CLIPort: What and Where Pathways for Robotic Manipulation

clip vision pytorch robotics grounding manipulation deep-learning rearrangement computer-vision vision-language natural-language-processing

Created 2021-09-20

91 commits to master branch, last one about a year ago

25

423

mit

10

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

maths planning grounding reasoning web-agent language-agent decision-making question-answering

Created 2023-10-01

115 commits to main branch, last one 3 months ago

49

303

mit

6

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2021-07-20

259 commits to main branch, last one 3 months ago

Video-LLaVA mbzuai-oryx

11

222

unknown

14

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

llm lmm video grounding transcription video-grounding video-conversation

Created 2023-11-20

8 commits to main branch, last one 5 months ago

Grounding_LLMs_with_online_RL flowersteam

20

200

mit

7

We perform functional grounding of LLMs' knowledge in BabyAI-Text

grounding language-model interactive-agents reinforcement-learning

Created 2023-02-01

39 commits to main branch, last one 4 months ago

CLIP-VG linhuixiao

4

98

apache-2.0

3

Self-paced Curriculum Adapting of CLIP for Visual Grounding.

clip grounding

Created 2023-05-13

23 commits to master branch, last one about a month ago

hulc lukashermann

9

60

mit

2

Hierarchical Universal Language Conditioned Policies

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2022-04-12

47 commits to main branch, last one 3 months ago

VidSitu TheShadow29

8

55

mit

3

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

nlp srl video vision grounding captioning semantic-roles video-language event-relations captioning-videos vision-and-language

Created 2021-02-10

57 commits to main branch, last one 2 years ago

8

41

mit

4

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

pytorch semantic grounding cross-modal transformer visual-grounding knowledge-transfer zero-shot-learning pretrained-language-model

Created 2022-11-27

48 commits to main branch, last one 4 months ago

2

31

mit

3

[ICRA2023] Grounding Language with Visual Affordances over Unstructured Data

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2022-11-06

4 commits to main branch, last one 8 months ago