Search Results - RepositoryStats

161

1.8k

mit

26

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...

ai gcc llm lmm vlm cradle ai-agent grounding personoid generative-ai multimodality computer-control foundation-agent ai-agents-framework large-language-models vision-language-model general-computer-control

Created 2024-03-03

34 commits to main branch, last one 22 hours ago

awesome-grounding TheShadow29

98

1.0k

mit

28

awesome grounding: A curated list of research papers in visual grounding

arxiv paper papers grounding awesome-list paper-roadmap embodied-agent computer-vision image-grounding video-grounding phrase-grounding visual-grounding captioning-images captioning-videos language-grounding video-understanding multimodal-deep-learning natural-language-processing

Created 2018-09-03

97 commits to master branch, last one about a year ago

Groma FoundationVision

59

556

apache-2.0

35

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 5 months ago

cliport cliport

81

461

apache-2.0

6

CLIPort: What and Where Pathways for Robotic Manipulation

clip vision pytorch robotics grounding manipulation deep-learning rearrangement computer-vision vision-language natural-language-processing

Created 2021-09-20

91 commits to master branch, last one about a year ago

lumos allenai

29

447

mit

10

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

maths planning grounding reasoning web-agent language-agent decision-making question-answering

Created 2023-10-01

115 commits to main branch, last one 7 months ago

calvin mees

57

394

mit

6

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2021-07-20

263 commits to main branch, last one 2 months ago

Video-LLaVA mbzuai-oryx

11

242

unknown

14

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

llm lmm video grounding transcription video-grounding video-conversation

Created 2023-11-20

8 commits to main branch, last one 10 months ago

Grounding_LLMs_with_online_RL flowersteam

24

219

mit

7

We perform functional grounding of LLMs' knowledge in BabyAI-Text

grounding language-model interactive-agents reinforcement-learning

Created 2023-02-01

52 commits to main branch, last one 2 months ago

CLIP-VG linhuixiao

6

107

apache-2.0

4

[TMM 2023] Self-paced Curriculum Adapting of CLIP for Visual Grounding.

clip grounding

Created 2023-05-13

30 commits to master branch, last one 3 months ago

StructLM TIGER-AI-Lab

9

68

mit

4

Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)

llm grounding reasoning

Created 2024-02-25

41 commits to main branch, last one 18 days ago

hulc lukashermann

9

66

mit

2

Hierarchical Universal Language Conditioned Policies

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2022-04-12

47 commits to main branch, last one 7 months ago

VidSitu TheShadow29

8

57

mit

3

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

nlp srl video vision grounding captioning semantic-roles video-language event-relations captioning-videos vision-and-language

Created 2021-02-10

57 commits to main branch, last one 3 years ago

DUET zjukg

8

49

mit

4

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

pytorch semantic grounding cross-modal transformer visual-grounding knowledge-transfer zero-shot-learning pretrained-language-model

Created 2022-11-27

48 commits to main branch, last one 9 months ago

hulc2 mees

3

36

mit

3

[ICRA2023] Grounding Language with Visual Affordances over Unstructured Data

vision pytorch robotics grounding manipulation deep-learning computer-vision vision-language vision-and-language natural-language-processing

Created 2022-11-06

4 commits to main branch, last one about a year ago

HiVG linhuixiao

3

31

apache-2.0

2

[ACM MM 2024] Hierarchical Multimodal Fine-grained Modulation for Visual Grounding.

clip grounding

Created 2024-04-20

15 commits to master branch, last one 19 days ago