Search Results - RepositoryStats

80

657

mit

8

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models

gpt-4 agents openai python ai-agents anthropic gpt4-vision huggingface ultralytics transformers google-gemini process-mining segment-anything large-action-model process-automation ai-agents-framework large-language-models large-multimodal-models huggingface-transformers

Created 2023-04-12

805 commits to main branch, last one a day ago

LLaVA-Plus-Codebase LLaVA-VL

49

641

apache-2.0

10

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

agent tool-use large-language-models large-multimodal-models multimodal-large-language-models

Created 2023-11-07

404 commits to main branch, last one 6 months ago

TinyLLaVA_Factory TinyLLaVA

27

372

apache-2.0

11

A Framework of Small-scale Large Multimodal Models

nlp llama llava tinyllama transformers vision-language large-multimodal-models

Created 2024-02-21

168 commits to main branch, last one a day ago

awesome-multimodal-in-medical-imaging richard-peng-xia

36

352

mit

13

A collection of resources on applications of multi-modal learning in medical imaging.

medical-imaging multimodal-learning large-language-models large-multimodal-models multimodal-deep-learning medical-report-generation visual-question-answering multimodal-large-language-models

Created 2022-07-13

124 commits to main branch, last one 26 days ago

MMMU MMMU-Benchmark

19

273

apache-2.0

4

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

llm llms stem evaluation multimodal deep-learning multimodality computer-vision machine-learning foundation-models question-answering multimodal-learning deep-neural-networks large-language-models large-multimodal-models multimodal-deep-learning visual-question-answering natural-language-processing

Created 2023-11-23

76 commits to main branch, last one 20 hours ago

OPERA shikiw

17

181

mit

2

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

gpt-4 llama chatbot chatgpt multimodal vision-language-model large-multimodal-models vision-language-learning

Created 2023-11-30

46 commits to main branch, last one 10 days ago

multi_token sshh12

6

151

apache-2.0

3

Embed arbitrary modalities (images, audio, documents, etc) into large language models.

llm llava multimodal large-context multi-modality large-language-models vision-language-model large-multimodal-models

Created 2023-10-11

84 commits to main branch, last one 2 months ago

LEGENT thunlp

7

135

apache-2.0

8

Open Platform for Embodied Agents

embodied-ai physics-engine robot-simulator language-grounding large-multimodal-models

Created 2024-03-13

86 commits to main branch, last one 4 days ago

MMStar MMStar-Benchmark

1

114

unknown

1

This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

llm llms lvlm lvlms evaluation multimodal multimodality multimodal-learning large-language-models large-multimodal-models visual-question-answering large-vision-language-model large-vision-language-models

Created 2024-03-29

18 commits to main branch, last one about a month ago

BenchLMM AIFEG

5

80

apache-2.0

0

BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Models

cv dataset benchmark large-language-models large-multimodal-models

Created 2023-11-20

89 commits to main branch, last one 5 months ago

Open-LLaVA-NeXT xiaoachen98

1

38

unknown

3

An open-source implementation of LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

29 commits to master branch, last one 2 days ago

VisualWebBench VisualWebBench

1

34

unknown

3

Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"

llm llms mllm evaluation multimodal deep-learning computer-vision machine-learning foundation-models question-answering large-language-models large-multimodal-models multimodal-deep-learning visual-question-answering natural-language-processing multimodal-large-language-models

Created 2024-04-02

25 commits to main branch, last one a day ago