Search Results - RepositoryStats

14

295

mit

6

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

awsome survey surveys paper-list awsome-list entity-linking knowledge-graph entity-alignment image-generation multi-modal-fusion image-classification multi-modal-learning cross-modal-retrieval large-language-models information-extraction visual-question-answering knowledge-graph-embeddings multi-modal-knowledge-graph

Created 2024-01-29

77 commits to main branch, last one 4 months ago

MyGO zjukg

4

207

unknown

4

[Paper][Preprint 2024] MyGO: Discrete Modality Information as Fine-Grained Tokens for Multi-modal Knowledge Graph Completion

mygo multi-modal tokenization multi-modal-fusion contrastive-learning knowledge-graph-completion multi-modal-knowledge-graph

Created 2024-04-15

9 commits to main branch, last one 4 months ago

the-compiler kyegomez

19

144

apache-2.0

4

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

agora autogpt chatgpt deep-learning multi-modality chain-of-thought tree-of-thoughts multi-modal-fusion prompt-engineering artficial-intelligence reinforcement-learning deep-learning-algorithms multimodal-deep-learning

Created 2023-05-22

48 commits to main branch, last one about a year ago

Achelous GuanRunwei

9

140

unknown

5

Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar

4d-mmwave-radar object-tracking object-detection multi-modal-fusion multi-task-learning panoptic-perception multi-modal-learning semantic-segmentation point-cloud-segmentation

Created 2023-03-17

150 commits to main branch, last one 2 months ago

VisEvent_SOT_Benchmark wangxiao5791509

9

116

mit

6

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

dvs event spike visevent neuromorphic pengchenglab multi-modal-fusion neuromorphic-vision frame-event-tracking dynamic-vision-sensors single-object-tracking

Created 2020-12-09

169 commits to main branch, last one 20 hours ago

Husformer SMARTlab-Purdue

29

104

unknown

18

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org...

transformer multi-modal-fusion affective-computing human-state-recognition multi-modal-deep-learning

Created 2022-08-26

152 commits to master branch, last one about a year ago

MoE-Mamba kyegomez

3

78

mit

5

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

ai ml moe swarms multi-modality multi-modal-fusion

Created 2024-01-21

14 commits to main branch, last one 8 months ago

MegaVIT kyegomez

1

25

mit

3

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

gpt4 multi-modal computer-vision multi-modal-fusion vision-transformer vision-and-language multi-modal-learning artificial-intelligence

Created 2023-10-02

28 commits to main branch, last one 12 months ago