Search Results - RepositoryStats

16

339

mit

7

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

awsome survey surveys paper-list awsome-list entity-linking knowledge-graph entity-alignment image-generation multi-modal-fusion image-classification multi-modal-learning cross-modal-retrieval large-language-models information-extraction visual-question-answering knowledge-graph-embeddings multi-modal-knowledge-graph

Created 2024-01-29

77 commits to main branch, last one 6 months ago

MyGO zjukg

4

217

unknown

4

[Paper][Preprint 2024] MyGO: Discrete Modality Information as Fine-Grained Tokens for Multi-modal Knowledge Graph Completion

mygo multi-modal tokenization multi-modal-fusion contrastive-learning knowledge-graph-completion multi-modal-knowledge-graph

Created 2024-04-15

9 commits to main branch, last one 5 months ago

Achelous GuanRunwei

9

145

unknown

5

The official repository of Achelous and Achelous++

4d-mmwave-radar object-tracking object-detection multi-modal-fusion multi-task-learning panoptic-perception multi-modal-learning semantic-segmentation point-cloud-segmentation

Created 2023-03-17

150 commits to main branch, last one 4 months ago

the-compiler kyegomez

19

144

apache-2.0

4

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

agora autogpt chatgpt deep-learning multi-modality chain-of-thought tree-of-thoughts multi-modal-fusion prompt-engineering artficial-intelligence reinforcement-learning deep-learning-algorithms multimodal-deep-learning

Created 2023-05-22

48 commits to main branch, last one about a year ago

VisEvent_SOT_Benchmark wangxiao5791509

9

124

mit

6

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

dvs event spike visevent neuromorphic pengchenglab multi-modal-fusion neuromorphic-vision frame-event-tracking dynamic-vision-sensors single-object-tracking

Created 2020-12-09

169 commits to main branch, last one about a month ago

Husformer SMARTlab-Purdue

29

106

unknown

19

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org...

transformer multi-modal-fusion affective-computing human-state-recognition multi-modal-deep-learning

Created 2022-08-26

152 commits to master branch, last one about a year ago

MoE-Mamba kyegomez

5

84

mit

5

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

ai ml moe swarms multi-modality multi-modal-fusion

Created 2024-01-21

14 commits to main branch, last one 10 months ago

AM3Net_Multimodal_Data_Fusion Cimy-wang

3

35

unknown

2

Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and ...

multi-modal-fusion hyperspectral-sar-fusion hyperspectral-lidar-fusion hyperspectral-image-classification

Created 2021-12-07

35 commits to main branch, last one about a year ago

NATIVE zjukg

1

26

unknown

4

[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild

multi-modal incomplete-data knowledge-graph multi-modal-fusion imbalanced-learning adversarial-learning knowledge-graph-completion multi-modal-knowledge-graph

Created 2024-03-28

8 commits to main branch, last one 3 months ago

MegaVIT kyegomez

1

25

mit

3

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

gpt4 multi-modal computer-vision multi-modal-fusion vision-transformer vision-and-language multi-modal-learning artificial-intelligence

Created 2023-10-02

28 commits to main branch, last one about a year ago