2 results found Sort:

VITA-Group
SLaK VITA-Group
22
264
mit
7
[ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers than Transformers for ConvNets?"
51x51 convnet pytorch segmentation deep-learning large-kernels dynamic-sparsity object-detection knowledge-distillation
Created 2022-05-25
111 commits to SLAKandLargeKernelKD branch, last one about a year ago
VITA-Group
SViTE VITA-Group
12
91
mit
15
[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang
pruning token-slimming sparse-training dynamic-sparsity model-compression vision-transformers efficient-transformers
Created 2021-05-28
9 commits to main branch, last one about a year ago