2 results found Sort:
This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language ...
Created
2024-05-07
741 commits to main branch, last one 2 days ago
Wonderful Matrices to Build Small Language Models
nlp
python
pytorch
transformer
deep-learning
language-model
machine-learning
foundation-models
mixture-of-experts
attention-mechanism
pytorch-transformers
small-language-model
small-language-models
dynamic-mask-attention
attention-is-all-you-need
feedforward-neural-network
natural-language-processing
cross-domain-mixture-of-experts
Created
2024-11-03
346 commits to main branch, last one about a month ago