2 results found Sort:

therealoliver
Deepdive-llama3-from-scratch therealoliver
42
558
mit
4
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
gpt rms llms mask rope llama swiglu kv-cache rms-norm attention inference residuals tokenizer transformer language-model llm-configuration attention-mechanism positional-encoding multi-head-attention rotary-position-encoding
Created 2025-02-19
9 commits to main branch, last one 28 days ago
hkproj
pytorch-llama-notes hkproj
6
54
unknown
7
Notes about LLaMA 2 model
llama2 rmsprop kv-cache study-notes rotary-position-encoding attention-is-all-you-need
Created 2023-08-21
4 commits to main branch, last one about a year ago