2 results found Sort:

therealoliver
Deepdive-llama3-from-scratch therealoliver
42
559
mit
4
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
gpt rms llms mask rope llama swiglu kv-cache rms-norm attention inference residuals tokenizer transformer language-model llm-configuration attention-mechanism positional-encoding multi-head-attention rotary-position-encoding
Created 2025-02-19
9 commits to main branch, last one about a month ago
aju22
LLaMA2 aju22
9
64
unknown
4
This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture ...
gpt llm rope llama llama2 kv-cache rms-norm attention transformer natural-language-processing
Created 2023-10-01
5 commits to main branch, last one about a year ago