NSTiwari / Llama3-on-Mobile

This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on-device inference.

NSTiwari
NSTiwari
Date Created 2024-05-13 (7 months ago)
Commits 37 (last one 7 months ago)
Stargazers 69 (1 this week)
Watchers 1 (0 this week)
Forks 8
License mit
Ranking

RepositoryStats indexes 595,856 repositories, of these NSTiwari/Llama3-on-Mobile is ranked #378,426 (36th percentile) for total stargazers, and #544,643 for total watchers. Github reports the primary language for this repository as Makefile, for repositories using this language it is ranked #737/1,190.

Other Information

NSTiwari/Llama3-on-Mobile has Github issues enabled, there is 1 open issue and 0 closed issues.

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

37 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Makefile but there's also others...

updated: 2024-12-19 @ 02:15am, id: 800129976 / R_kgDOL7EDuA