LowinLi / transformers-stream-generator

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

Date Created 2023-03-26 (about a year ago)

Commits 19 (last one 2 months ago)

Stargazers 89 (0 this week)

Watchers 2 (0 this week)

Forks 15

License mit

Ranking

RepositoryStats indexes 523,840 repositories, of these LowinLi/transformers-stream-generator is ranked #290,033 (45th percentile) for total stargazers, and #442,567 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #52,371/100,813.

LowinLi/transformers-stream-generator is also tagged with popular topics, for these it's ranked: gpt (#547/939), text-generation (#92/151)

Other Information

LowinLi/transformers-stream-generator has Github issues enabled, there are 11 open issues and 1 closed issue.

All Topics

gpt text-generation stream-generator

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

19 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Python but there's also others...

updated: 2024-05-26 @ 04:45am, id: 619078090 / R_kgDOJOZhyg