3 results found Sort:

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
Created 2023-03-28
61 commits to main branch, last one 5 months ago
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
Created 2023-06-09
126 commits to main branch, last one 2 days ago