Search Results - RepositoryStats

14

214

mit

8

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.

gpt gpt-3 gpt-4 csharp openai tokenizer cl100kbase

Created 2023-03-28

61 commits to main branch, last one 6 months ago

15

148

unknown

10

Analysis of OpenAI's ChatGPT

chat gpt-4 openai chatgpt plugins analysis tiktoken cl100kbase gpt-4-0613 gpt-35-turbo gpt-4-32k-0613 language-model gpt-35-turbo-0301 gpt-35-turbo-1106 chat-markup-language gpt-35-turbo-16k-0613 text-davinci-002-render text-davinci-002-plugins text-davinci-002-render-sha

Created 2022-12-03

64 commits to main branch, last one 9 months ago

3

57

mit

4

This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.

ai gpt4 csharp openai tokens chatgpt encoding p50kbase tiktoken langchain cl100kbase gpt35turbo tiktoken-sharp langchain-dotnet

Created 2023-06-09

137 commits to main branch, last one 3 days ago