python-tiktoken
Link | package | bugs open | bugs closed | Wiki | GitHub | web search |
Description | A fast BPE tokeniser for use with OpenAI's models |
Version | 0.8.0-1 [extra] |
Link | package | bugs open | bugs closed | Wiki | GitHub | web search |
Description | A fast BPE tokeniser for use with OpenAI's models |
Version | 0.8.0-1 [extra] |