gpt-tokenizer1.3mMIT3.4.0A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
niieani19 days 前BPE, encoder, decoder, tokenizer @promptbook/utils3.4mCC-BY-4.00.103.0-49Promptbook: Turn your company's scattered knowledge into AI ready books
webgptorgabout 5 hours 前ai, ai-agents, ai-application-framework, ai-assistant date.js1.2mMIT0.3.3dates for humans
MatthewMuellerover 3 years 前nlp, natural language processing, time, parser