Reverse Dependencies of tiktoken

The following projects have a declared dependency on tiktoken:

• llm-prompt-creator — Takes a given directory and parses its contents to create a text vectorstore to be consumed in prompts for various LLM models.
• llm-quiver — The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.
• llm-rankers — Pointwise, Listwise, Pairwise and Setwise Document Ranking with Large Language Models.
• llm-roleplay — LLM Roleplay: Simulating Human-Chatbot Interaction
• llm-server — no summary
• llm-space — A Python wrapper for managing OpenAI API and other LLM models.
• llm-toolkit — LLM Finetuning resource hub + toolkit
• llm-utils — Utilities for our LLM projects (CWhy, ChatDBG, ...).
• llm-workflow — build LLM workflows
• llmadapter — LLMs Adapter Package
• llmbench-cmri — A framework for load testing llmbench APIs
• llmcore — LLMCore: Essential tools for LLM development - models, prompts, embeddings, agents, chains, and more.
• llmflows — LLMFlows - Simple, Explicit and Transparent LLM Apps
• llmkira — A chain message bot based on OpenAI
• llmlingua — To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
• llmlingua-promptflow — To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
• llmppl — A package for calculating perplexity using various language models
• llmprototyping — A lightweight set of tools to use several llm and embeddings apis
• llmproxy — no summary
• llmstudio-core — LLMStudio core capabilities for routing llm calls for any vendor. No proxy server required. For that use llmstudio[proxy]
• llmstudio-proxy — no summary
• llmtorch — llm model process for pytorch
• llmtuner — Easy-to-use LLM fine-tuning framework
• llmuses — Eval-Scope: Lightweight LLMs Evaluation Framework
• llmutils — A few utility classes for working with LLMs
• llmvm-cli — Command Line LLM with client-side tools support.
• llmx — LLMX: A library for LLM Text Generation
• lloom — no summary
• lloom_ai — Concept Induction to analyze unstructured text
• lm-eval — A framework for evaluating language models
• lmao-nlp — LMAO: Language Model Adapter Objects
• lmfao — LMFAO: Language Model Functions, APIs, and Objects
• lmms-eval — A framework for evaluating large multi-modality language models
• lmql — A query language for language models.
• LMterminal — Interact with OpenAI's ChatGPT models from the comfort of your terminal.
• lmtk — Command line REPL for GPT-based tools
• LMtoolbox — A collection of CLI tools leveraging language models
• lmwrapper — An object-oriented wrapper around language models with caching, batching, and more.
• local-llm — Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
• lodestonegpt — 🤖 Modular Auto-GPT Framework Build For Project Lodestone
• logbatcher — A tool for batch parsing of log files
• logedit — A package to auto-generate changelogs from git commits using OpenAI's APIs
• logyca-ai — An integration package created by the company LOGYCA to interact with ChatGPT and analyze documents, files and other functionality of the OpenAI library.
• lollmsvectordb — A modular text-based database manager for retrieval-augmented generation (RAG), seamlessly integrating with the LoLLMs ecosystem.
• long-ebook-generator-ai — An A.I. tool for generating long Kindle ebooks based on a prompt
• longchat — LongChat and LongEval
• longdata — longevity-databases - longdata to work with common databases
• longtrainer — Production Ready LangChain
• lookaside — Lookaside cache in the LLM era
• loopgpt — Modular Auto-GPT Framework
• lotus-ai — lotus
• lynxius — Lynxius speeds up LLM evaluation and prevents errors before they reach users.
• mad-whisper-progress — Robust Speech Recognition via Large-Scale Weak Supervision with progress callback
• maldinio-ai — A utility package for AI prompt management and prompt processing.
• manifest-ml — Manifest for Prompting Foundation Models.
• mantis-vl — Official Codes for of "MANTIS: Interleaved Multi-Image Instruction Tuning"
• map2gpt — A python package to index and search documents using GPT3
• maritalk — Client library for the MariTalk API
• Marketingtool — A tool module to help you do marketing
• MarkLLM — MarkLLM: An Open-Source Toolkit for LLM Watermarking
• marvin — A lightweight AI engineering toolkit for building natural language interfaces that are reliable, scalable, and easy to trust.
• MateGen — 交互式智能编程助手MateGen
• materials-eunomia — Chemist AI Agent for Developing Materials Datasets with Natural Language Prompts
• matgraphdb — Welcome to MatGraphDB, a powerful Python package designed to interface with primary and graph databases for advanced material analysis.
• matrix-gptbot — Multifunctional Chatbot for Matrix
• mazurka — no summary
• mcodegpt — mCodeGPT
• mcodegpthippa — mcodegpthippa
• mdchat — a CLI that lets you chat with your markdown notes
• mdlsum-cli — A CLI tool to download, transcribe, and summarize YouTube videos.
• meetnotes-questions — GPT plugin for asking intelligent questions on live meeting notes
• megabots — 🤖 Megabots provides State-of-the-art, production ready bots made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵
• memonto — no summary
• memorag — A Python package for memory-augmented retrieval-augmented generation
• memoripy — Memoripy provides context-aware memory management with support for OpenAI and Ollama APIs, offering structured short-term and long-term memory storage for interactive applications.
• menderbot — The AI-powered command line tool for working with legacy code
• mentat — AI coding assistant on your command line
• mentat-ai — AI coding assistant on your command line
• merlin-ai — no summary
• meta-llama3 — no summary
• metagpt — The Multi-Agent Framework
• metagpt-simple — The Multi-Agent Framework
• metapal — Experiments regarding LLM components
• microllama — The smallest possible LLM API
• miksi-ai-sdk — Miksi-AI empowers your BI
• mimir-ai — no summary
• minimalgpt — Simple LangChain Wrapper Package for ease of using ChatGPT
• miniogre — miniogre: from source code to reproducible environment, in seconds.
• minlizhash — A simple MinHash LSH Implimentation from scratch
• miose-toolkit-llm — Miose Toolkit 大语言模型模块
• mirageml — Your Personal AGI
• mistral_common — no summary
• mktdata — no summary
• mlcopilot — Assistant for data scientists and machine learning developers.
• mlflow-saagie — MLflow: A Platform for ML Development and Productionization - forked for Saagie
• mlflow-skinny — MLflow is an open source platform for the complete machine learning lifecycle
• mlipy — Python-based Machine Learning Interface
• mllopenaimanager — no summary
• mlora — An Efficient Factory to Build Multiple LoRA Adapters
• mltb2 — Machine Learning Toolbox 2