{"full_name":"BerriAI/litellm","owner":"BerriAI","name":"litellm","shard":"1","url":"https://github.com/BerriAI/litellm","description":"The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]","homepage":"https://docs.litellm.ai/docs/","topics":["anthropic","langchain","llm","llmops","openai","ai-gateway","azure-openai","bedrock","gateway","openai-proxy","vertex-ai","llm-gateway","litellm","mcp-gateway","rust"],"tag_pages":["ai-gateway","anthropic","gateway","langchain","llm","llm-gateway","llmops","openai","rust","vertex-ai"],"language":"Python","license":"NOASSERTION","avatar":"https://avatars.githubusercontent.com/u/121462774?v=4","created_at":"2023-07-27T00:09:52Z","pushed_at":"2026-11-15T19:31:10Z","metrics":{"stars":63301,"forks":13301,"watchers":236,"issues":14154,"prs":36392,"releases":1573,"issues_open":1493,"issues_closed":12661,"prs_open":3719,"prs_closed":11701,"prs_merged":20972,"discussions":672},"growth":{"day":{"stars":46,"forks":24,"base_day":"2026-11-15"},"week":{"stars":348,"forks":173,"base_day":"2026-11-09"}},"history":{"dates":["2026-10-19","2026-10-20","2026-10-21","2026-10-22","2026-10-23","2026-10-24","2026-10-25","2026-10-26","2026-10-27","2026-10-28","2026-10-29","2026-10-30","2026-10-31","2026-11-01","2026-11-02","2026-11-03","2026-11-04","2026-11-09","2026-11-10","2026-11-11","2026-11-12","2026-11-13","2026-11-14","2026-11-15","2026-11-16"],"stars":[61293,61329,61393,61444,61578,61666,61741,61827,61912,61968,62080,62170,62246,62322,62396,62564,62636,62953,63023,63108,63157,63186,63220,63255,63301],"forks":[12365,12382,12418,12432,12481,12520,12550,12576,12612,12636,12707,12735,12787,12822,12856,12937,12982,13128,13148,13196,13220,13234,13266,13277,13301],"watchers":[239,239,240,240,240,239,238,238,238,233,234,234,234,236,236,237,236,237,237,237,237,237,237,237,236],"issues_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,1501,1495,1498,1496,1486,1493],"prs_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,3644,3654,3665,3703,3704,3719]},"boards":{},"same_owner":[],"issues":[{"number":31263,"title":"LiteLLM Rust Migration - the fastest and litest AI Gateway (sub 1ms overheads)","comments":33,"created_at":"2026-06-25T02:11:17Z"},{"number":30484,"title":"LiteLLM Stability Sprint Roadmap","comments":26,"created_at":"2026-06-15T21:35:41Z"},{"number":39057,"title":"Design intent: on cache hits, spend is zeroed but token columns replay the original usage — which basis should token reports aggregate?","comments":26,"created_at":"2026-09-01T02:40:29Z"},{"number":18686,"title":"I WISH LITELLM HAD - Models, Providers, Endpoints requests","comments":24,"created_at":"2026-01-06T05:17:07Z"},{"number":26672,"title":"[Bug]: Budget enforcement bypassed in v1.82.3 for key/user max_budget despite spend exceeding max_budget","comments":21,"created_at":"2026-04-28T06:18:11Z"},{"number":8513,"title":"[Feature]: Set currency by env variable","comments":21,"created_at":"2025-02-13T10:16:03Z"},{"number":25762,"title":"[Feature]: unlimited SSO Login with Standard Plan","comments":20,"created_at":"2026-04-15T08:22:32Z"},{"number":9753,"title":"Notice: Deprecation of the Prisma Python client","comments":20,"created_at":"2025-04-04T14:49:46Z"}],"discussions":[{"number":51749,"title":"[Withdrawn] posted by mistake — please ignore","comments":1,"category":"Q&A","created_at":"2026-11-13T23:27:12Z"},{"number":51436,"title":"Gemini 4 Hydrogen API Pricing and Day 0 Support on LiteLLM","comments":0,"category":"General","created_at":"2026-11-12T18:41:53Z"},{"number":51333,"title":"mcp-slim: Cross-provider MCP schema normalizer, token optimizer (-50% to -98%), and secret firewall","comments":0,"category":"Show and tell","created_at":"2026-11-12T02:29:25Z"},{"number":51157,"title":"Capping one agent run in front of a LiteLLM proxy, and sending less each turn","comments":0,"category":"Show and tell","created_at":"2026-11-11T06:47:09Z"},{"number":50970,"title":"Gemini 4 Carbon is now supported on LiteLLM","comments":0,"category":"General","created_at":"2026-11-10T18:12:11Z"},{"number":50654,"title":"LiteLLM enabling in-depth analysis of agentic behaviours","comments":0,"category":"Show and tell","created_at":"2026-11-08T21:27:35Z"},{"number":50640,"title":"Counting tokens per customer when your API calls models through LiteLLM","comments":0,"category":"Show and tell","created_at":"2026-11-08T18:13:52Z"},{"number":50533,"title":"models not available","comments":1,"category":"General","created_at":"2026-11-07T13:55:10Z"}],"latest_release":{"name":"v1.109.1","tag":"v1.109.1","published_at":"2026-11-12T02:07:01Z","body":"## Verify Docker Image Signature\n\nAll LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). This release is signed with the key introduced in [commit `e82a3c6`](https://github.com/BerriAI/litellm/commit/e82a3c646908ba0a6ee0beddc4310d7a6cac4065).\n\n**Verify using the pinned commit hash (recommended):**\n\nA commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the published signing key:\n\n```bash\ncosign verify \\\n  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \\\n  ghcr.io/berriai/litellm:v1.109.1\n```\n\n**Verify using the release tag (convenience):**\n\nTags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:\n\n```bash\ncosign verify \\\n  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.109.1/cosign.pub \\\n  ghcr.io/berriai/litellm:v1.109.1\n```\n\nExpected output:\n\n```\nThe following checks were performed on each of these signatures:\n  - The cosign claims were validated\n  - The signatures were verified against the specified public key\n```\n\n---\n## What's Changed\n* security(proxy): backport #51254 to stable/1.109.x by @shrey-berri in https://github.com/BerriAI/litellm/pull/51264\n* chore: bump litellm 1.109.0 -> 1.109.1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/51298\n\n\n**Full Changelog**: https://github.com/BerriAI/litellm/compare/v1.109.0...v1.109.1","is_prerelease":false},"readme":true,"readme_zh":false,"news":[{"title":"Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised","url":"https://github.com/BerriAI/litellm/issues/24512","hn":"https://news.ycombinator.com/item?id=47501426","source":"Hacker News","lang":"en","date":"2026-03-24","points":938,"comments":500},{"title":"Malicious litellm_init.pth in litellm 1.82.8 PyPI package – credential stealer","url":"https://github.com/BerriAI/litellm/issues/24512","hn":"https://news.ycombinator.com/item?id=47501729","source":"Hacker News","lang":"en","date":"2026-03-24","points":739,"comments":1},{"title":"Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching","url":"https://github.com/BerriAI/litellm/blob/main/cookbook/proxy-server/readme.md","hn":"https://news.ycombinator.com/item?id=37095542","source":"Hacker News","lang":"en","date":"2023-08-12","points":140,"comments":34},{"title":"Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O","url":"https://github.com/BerriAI/litellm","hn":"https://news.ycombinator.com/item?id=36887711","source":"Hacker News","lang":"en","date":"2023-07-27","points":62,"comments":17},{"title":"Show HN: A modern C++20 AI SDK (GPT‑4o, Claude 3.5, tool‑calling)","url":"https://news.ycombinator.com/item?id=44412726","hn":"https://news.ycombinator.com/item?id=44412726","source":"Hacker News","lang":"en","date":"2025-06-29","points":56,"comments":6},{"title":"LiteLLM Python SDK Proxy Server LLM Gateway Call 100 LLM APIs in OpenAI Format","url":"https://github.com/BerriAI/litellm","hn":"https://news.ycombinator.com/item?id=44674162","source":"Hacker News","lang":"en","date":"2025-07-24","points":5,"comments":0},{"title":"Litellm 1.107.0 on PYPI Compromised","url":"https://github.com/BerriAI/litellm/issues/47826","hn":"https://news.ycombinator.com/item?id=50180845","source":"Hacker News","lang":"en","date":"2026-10-21","points":3,"comments":0},{"title":"LiteLLM Agent Platform: Run Claude Code/Codex On-Prem Sandboxes and Vaults","url":"https://github.com/BerriAI/litellm-agent-platform","hn":"https://news.ycombinator.com/item?id=48155595","source":"Hacker News","lang":"en","date":"2026-05-16","points":3,"comments":0},{"title":"Popular AI tool LiteLLM says unrevoked key allowed hackers to target users","url":"https://therecord.media/litellm-hackers-ai-malware","source":"The Record from Recorded Future News","lang":"en","date":"2026-10-26"},{"title":"LiteLLM traces supply chain attack to a GitHub key nobody revoked","url":"https://cryptobriefing.com/litellm-supply-chain-attack-exposed-github-key/","source":"Crypto Briefing","lang":"en","date":"2026-10-26"},{"title":"LiteLLM 1.107.0 是如何被投毒的：响应体中的一个令牌，以及将其留存下来的日志","url":"https://news.google.com/rss/articles/CBMiigFBVV95cUxQWEhnaHB6N1ljR0NlRnlCaktMVGFJeTZXREQ2Tm4zSWIzdlZaWUtEUlp4VWRQa2dYdVRGQzh2bzZyM3R0aUNJQ19naFBtSlJjdWVlLXUwSnJ4LXkyWHBBcHFxNGNWbHVzMWJsQ0c4ZVpuZ2l0T3h3Y2prZVdXdk4wRFk4LURjbVFBUVE?oc=5","source":"OrcaRouter","lang":"zh","date":"2026-10-30"},{"title":"LiteLLM主密钥泄露致部署链路遭入侵 恶意版本流入PyPI和Docker Hub","url":"https://news.google.com/rss/articles/CBMiugFBVV95cUxPUHQ3VkRsX19DME5LZ0o0bkZQcnhDQ3JDYjV0YU9UMVpUeHJRdm1RMEE5TjVlQ0NHSWc4anhrenEyaU5feEE3S2FZREtOdEhqc1Nyc3g2TXJnMXg2ZlBIY0RSZlZDYlFQdlJZdkNjTkkyZlhmWHg5N2pTbWtNdkJtS29xYU9sX2pJX2ktY280Z0tlLVBWOTRHY0Q1RlF1MFRGY1B2eEpZUmgzUHdkZnJjRGZ2Z0NjS2cwdGc?oc=5","source":"디지털투데이","lang":"zh","date":"2026-10-24"},{"title":"泄露的 LiteLLM 主密钥让攻击者劫持发布流程，发布恶意软件包","url":"https://news.google.com/rss/articles/CBMizAFBVV95cUxNWXhZN2Z2Szh5VUFQRkczWXFQdEZsR0JsRk0xcjRBRG9IVnNyVlYyN2lZRmdaTHdGQjkxa1NhTEtZbkJzeXhrczFwLU9zaVV5TnVETW1GLXV3ZXRpV3hjSlV6ZlRMUFc4elMzbkE3UE91U3QyRG85aWFwTjNlNE1abEhVZjNwLXl4REllamkzT2pyQTdwS1FJVHMtRUJhVTlHSTlvWFhQbEJiX3NHVWlBMXB4Wm9EVWVjMUJuUHJ0NUlOVU53bFp0ZWkyRHU?oc=5","source":"news.lavx.hu","lang":"zh","date":"2026-10-24"},{"title":"PyPI遭投毒！LiteLLM用户Python启动就中招，个人凭证秒泄露","url":"https://news.google.com/rss/articles/CBMiSEFVX3lxTE9PRkJjbzdnbUtBazh5bnp2b19FZUpFOGdMQU1COHJqWU9lQkpmc0hfdmhyelJraGtOWDBfZDBZTUZjckhtbEpmQQ?oc=5","source":"智源社区","lang":"zh","date":"2026-03-27"},{"title":"LiteLLM 供应链攻击事件始末| 慢雾SlowMist发布于币安广场","url":"https://news.google.com/rss/articles/CBMiaEFVX3lxTE1xSU9rOVp1TzRMNGZ1ZTdzempvOW9DeDJKM3RTczJZQWJrQ0JCUkdSa01HdmlBT3o3NWtvYVJLSHpYbUFKTktfWm43Y2NvUVd1V05UekV5RUlwaGUzOGl6LWJRN3E2VURr?oc=5","source":"Binance","lang":"zh","date":"2026-03-25"}],"stale":false,"snapshot_at":"2026-11-16T09:23:14Z","history_start":"2026-09-06"}