{"full_name":"vllm-project/semantic-router","owner":"vllm-project","name":"semantic-router","shard":"1","url":"https://github.com/vllm-project/semantic-router","description":"An open, programmable decision layer for models and compute.","homepage":"https://vllm-sr.ai","topics":["mixture-of-models","semantic-router","vllm","ai-gateway","kubernetes","llmrouter","llm","guardrails","inference","pytorch","transformer"],"tag_pages":["ai-gateway","guardrails","inference","kubernetes","llm","pytorch","transformer","vllm"],"language":"Go","license":"Apache-2.0","avatar":"https://avatars.githubusercontent.com/u/136984999?v=4","created_at":"2025-08-26T21:49:50Z","pushed_at":"2026-11-15T16:28:54Z","metrics":{"stars":6479,"forks":1122,"watchers":61,"issues":2693,"prs":3930,"releases":4,"issues_open":384,"issues_closed":2309,"prs_open":254,"prs_closed":791,"prs_merged":2885,"discussions":14},"growth":{"day":{"stars":2,"forks":1,"base_day":"2026-11-15"}},"history":{"dates":["2026-11-15","2026-11-16"],"stars":[6477,6479],"forks":[1121,1122],"watchers":[62,61],"issues_open":[383,384],"prs_open":[241,254]},"boards":{},"same_owner":[{"full_name":"vllm-project/vllm","name":"vllm","shard":"1","boards":{"daily_forks":102,"total":156}},{"full_name":"vllm-project/vllm-omni","name":"vllm-omni","shard":"1","boards":{}}],"issues":[{"number":2966,"title":"[WG] Router Models & Inference Runtime — charter and Lead/Member self-nomination","comments":97,"created_at":"2026-08-22T09:30:13Z"},{"number":15,"title":"[Community] Join the vLLM Semantic Router Workgroups","comments":87,"created_at":"2025-09-01T11:20:13Z"},{"number":2987,"title":"[WG] Agentic & Context — charter and Lead/Member self-nomination","comments":54,"created_at":"2026-08-23T15:16:00Z"},{"number":2967,"title":"[WG] Data Plane & Networking — charter and Lead/Member self-nomination","comments":51,"created_at":"2026-08-22T09:30:17Z"},{"number":2976,"title":"[Epic] Enable safe cross-model KV-cache reuse","comments":50,"created_at":"2026-08-22T09:31:59Z"},{"number":2965,"title":"[WG] MoM & Routing — charter and Lead/Member self-nomination","comments":49,"created_at":"2026-08-22T09:30:11Z"},{"number":2970,"title":"[WG] Developer Experience & Ecosystem — charter and Lead/Member self-nomination","comments":36,"created_at":"2026-08-22T09:30:25Z"},{"number":2969,"title":"[WG] Evaluation & Quality — charter and Lead/Member self-nomination","comments":35,"created_at":"2026-08-22T09:30:22Z"}],"discussions":[{"number":4608,"title":"Proposal: a clarification-loop example for decision models with incomplete input","comments":0,"category":"Ideas","created_at":"2026-10-05T17:43:49Z"},{"number":4294,"title":"Decision-1.0-Lux-9B is listed on systemonemodels.tech: want to claim the page?","comments":0,"category":"Q&A","created_at":"2026-09-27T15:59:56Z"},{"number":3946,"title":"semantic-router-counterfactual v0.1","comments":0,"category":"Show and tell","created_at":"2026-09-19T12:37:31Z"},{"number":2952,"title":"[RFC] Feature Request: Dedicated Routing Strategy for Long-Horizon Code Tasks (Beyond Multi-Domain Routing)","comments":0,"category":"Ideas","created_at":"2026-08-20T01:57:04Z"},{"number":2752,"title":"How does this auto routing exactly works","comments":2,"category":"General","created_at":"2026-08-03T04:46:58Z"},{"number":2180,"title":"[RFC] Semantic cache entry identity: should the key be query-only, or composite (tenant × model × query)?","comments":0,"category":"Ideas","created_at":"2026-06-14T02:05:52Z"},{"number":1862,"title":"Getting More Involved","comments":0,"category":"General","created_at":"2026-04-30T17:23:36Z"},{"number":1860,"title":"[RFC] Routing Hint Injection & Plan Binding — Escape Hatches for LLM Routing","comments":1,"category":"Ideas","created_at":"2026-04-29T17:35:10Z"}],"latest_release":{"name":"Release v0.4.0","tag":"v0.4.0","published_at":"2026-09-27T06:59:53Z","body":"## Announcement\r\n\r\n982 commits · 130 contributors · 107 first-time contributors since Themis. This is a milestone built by a growing community across models, runtime, evaluation, and the experience of putting it all to work.\r\n\r\nRead the full release [blog](https://vllm-sr.ai/blog/v0.4-vllm-sr-hermes-release) 🎉\r\n\r\n### Python\r\n\r\n```bash\r\npip install vllm-sr==0.4.0\r\n```\r\n\r\n## New Contributors\r\n* @xiaoyu-xyz made their first contribution in https://github.com/vllm-project/semantic-router/pull/2061\r\n* @wyf027 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2187\r\n* @omkar-334 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2196\r\n* @danehans made their first contribution in https://github.com/vllm-project/semantic-router/pull/2199\r\n* @MilindRastogi24 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2273\r\n* @TwilightTechie made their first contribution in https://github.com/vllm-project/semantic-router/pull/2232\r\n* @kunalpandey1 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2309\r\n* @Aastha204 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2409\r\n* @haritha3320 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2416\r\n* @Raghul-M made their first contribution in https://github.com/vllm-project/semantic-router/pull/2483\r\n* @xiongzubiao made their first contribution in https://github.com/vllm-project/semantic-router/pull/2418\r\n* @iroiro147 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2510\r\n* @lxingy3 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2519\r\n* @adaamko made their first contribution in https://github.com/vllm-project/semantic-router/pull/2560\r\n* @orangeCatDeveloper made their first contribution in https://github.com/vllm-project/semantic-router/pull/2574\r\n* @pollychen-lab made their first contribution in https://github.com/vllm-project/semantic-router/pull/2601\r\n* @benhurstephen made their first contribution in https://github.com/vllm-project/semantic-router/pull/2563\r\n* @EuclidStellar made their first contribution in https://github.com/vllm-project/semantic-router/pull/2609\r\n* @arijitroy003 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2651\r\n* @aaditraj made their first contribution in https://github.com/vllm-project/semantic-router/pull/2618\r\n* @raghavchitkara36 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2698\r\n* @duchangyong made their first contribution in https://github.com/vllm-project/semantic-router/pull/2736\r\n* @pranavthakur0-0 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2526\r\n* @ankit373 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2776\r\n* @abhinav-m22 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2746\r\n* @olifarhaan made their first contribution in https://github.com/vllm-project/semantic-router/pull/2818\r\n* @nandi19k made their first contribution in https://github.com/vllm-project/semantic-router/pull/2846\r\n* @uuzzrm made their first contribution in https://github.com/vllm-project/semantic-router/pull/2874\r\n* @chethanuk made their first contribution in https://github.com/vllm-project/semantic-router/pull/2870\r\n* @fzlzjerry made their first contribution in https://github.com/vllm-project/semantic-router/pull/2872\r\n* @AmirF194 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2891\r\n* @muchengl made their first contribution in https://github.com/vllm-project/semantic-router/pull/2906\r\n* @csarushan1729 made their first contribution in https://github.com/vllm-project/semantic-router/pull/2945\r\n* @aakankshabhende made their first contribution in https://github.com/vllm-project/semantic-","is_prerelease":false},"readme":true,"readme_zh":false,"news":[],"stale":false,"snapshot_at":"2026-11-16T09:23:14Z","history_start":"2026-09-06"}