{"full_name":"xlite-dev/Awesome-LLM-Inference","owner":"xlite-dev","name":"Awesome-LLM-Inference","shard":"1","url":"https://github.com/xlite-dev/Awesome-LLM-Inference","description":"📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉","homepage":"","topics":["flash-attention","paged-attention","tensorrt-llm","vllm","awesome-llm","llm-inference","deepseek","flash-attention-3","deepseek-v3","minimax-01","deepseek-r1","mla","flash-mla","qwen3"],"tag_pages":["deepseek","deepseek-v3","llm-inference","qwen3","vllm"],"language":"Python","license":"GPL-3.0","avatar":"https://avatars.githubusercontent.com/u/204302598?v=4","created_at":"2023-08-27T02:32:15Z","pushed_at":"2026-10-20T08:19:47Z","metrics":{"stars":5558,"forks":447,"watchers":132,"issues":13,"prs":187,"releases":45,"issues_open":1,"issues_closed":12,"prs_open":11,"prs_closed":12,"prs_merged":164,"discussions":0},"growth":{"day":{"stars":1,"forks":0,"base_day":"2026-11-15"}},"history":{"dates":["2026-11-10","2026-11-11","2026-11-12","2026-11-13","2026-11-14","2026-11-15","2026-11-16"],"stars":[5552,5553,5554,5555,5556,5557,5558],"forks":[443,444,445,445,445,447,447],"watchers":[null,132,132,132,132,132,132],"issues_open":[null,1,1,1,1,1,1],"prs_open":[null,9,9,9,9,11,11]},"boards":{},"same_owner":[{"full_name":"xlite-dev/LeetCUDA","name":"LeetCUDA","shard":"1","boards":{}}],"issues":[{"number":205,"title":"Scope question: Bayes@N evaluation under repeated sampling","comments":0,"created_at":"2026-10-20T05:49:19Z"}],"discussions":[],"latest_release":{"name":"v2.6.20","tag":"v2.6.20","published_at":"2025-06-17T09:57:32Z","body":"## What's Changed\r\n* Add 4 papers by @woominsong in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/148\r\n* Update new paper (KVzip) by @Janghyun1230 in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/149\r\n* Add a new paper (GuidedQuant) by @jusjinuk in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/150\r\n* Add STAND by @woominsong in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/151\r\n* Add Inference-Time Hyper-Scaling by @CStanKonrad in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/152\r\n\r\n## New Contributors\r\n* @woominsong made their first contribution in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/148\r\n* @jusjinuk made their first contribution in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/150\r\n* @CStanKonrad made their first contribution in https://github.com/xlite-dev/Awesome-LLM-Inference/pull/152\r\n\r\n**Full Changelog**: https://github.com/xlite-dev/Awesome-LLM-Inference/compare/v2.6.19...v2.6.20","is_prerelease":false},"readme":true,"readme_zh":false,"news":[],"stale":false,"snapshot_at":"2026-11-16T09:23:14Z","history_start":"2026-09-06"}