{"full_name":"ymcui/Chinese-LLaMA-Alpaca","owner":"ymcui","name":"Chinese-LLaMA-Alpaca","shard":"1","url":"https://github.com/ymcui/Chinese-LLaMA-Alpaca","description":"中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)","homepage":"https://github.com/ymcui/Chinese-LLaMA-Alpaca/wiki","topics":["llm","plm","pre-trained-language-models","alpaca","llama","nlp","quantization","large-language-models","lora","alpaca-2","llama-2"],"tag_pages":["large-language-models","llama","llm","lora","nlp","quantization"],"language":"Python","license":"Apache-2.0","avatar":"https://avatars.githubusercontent.com/u/16095339?u=c186302fbab5af7620737e166766710312eb5594&v=4","created_at":"2023-03-15T11:09:39Z","pushed_at":"2026-04-19T00:58:05Z","metrics":{"stars":18912,"forks":1831,"watchers":182,"issues":733,"prs":69,"releases":12,"issues_open":1,"issues_closed":732,"prs_open":4,"prs_closed":13,"prs_merged":52,"discussions":95},"growth":{"day":{"stars":1,"forks":0,"base_day":"2026-11-15"},"week":{"stars":-10,"forks":-2,"base_day":"2026-11-04"},"month":{"stars":-17,"forks":-42,"base_day":"2026-10-17"}},"history":{"dates":["2026-09-06","2026-09-07","2026-09-08","2026-09-09","2026-09-10","2026-09-11","2026-09-12","2026-09-13","2026-09-14","2026-09-15","2026-09-16","2026-09-17","2026-09-18","2026-09-19","2026-09-20","2026-09-21","2026-09-22","2026-09-23","2026-09-24","2026-09-25","2026-09-26","2026-09-27","2026-09-28","2026-09-29","2026-09-30","2026-10-01","2026-10-02","2026-10-03","2026-10-04","2026-10-05","2026-10-06","2026-10-07","2026-10-08","2026-10-09","2026-10-10","2026-10-11","2026-10-12","2026-10-13","2026-10-14","2026-10-15","2026-10-16","2026-10-17","2026-10-18","2026-10-19","2026-10-20","2026-10-21","2026-10-22","2026-10-23","2026-10-24","2026-10-25","2026-10-26","2026-10-27","2026-10-28","2026-10-29","2026-10-30","2026-10-31","2026-11-01","2026-11-02","2026-11-03","2026-11-04","2026-11-10","2026-11-11","2026-11-12","2026-11-13","2026-11-14","2026-11-15","2026-11-16"],"stars":[18934,18937,18938,18939,18941,18941,18943,18942,18942,18941,18942,18943,18943,18941,18942,18940,18941,18941,18940,18939,18938,18938,18938,18938,18939,18939,18939,18936,18936,18936,18936,18935,18933,18931,18930,18930,18929,18929,18929,18929,18929,18929,18929,18926,18929,18929,18928,18926,18927,18927,18927,18923,18922,18923,18922,18923,18923,18922,18923,18922,18916,18915,18914,18914,18913,18911,18912],"forks":[1839,1839,1839,1838,1838,1838,1838,1837,1837,1836,1836,1836,1836,1836,1836,1836,1836,1837,1837,1837,1837,1837,1836,1836,1836,1835,1835,1834,1834,1835,1835,1835,1835,1835,1835,1835,1836,1837,1838,1845,1846,1873,1901,1929,1962,1952,1836,1836,1836,1836,1835,1835,1835,1834,1834,1834,1834,1833,1833,1833,1833,1833,1832,1832,1832,1831,1831],"watchers":[184,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,185,186,186,186,186,186,186,186,186,186,186,186,186,186,187,187,187,187,187,187,187,182,182,182,182,182,182,182,182,182,182,182,null,182,182,182,182,182,182],"issues_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,1,1,1,1,1,1],"prs_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,4,4,4,4,4,4]},"boards":{},"same_owner":[{"full_name":"ymcui/Chinese-LLaMA-Alpaca-2","name":"Chinese-LLaMA-Alpaca-2","shard":"1","boards":{}}],"issues":[{"number":817,"title":"是否有基于Llama-2的增量训练模型？","comments":0,"created_at":"2023-08-09T08:54:24Z"}],"discussions":[{"number":902,"title":"是否有微信交流群一类？","comments":0,"category":"General","created_at":"2024-12-20T03:00:07Z"},{"number":901,"title":"请问Llama-Chinese支持或有望支持Llama-3.2-1B和Llama-3.2-3B版本模型吗?","comments":1,"category":"Q&A","created_at":"2024-10-26T10:58:07Z"},{"number":898,"title":"模型的微调支持pytorch2.0.0吗","comments":0,"category":"Q&A","created_at":"2024-06-05T09:46:35Z"},{"number":895,"title":"扩充词表 add_tokens","comments":0,"category":"Q&A","created_at":"2024-05-09T13:14:30Z"},{"number":891,"title":"llama3 有开源的chinese版本吗？","comments":0,"category":"Q&A","created_at":"2024-04-28T09:08:26Z"},{"number":888,"title":"Create training data for pretraining","comments":0,"category":"Q&A","created_at":"2024-03-27T19:44:24Z"},{"number":881,"title":"colab部署使用","comments":1,"category":"Q&A","created_at":"2024-01-22T10:01:53Z"},{"number":878,"title":"ntk上下文扩展","comments":0,"category":"Q&A","created_at":"2024-01-05T08:33:42Z"}],"latest_release":{"name":"民间版中文羊驼模型 v5.0","tag":"v5.0","published_at":"2023-07-19T08:21:15Z","body":"本版本针对模型回复较短的问题进行升级，同时推出Plus-33B系列模型。\r\n\r\n同时，我们也很高兴地向大家宣布新项目启动：[**中文LLaMA-2、Alpaca-2大模型🦙**](https://github.com/ymcui/Chinese-LLaMA-Alpaca-2)\r\n\r\n### 🚀 推出中文Alpaca-Pro系列模型\r\n\r\n- 针对早期Alpaca相关模型回复较短的问题进行优化，使其回复长度接近GPT-3.5/GPT-4\r\n- 推荐所有使用Alpaca系列模型的用户升级至Pro版本（7B/13B/33B），合并方式与Plus模型一致，需要同时融合LLaMA-Plus的LoRA\r\n- 如果更喜欢短回复，可以选择Plus系列模型\r\n\r\n在此特别感谢所有参与beta评测投票的各位社区成员。\r\n\r\n### 🚀  推出LLaMA-Plus-33B、Alpaca-Plus-33B\r\n\r\n- 在基础版33B之上将训练数据扩充至120G，得到LLaMA-Plus-33B；进一步通过指令精调得到Alpaca-Plus-33B\r\n- 在C-Eval、主观体验方面显著优于本项目其他模型\r\n- 本次不再提供GPT-4评价的结果，请通过接下来介绍的ChatBot Arena浏览对比相关模型输出\r\n\r\n### 📊 添加ChatBot Arena\r\n\r\n- 仿照fastchat的方式，添加了模型对战页面，题库进一步扩充至360题\r\n- 评测模型包括所有Alpaca-Plus和Alpaca-Pro系列模型，每个模型包含3个参考输出（随机显示其一）\r\n- 可实时查看总体胜率、Elo评分、两两对战胜率等信息\r\n\r\n对战地址：http://chinese-alpaca-arena.ymcui.com/\r\n\r\n### 🔬 升级NTK-scaling算法，添加Memory Efficient Attention（#743）\r\n\r\n- 升级了NTK-scaling算法，更好地支持长上下文条件下的文本生成\r\n- 可通过参数`alpha`控制上下文扩展长度，支持指定数值和auto两种方式\r\n- 添加了Memory Efficient Attention补丁，显著降低显存消耗，在单张24G显存的显卡上7B模型最大输入长度可达5K+\r\n\r\n具体使用方法见 #743 中的说明。\r\n\r\n### 其他更新与修复\r\n\r\n- 推理脚本inference_hf.py中添加了8比特量化推理支持（#756）\r\n- 修复了推理脚本`repeat_penalty`默认值过高的问题（#760）\r\n\r\n#### For English release note, please refer to [Discussion](https://github.com/ymcui/Chinese-LLaMA-Alpaca/discussions).","is_prerelease":false},"readme":true,"readme_zh":false,"news":[],"stale":false,"snapshot_at":"2026-11-16T09:23:14Z","history_start":"2026-09-06"}