OpenRaiser/NanoResearch

# Build SVG     svg = f'<svg width="{width}" height="{height}" xmlns="http://www.w3.org/2000/svg">'

svg = f'<svg width="{width}" height="{height}" xmlns="http://www.w3.org/2000/svg">'

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

print("  Get a key at: https://aistudio.google.com/apikey")

[Credential-related source omitted]

[Credential-related source omitted]

- Docs: https://huggingface.co/docs/accelerate

- GitHub: https://github.com/huggingface/accelerate

- Version: 1.11.0+ - Tutorial: "Accelerate your scripts" - Examples: https://github.com/huggingface/accelerate/tree/main/examples

- Tutorial: "Accelerate your scripts" - Examples: https://github.com/huggingface/accelerate/tree/main/examples - Used by: HuggingFace Transformers, TRL, PEFT, all HF libraries

- Examples: https://github.com/huggingface/accelerate/tree/main/examples

- Accelerate Plugins: https://huggingface.co/docs/accelerate/package_reference/kwargs

- DeepSpeed Config: https://www.deepspeed.ai/docs/config-json/

- FSDP Guide: https://pytorch.org/docs/stable/fsdp.html

- Custom Training Loops: https://huggingface.co/docs/accelerate/usage_guides/training_tpu

# Clone Megatron-LM repository git clone https://github.com/NVIDIA/Megatron-LM.git

git clone https://github.com/NVIDIA/Megatron-LM.git

# Install Apex (NVIDIA optimizations) git clone https://github.com/NVIDIA/apex

git clone https://github.com/NVIDIA/apex

- Megatron-LM: https://github.com/NVIDIA/Megatron-LM

- Accelerate Megatron docs: https://huggingface.co/docs/accelerate/usage_guides/megatron_lm

- NVIDIA Apex: https://github.com/NVIDIA/apex

[Credential-related source omitted]

- Accelerate Performance: https://huggingface.co/docs/accelerate/usage_guides/performance

- PyTorch Profiler: https://pytorch.org/tutorials/recipes/recipes/profiler_recipe.html

- NCCL Tuning: https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/env.html

- Flash Attention: https://github.com/Dao-AILab/flash-attention

Avoid for frequent eval (too slow):

- GitHub: https://github.com/EleutherAI/lm-evaluation-harness

- Docs: https://github.com/EleutherAI/lm-evaluation-harness/tree/main/docs

- Leaderboard: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard (uses this harness)

[Credential-related source omitted]

lm_eval --model openai-chat-completions    --model_args      model=gpt-4-turbo,     base_url=https://api.openai.com/v1,

base_url=https://api.openai.com/v1,\

[Credential-related source omitted]

lm_eval --model anthropic-chat    --model_args      model=claude-3-5-sonnet-20241022,     base_url=https://api.anthropic.com,

base_url=https://api.anthropic.com,\

lm_eval --model local-completions    --model_args      model=meta-llama/Llama-2-7b-hf,     base_url=http://localhost:8000/v1,

base_url=http://localhost:8000/v1,\

lm_eval --model local-completions    --model_args      model=meta-llama/Llama-2-7b-hf,     base_url=http://localhost:8080/v1

base_url=http://localhost:8080/v1 \

lm_eval --model local-completions    --model_args      model=llama2:7b,     base_url=http://localhost:11434/v1

base_url=http://localhost:11434/v1 \

lm_eval --model local-completions    --model_args      model=llama2,     base_url=http://localhost:8080/v1

base_url=http://localhost:8080/v1 \

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

model = MyCustomAPI(     base_url="https://api.example.com/v1",

base_url="https://api.example.com/v1",

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

curl http://localhost:8000/v1/models

lm_eval --model local-completions    --model_args      base_url=http://api.example.com/v1,

base_url=http://api.example.com/v1,\

lm_eval --model local-completions    --model_args      base_url=https://localhost:8000/v1,

base_url=https://localhost:8000/v1,\

- OpenAI API: https://platform.openai.com/docs/api-reference

- Anthropic API: https://docs.anthropic.com/claude/reference

- HuggingFace Accelerate: https://huggingface.co/docs/accelerate/

- vLLM docs: https://docs.vllm.ai/

- NeMo docs: https://docs.nvidia.com/nemo-framework/

claude mcp add exa -- npx -y mcp-remote "https://mcp.exa.ai/mcp"

"exa": {       "type": "http",       "url": "https://mcp.exa.ai/mcp"

"type": "http",       "url": "https://mcp.exa.ai/mcp"     }

"url": "https://mcp.exa.ai/mcp"

| Source | Key Contribution | Link | |--------|-----------------|------| | **Neel Nanda** (Google DeepMind) | The Narrative Principle, What/Why/So What framework | [How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLp

|--------|-----------------|------| | **Neel Nanda** (Google DeepMind) | The Narrative Principle, What/Why/So What framework | [How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-

| **Neel Nanda** (Google DeepMind) | The Narrative Principle, What/Why/So What framework | [How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) |

| **Sebastian Farquhar** (DeepMind) | 5-sentence abstract formula | [How to Write ML Papers](https://sebastianfarquhar.com/on-research/2024/11/04/how_to_write_ml_papers/) |

| **Gopen & Swan** | 7 principles of reader expectations | [Science of Scientific Writing](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) |

| **Zachary Lipton** | Word choice, eliminating hedging | [Heuristics for Scientific Writing](https://www.approximatelycorrect.com/2018/01/29/heuristics-technical-scientific-writing-machine-learning-perspective/) |

| **Jacob Steinhardt** (UC Berkeley) | Precision, consistent terminology | [Writing Tips](https://bounded-regret.ghost.io/) |

| **Ethan Perez** (Anthropic) | Micro-level clarity tips | [Easy Paper Writing Tips](https://ethanperez.net/easy-paper-writing-tips/) |

def doi_to_bibtex(doi: str) -> str:     """Get verified BibTeX from DOI via CrossRef."""     response = requests.get(

"""Get verified BibTeX from DOI via CrossRef."""     response = requests.get(         f"https://doi.org/{doi}",

response = requests.get(

f"https://doi.org/{doi}",

author    = {{Orchestra Research}},   year      = {2025},   url       = {https://github.com/orchestra-research/AI-research-SKILLs},

year      = {2025},   url       = {https://github.com/orchestra-research/AI-research-SKILLs},   note      = {Open-source skills library enabling AI agents to autonomously conduct AI research}

url       = {https://github.com/orchestra-research/AI-research-SKILLs},

- **VS Code/Cursor**: Install LaTeX Workshop extension + TeX Live → Save to auto-compile - **Command line**: `latexmk -pdf main.tex` or `pdflatex` + `bibtex` workflow - **Online**: Upload to [Overleaf](https://overleaf.com)

- **Online**: Upload to [Overleaf](https://overleaf.com)

**Writing Philosophy:** - [Neel Nanda: How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) - Narrative, "What/Why/So What"

- [Neel Nanda: How to Write ML Papers](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) - Narrative, "What/Why/So What"

- [Farquhar: How to Write ML Papers](https://sebastianfarquhar.com/on-research/2024/11/04/how_to_write_ml_papers/) - 5-sentence abstract

- [Gopen & Swan: Science of Scientific Writing](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) - 7 reader expectation principles

- [Lipton: Heuristics for Scientific Writing](https://www.approximatelycorrect.com/2018/01/29/heuristics-technical-scientific-writing-machine-learning-perspective/) - Word choice

- [Perez: Easy Paper Writing Tips](https://ethanperez.net/easy-paper-writing-tips/) - Micro-level clarity

**APIs:** [Semantic Scholar](https://api.semanticscholar.org/api-docs/) | [CrossRef](https://www.crossref.org/documentation/retrieve-metadata/rest-api/) | [arXiv](https://info.arxiv.org/help/api/basics.html)

**ML/AI Venues:** [NeurIPS](https://neurips.cc/Conferences/2025/PaperInformation/StyleFiles) | [ICML](https://icml.cc/Conferences/2025/AuthorInstructions) | [ICLR](https://iclr.cc/Conferences/2026/AuthorGuide) | [ACL](https://github.com/acl

**Systems Venues:** [OSDI 2026](https://www.usenix.org/conference/osdi26/call-for-papers) | [NSDI 2027](https://www.usenix.org/conference/nsdi27/call-for-papers) | [ASPLOS 2027](https://www.asplos-conference.org/asplos2026/call-for-papers-a

# Check CrossRef (via DOI)     if doi:         resp = requests.get(f"https://api.crossref.org/works/{doi}")

if doi:         resp = requests.get(f"https://api.crossref.org/works/{doi}")         if resp.status_code == 200:

resp = requests.get(f"https://api.crossref.org/works/{doi}")

# Check arXiv     if arxiv_id:         resp = requests.get(

if arxiv_id:         resp = requests.get(             f"http://export.arxiv.org/api/query?id_list={arxiv_id}"

resp = requests.get(

f"http://export.arxiv.org/api/query?id_list={arxiv_id}"

def doi_to_bibtex(doi: str) -> str:     """Get verified BibTeX from DOI via CrossRef content negotiation."""     response = requests.get(

"""Get verified BibTeX from DOI via CrossRef content negotiation."""     response = requests.get(         f"https://doi.org/{doi}",

response = requests.get(

f"https://doi.org/{doi}",

[Credential-related source omitted]

[Credential-related source omitted]

if paper.doi:             try:                 resp = requests.get(

try:                 resp = requests.get(                     f"https://api.crossref.org/works/{paper.doi}",

resp = requests.get(

f"https://api.crossref.org/works/{paper.doi}",

if paper.arxiv_id:             try:                 resp = requests.get(

try:                 resp = requests.get(                     f"http://export.arxiv.org/api/query?id_list={paper.arxiv_id}",

resp = requests.get(

f"http://export.arxiv.org/api/query?id_list={paper.arxiv_id}",

if paper.doi:             try:                 resp = requests.get(

try:                 resp = requests.get(                     f"https://doi.org/{paper.doi}",

resp = requests.get(

f"https://doi.org/{paper.doi}",

**APIs:** - Semantic Scholar: https://api.semanticscholar.org/api-docs/

- Semantic Scholar: https://api.semanticscholar.org/api-docs/

- CrossRef: https://www.crossref.org/documentation/retrieve-metadata/rest-api/

- arXiv: https://info.arxiv.org/help/api/basics.html

- OpenAlex: https://docs.openalex.org/

**Python Libraries:** - `semanticscholar`: https://pypi.org/project/semanticscholar/

- `semanticscholar`: https://pypi.org/project/semanticscholar/

- `arxiv`: https://pypi.org/project/arxiv/

- `habanero` (CrossRef): https://github.com/sckott/habanero

**Verification Tools:** - Citely: https://citely.ai/citation-checker

- Citely: https://citely.ai/citation-checker

- ReciteWorks: https://reciteworks.com/

| Source | Author | URL | Key Contribution | |--------|--------|-----|------------------| | **Highly Opinionated Advice on How to Write ML Papers** | Neel Nanda | [Alignment Forum](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/high

|--------|--------|-----|------------------| | **Highly Opinionated Advice on How to Write ML Papers** | Neel Nanda | [Alignment Forum](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-pape

| **Highly Opinionated Advice on How to Write ML Papers** | Neel Nanda | [Alignment Forum](https://www.alignmentforum.org/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers) | Narrative framework, "What/Why/So What"

| **How to Write ML Papers** | Sebastian Farquhar (DeepMind) | [Blog](https://sebastianfarquhar.com/on-research/2024/11/04/how_to_write_ml_papers/) | 5-sentence abstract formula, structure templates |

| **A Survival Guide to a PhD** | Andrej Karpathy | [Blog](http://karpathy.github.io/2016/09/07/phd/) | Paper structure recipe, contribution framing |

| **Heuristics for Scientific Writing** | Zachary Lipton (CMU) | [Blog](https://www.approximatelycorrect.com/2018/01/29/heuristics-technical-scientific-writing-machine-learning-perspective/) | Word choice, section balance, intensifier warni

| **Advice for Authors** | Jacob Steinhardt (UC Berkeley) | [Blog](https://jsteinhardt.stat.berkeley.edu/blog/advice-for-authors) | Precision over brevity, consistent terminology |

| **Easy Paper Writing Tips** | Ethan Perez (Anthropic) | [Blog](https://ethanperez.net/easy-paper-writing-tips/) | Micro-level tips, apostrophe unfolding, clarity tricks |

| Source | Author | URL | Key Contribution | |--------|--------|-----|------------------| | **The Science of Scientific Writing** | Gopen & Swan | [PDF](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) | Topic/stress position

|--------|--------|-----|------------------| | **The Science of Scientific Writing** | Gopen & Swan | [PDF](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) | Topic/stress positions, old-before-new, 7 principles | | **Summary

| **The Science of Scientific Writing** | Gopen & Swan | [PDF](https://cseweb.ucsd.edu/~swanson/papers/science-of-writing.pdf) | Topic/stress positions, old-before-new, 7 principles |

| **Summary of Science of Scientific Writing** | Lawrence Crowl | [Summary](https://www.crowl.org/Lawrence/writing/GopenSwan90.html) | Condensed version of Gopen & Swan |

| Source | URL | Key Contribution | |--------|-----|------------------| | How To Write A Research Paper In ML | [Blog](https://grigorisg9gr.github.io/machine%20learning/research%20paper/how-to-write-a-research-paper-in-machine-learning/) | 

|--------|-----|------------------| | How To Write A Research Paper In ML | [Blog](https://grigorisg9gr.github.io/machine%20learning/research%20paper/how-to-write-a-research-paper-in-machine-learning/) | Practical walkthrough, LaTeX tips | 

| How To Write A Research Paper In ML | [Blog](https://grigorisg9gr.github.io/machine%20learning/research%20paper/how-to-write-a-research-paper-in-machine-learning/) | Practical walkthrough, LaTeX tips |

| A Recipe for Training Neural Networks | [Karpathy Blog](http://karpathy.github.io/2019/04/25/recipe/) | Debugging methodology that translates to paper structure |

| ICML Paper Writing Best Practices | [ICML](https://icml.cc/Conferences/2022/BestPractices) | Official venue guidance |

| Bill Freeman's Writing Slides | [MIT](https://billf.mit.edu/sites/default/files/documents/cvprPapers.pdf) | Visual guide to paper structure |

| Document | URL | Purpose | |----------|-----|---------| | Paper Checklist Guidelines | [NeurIPS](https://neurips.cc/public/guides/PaperChecklist) | 16-item mandatory checklist |

|----------|-----|---------| | Paper Checklist Guidelines | [NeurIPS](https://neurips.cc/public/guides/PaperChecklist) | 16-item mandatory checklist | | Reviewer Guidelines 2025 | [NeurIPS](https://neurips.cc/Conferences/2025/ReviewerGuidel

| Paper Checklist Guidelines | [NeurIPS](https://neurips.cc/public/guides/PaperChecklist) | 16-item mandatory checklist |

| Reviewer Guidelines 2025 | [NeurIPS](https://neurips.cc/Conferences/2025/ReviewerGuidelines) | Evaluation criteria, scoring |

| Style Files | [NeurIPS](https://neurips.cc/Conferences/2025/PaperInformation/StyleFiles) | LaTeX templates |

| Document | URL | Purpose | |----------|-----|---------| | Paper Guidelines | [ICML](https://icml.cc/Conferences/2024/PaperGuidelines) | Submission requirements |

|----------|-----|---------| | Paper Guidelines | [ICML](https://icml.cc/Conferences/2024/PaperGuidelines) | Submission requirements | | Reviewer Instructions 2025 | [ICML](https://icml.cc/Conferences/2025/ReviewerInstructions) | Review for

| Paper Guidelines | [ICML](https://icml.cc/Conferences/2024/PaperGuidelines) | Submission requirements |

| Reviewer Instructions 2025 | [ICML](https://icml.cc/Conferences/2025/ReviewerInstructions) | Review form, evaluation |

| Style & Author Instructions | [ICML](https://icml.cc/Conferences/2022/StyleAuthorInstructions) | Formatting specifications |

| Document | URL | Purpose | |----------|-----|---------| | Author Guide 2026 | [ICLR](https://iclr.cc/Conferences/2026/AuthorGuide) | Submission requirements, LLM disclosure |

|----------|-----|---------| | Author Guide 2026 | [ICLR](https://iclr.cc/Conferences/2026/AuthorGuide) | Submission requirements, LLM disclosure | | Reviewer Guide 2025 | [ICLR](https://iclr.cc/Conferences/2025/ReviewerGuide) | Review proc

| Author Guide 2026 | [ICLR](https://iclr.cc/Conferences/2026/AuthorGuide) | Submission requirements, LLM disclosure |

| Reviewer Guide 2025 | [ICLR](https://iclr.cc/Conferences/2025/ReviewerGuide) | Review process, evaluation |

| Document | URL | Purpose | |----------|-----|---------| | ACL Style Files | [GitHub](https://github.com/acl-org/acl-style-files) | LaTeX templates |

|----------|-----|---------| | ACL Style Files | [GitHub](https://github.com/acl-org/acl-style-files) | LaTeX templates | | ACL Rolling Review | [ARR](https://aclrollingreview.org/) | Submission process |

| ACL Style Files | [GitHub](https://github.com/acl-org/acl-style-files) | LaTeX templates |

| ACL Rolling Review | [ARR](https://aclrollingreview.org/) | Submission process |

| Document | URL | Purpose | |----------|-----|---------| | Author Kit 2026 | [AAAI](https://aaai.org/authorkit26/) | Templates and guidelines |

| Author Kit 2026 | [AAAI](https://aaai.org/authorkit26/) | Templates and guidelines |

| Document | URL | Purpose | |----------|-----|--------| | Template | [GitHub](https://github.com/COLM-org/Template) | LaTeX templates |

| Template | [GitHub](https://github.com/COLM-org/Template) | LaTeX templates |

| Document | URL | Purpose | |----------|-----|--------| | OSDI '26 Call for Papers | [USENIX](https://www.usenix.org/conference/osdi26/call-for-papers) | Submission requirements, deadlines, tracks |

|----------|-----|--------| | OSDI '26 Call for Papers | [USENIX](https://www.usenix.org/conference/osdi26/call-for-papers) | Submission requirements, deadlines, tracks | | OSDI '26 CFP PDF | [PDF](https://www.usenix.org/sites/default/files

| OSDI '26 Call for Papers | [USENIX](https://www.usenix.org/conference/osdi26/call-for-papers) | Submission requirements, deadlines, tracks |

| OSDI '26 CFP PDF | [PDF](https://www.usenix.org/sites/default/files/osdi26_cfp_121525.pdf) | Downloadable CFP |

| USENIX Paper Templates | [USENIX](https://www.usenix.org/conferences/author-resources/paper-templates) | LaTeX/Word templates |

| Document | URL | Purpose | |----------|-----|--------| | NSDI '27 Call for Papers | [USENIX](https://www.usenix.org/conference/nsdi27/call-for-papers) | Submission requirements, tracks, prescreening |

|----------|-----|--------| | NSDI '27 Call for Papers | [USENIX](https://www.usenix.org/conference/nsdi27/call-for-papers) | Submission requirements, tracks, prescreening | | NSDI '27 CFP PDF | [PDF](https://www.usenix.org/sites/default/fi

| NSDI '27 Call for Papers | [USENIX](https://www.usenix.org/conference/nsdi27/call-for-papers) | Submission requirements, tracks, prescreening |

| NSDI '27 CFP PDF | [PDF](https://www.usenix.org/sites/default/files/nsdi27_cfp_020326.pdf) | Downloadable CFP |

| Document | URL | Purpose | |----------|-----|--------| | ASPLOS '27 Call for Papers | [ASPLOS](https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/) | Submission requirements, rapid review, deadlines |

|----------|-----|--------| | ASPLOS '27 Call for Papers | [ASPLOS](https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/) | Submission requirements, rapid review, deadlines | | ACM Proceedings Template | [ACM](https://www.

| ASPLOS '27 Call for Papers | [ASPLOS](https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/) | Submission requirements, rapid review, deadlines |

| ACM Proceedings Template | [ACM](https://www.acm.org/publications/proceedings-template) | `acmart.cls` template |

| Document | URL | Purpose | |----------|-----|--------| | SOSP '26 Call for Papers | [SOSP](https://sigops.org/s/conferences/sosp/2026/cfp.html) | Submission requirements, artifact evaluation |

|----------|-----|--------| | SOSP '26 Call for Papers | [SOSP](https://sigops.org/s/conferences/sosp/2026/cfp.html) | Submission requirements, artifact evaluation | | ACM SIGPLAN Template | [ACM](https://www.acm.org/publications/proceeding

| SOSP '26 Call for Papers | [SOSP](https://sigops.org/s/conferences/sosp/2026/cfp.html) | Submission requirements, artifact evaluation |

| ACM SIGPLAN Template | [ACM](https://www.acm.org/publications/proceedings-template) | `acmart.cls` with `sigplan` option |

| API | Documentation | Best For | |-----|---------------|----------| | **Semantic Scholar** | [Docs](https://api.semanticscholar.org/api-docs/) | ML/AI papers, citation graphs |

|-----|---------------|----------| | **Semantic Scholar** | [Docs](https://api.semanticscholar.org/api-docs/) | ML/AI papers, citation graphs | | **CrossRef** | [Docs](https://www.crossref.org/documentation/retrieve-metadata/rest-api/) | DO

| **Semantic Scholar** | [Docs](https://api.semanticscholar.org/api-docs/) | ML/AI papers, citation graphs |

| **CrossRef** | [Docs](https://www.crossref.org/documentation/retrieve-metadata/rest-api/) | DOI lookup, BibTeX retrieval |

| **arXiv** | [Docs](https://info.arxiv.org/help/api/basics.html) | Preprints, PDF access |

| **OpenAlex** | [Docs](https://docs.openalex.org/) | Open alternative, bulk access |

| Tool | URL | Purpose | |------|-----|---------| | Citely | [citely.ai](https://citely.ai/citation-checker) | Batch verification |

|------|-----|---------| | Citely | [citely.ai](https://citely.ai/citation-checker) | Batch verification | | ReciteWorks | [reciteworks.com](https://reciteworks.com/) | In-text citation checking |

| Citely | [citely.ai](https://citely.ai/citation-checker) | Batch verification |

| ReciteWorks | [reciteworks.com](https://reciteworks.com/) | In-text citation checking |

| Tool | URL | Purpose | |------|-----|---------| | PlotNeuralNet | [GitHub](https://github.com/HarisIqbal88/PlotNeuralNet) | TikZ neural network diagrams |

|------|-----|---------| | PlotNeuralNet | [GitHub](https://github.com/HarisIqbal88/PlotNeuralNet) | TikZ neural network diagrams | | SciencePlots | [GitHub](https://github.com/garrettj403/SciencePlots) | Publication-ready matplotlib |

| PlotNeuralNet | [GitHub](https://github.com/HarisIqbal88/PlotNeuralNet) | TikZ neural network diagrams |

| SciencePlots | [GitHub](https://github.com/garrettj403/SciencePlots) | Publication-ready matplotlib |

| Okabe-Ito Palette | [Reference](https://jfly.uni-koeln.de/color/) | Colorblind-safe colors |

| Resource | URL | Purpose | |----------|-----|---------| | Overleaf Templates | [Overleaf](https://www.overleaf.com/latex/templates) | Online LaTeX editor |

|----------|-----|---------| | Overleaf Templates | [Overleaf](https://www.overleaf.com/latex/templates) | Online LaTeX editor | | BibLaTeX Guide | [CTAN](https://ctan.org/pkg/biblatex) | Modern citation management |

| Overleaf Templates | [Overleaf](https://www.overleaf.com/latex/templates) | Online LaTeX editor |

| BibLaTeX Guide | [CTAN](https://ctan.org/pkg/biblatex) | Modern citation management |

| Source | URL | Key Finding | |--------|-----|-------------| | AI Hallucinations in Citations | [Enago](https://www.enago.com/academy/ai-hallucinations-research-citations/) | ~40% error rate |

|--------|-----|-------------| | AI Hallucinations in Citations | [Enago](https://www.enago.com/academy/ai-hallucinations-research-citations/) | ~40% error rate | | Hallucination in AI Writing | [PMC](https://pmc.ncbi.nlm.nih.gov/articles/P

| AI Hallucinations in Citations | [Enago](https://www.enago.com/academy/ai-hallucinations-research-citations/) | ~40% error rate |

| Hallucination in AI Writing | [PMC](https://pmc.ncbi.nlm.nih.gov/articles/PMC10726751/) | Types of citation errors |

| NeurIPS 2025 AI Report | [ByteIota](https://byteiota.com/neurips-2025-100-ai-hallucinations-slip-through-review/) | 100+ hallucinated citations |

- **OSDI 2026**: <https://www.usenix.org/conference/osdi26/call-for-papers>

- **NSDI 2027**: <https://www.usenix.org/conference/nsdi27/call-for-papers>

- **ASPLOS 2027**: <https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/>

- **SOSP 2026**: <https://sigops.org/s/conferences/sosp/2026/cfp.html>

- **USENIX LaTeX Template**: <https://www.usenix.org/conferences/author-resources/paper-templates>

- **ACM SIGPLAN Template**: <https://www.acm.org/publications/proceedings-template>

**Setup:** 1. Install [TeX Live](https://www.tug.org/texlive/) (full distribution recommended)

1. Install [TeX Live](https://www.tug.org/texlive/) (full distribution recommended)

- macOS: `brew install --cask mactex`    - Ubuntu: `sudo apt install texlive-full`    - Windows: Download from [tug.org/texlive](https://www.tug.org/texlive/)

- Ubuntu: `sudo apt install texlive-full`

- Windows: Download from [tug.org/texlive](https://www.tug.org/texlive/)

1. Go to [overleaf.com](https://www.overleaf.com)

| Conference | Directory | Year | Source | |------------|-----------|------|--------| | ICML | `icml2026/` | 2026 | [Official ICML](https://icml.cc/Conferences/2026/AuthorInstructions) |

|------------|-----------|------|--------| | ICML | `icml2026/` | 2026 | [Official ICML](https://icml.cc/Conferences/2026/AuthorInstructions) | | ICLR | `iclr2026/` | 2026 | [Official GitHub](https://github.com/ICLR/Master-Template) |

| ICML | `icml2026/` | 2026 | [Official ICML](https://icml.cc/Conferences/2026/AuthorInstructions) |

| ICLR | `iclr2026/` | 2026 | [Official GitHub](https://github.com/ICLR/Master-Template) |

| NeurIPS | `neurips2025/` | 2025 | Community template | | ACL | `acl/` | 2025+ | [Official ACL](https://github.com/acl-org/acl-style-files) | | AAAI | `aaai2026/` | 2026 | [AAAI Author Kit](https://aaai.org/authorkit26/) |

| ACL | `acl/` | 2025+ | [Official ACL](https://github.com/acl-org/acl-style-files) |

| AAAI | `aaai2026/` | 2026 | [AAAI Author Kit](https://aaai.org/authorkit26/) |

| COLM | `colm2025/` | 2025 | [Official COLM](https://github.com/COLM-org/Template) |

| Conference | Directory | Year | Template Type | Source | |------------|-----------|------|---------------|--------| | OSDI | `osdi2026/` | 2026 | USENIX | [OSDI '26 CFP](https://www.usenix.org/conference/osdi26/call-for-papers) |

|------------|-----------|------|---------------|--------| | OSDI | `osdi2026/` | 2026 | USENIX | [OSDI '26 CFP](https://www.usenix.org/conference/osdi26/call-for-papers) | | NSDI | `nsdi2027/` | 2027 | USENIX | [NSDI '27 CFP](https://www.u

| OSDI | `osdi2026/` | 2026 | USENIX | [OSDI '26 CFP](https://www.usenix.org/conference/osdi26/call-for-papers) |

| NSDI | `nsdi2027/` | 2027 | USENIX | [NSDI '27 CFP](https://www.usenix.org/conference/nsdi27/call-for-papers) |

| ASPLOS | `asplos2027/` | 2027 | ACM SIGPLAN | [ASPLOS '27 CFP](https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/) |

| SOSP | `sosp2026/` | 2026 | ACM SIGPLAN | [SOSP '26 CFP](https://sigops.org/s/conferences/sosp/2026/cfp.html) |

Key files: - `acmart.cls` - ACM document class (download from [ACM](https://www.acm.org/publications/proceedings-template))

- `acmart.cls` - ACM document class (download from [ACM](https://www.acm.org/publications/proceedings-template))

Templates are updated annually. Check official sources before each submission: **ML/AI:** - ICML: https://icml.cc/

**ML/AI:** - ICML: https://icml.cc/ - ICLR: https://iclr.cc/

- ICML: https://icml.cc/

- ICLR: https://iclr.cc/

- NeurIPS: https://neurips.cc/

- ACL: https://github.com/acl-org/acl-style-files

- AAAI: https://aaai.org/

- COLM: https://colmweb.org/

**Systems - OSDI: https://www.usenix.org/conference/osdi26/call-for-papers

- OSDI: https://www.usenix.org/conference/osdi26/call-for-papers

- NSDI: https://www.usenix.org/conference/nsdi27/call-for-papers

- ASPLOS: https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/

- SOSP: https://sigops.org/s/conferences/sosp/2026/cfp.html

- USENIX Templates: https://www.usenix.org/conferences/author-resources/paper-templates

- ACM Templates: https://www.acm.org/publications/proceedings-template

**📖 在线阅读和测试模板**: [https://cn.overleaf.com/read/wyhcnvcrtpyt#cd4a07](https://cn.overleaf.com/read/wyhcnvcrtpyt#cd4a07)

**📖 Online View and Test Template**: [https://cn.overleaf.com/read/wyhcnvcrtpyt#cd4a07](https://cn.overleaf.com/read/wyhcnvcrtpyt#cd4a07)

Written by AAAI Press Staff\textsuperscript{\rm 1}\thanks{With help from the AAAI Publications Committee.}\\

\textsuperscript{\rm 1}Association for the Advancement of Artificial Intelligence\\

Written by AAAI Press Staff\textsuperscript{\rm 1}\thanks{With help from the AAAI Publications Committee.}\\

\textsuperscript{\rm 1}Association for the Advancement of Artificial Intelligence\\

% Sunil Issar\textsuperscript{\rm 2},

% J. Scott Penberthy\textsuperscript{\rm 3},

% George Ferguson\textsuperscript{\rm 4},

% Hans Guesgen\textsuperscript{\rm 5}

First Author Name\textsuperscript{\rm 1},

Second Author Name\textsuperscript{\rm 2},

Third Author Name\textsuperscript{\rm 1}

\textsuperscript{\rm 1}Affiliation 1\\

\textsuperscript{\rm 2}Affiliation 2\\

% NOTE: For anonymous submissions, do not include links that could reveal your identity % \begin{links} %     \link{Code}{https://aaai.org/example/code}

% \begin{links} %     \link{Code}{https://aaai.org/example/code} %     \link{Datasets}{https://aaai.org/example/datasets}

%     \link{Code}{https://aaai.org/example/code}

%     \link{Datasets}{https://aaai.org/example/datasets}

%     \link{Extended version}{https://aaai.org/example/extended-version}

% You must keep this block between (not within) the abstract and the main body of the paper. \begin{links}     \link{Code}{https://aaai.org/example/code}

\begin{links}     \link{Code}{https://aaai.org/example/code}     \link{Datasets}{https://aaai.org/example/datasets}

\link{Code}{https://aaai.org/example/code}

\link{Datasets}{https://aaai.org/example/datasets}

\link{Extended version}{https://aaai.org/example/extended-version}

\begin{scriptsize}\begin{verbatim} \begin{links}   \link{Code}{https://aaai.org/example/guidelines}

\begin{links}   \link{Code}{https://aaai.org/example/guidelines}   \link{Datasets}{https://aaai.org/example/datasets}

\link{Code}{https://aaai.org/example/guidelines}

\link{Datasets}{https://aaai.org/example/datasets}

\link{Extended version}{https://aaai.org/example}

\subsubsection{Obtaining Type 1 Computer Modern for \LaTeX{}.} If you use Computer Modern for the mathematics in your paper (you cannot use it for the text) you may need to download type 1 Computer fonts. They are available without charge f

http://www.ams.org/tex/type1-fonts.html.

\subsection{Title and Authors} Your title must appear centered over both text columns in sixteen-point bold type (twenty-four point leading). The title must be written in Title Case capitalization rules (not sentence case). The rules are a 

Your title must appear centered over both text columns in sixteen-point bold type (twenty-four point leading). The title must be written in Title Case capitalization rules (not sentence case). The rules are a bit involved, but in general ve

\noindent For authors from different institutions, use \textbackslash textsuperscript \{\textbackslash rm x \} to match authors and affiliations. Notice that there should not be any spaces between the author name (or comma following it) and

AuthorOne\equalcontrib\textsuperscript{\rm 1,\rm 2},

AuthorTwo\equalcontrib\textsuperscript{\rm 2},

AuthorThree\textsuperscript{\rm 3},\\

AuthorFour\textsuperscript{\rm 4},

AuthorFive \textsuperscript{\rm 5}}

\textsuperscript{\rm 1}AffiliationOne,\\

\textsuperscript{\rm 2}AffiliationTwo,\\

\textsuperscript{\rm 3}AffiliationThree,\\

\textsuperscript{\rm 4}AffiliationFour,\\

\textsuperscript{\rm 5}AffiliationFive\\

@misc(key,   [...]   howpublished="\url{http://...}",

[...]   howpublished="\url{http://...}",   note="Accessed: YYYY-mm-dd",

howpublished="\url{http://...}",

\vspace{.2em} For the most up to date version of the AAAI reference style, please consult the \textit{AI Magazine} Author Guidelines at \url{https://aaai.org/ojs/index.php/aimagazine/about/submissions#authorGuidelines}

For the most up to date version of the AAAI reference style, please consult the \textit{AI Magazine} Author Guidelines at \url{https://aaai.org/ojs/index.php/aimagazine/about/submissions#authorGuidelines}

publisher = {American Association for the Advancement of Science},   issn = {0036-8075},   URL = {https://science.sciencemag.org/content/208/4447/1019},

issn = {0036-8075},   URL = {https://science.sciencemag.org/content/208/4447/1019},   eprint = {https://science.sciencemag.org/content/208/4447/1019.full.pdf},

URL = {https://science.sciencemag.org/content/208/4447/1019},

eprint = {https://science.sciencemag.org/content/208/4447/1019.full.pdf},

year = {1984}, issn = {0020-7373}, doi = {https://doi.org/10.1016/S0020-7373(84)80003-6},

issn = {0020-7373}, doi = {https://doi.org/10.1016/S0020-7373(84)80003-6}, url = {https://www.sciencedirect.com/science/article/pii/S0020737384800036},

doi = {https://doi.org/10.1016/S0020-7373(84)80003-6},

url = {https://www.sciencedirect.com/science/article/pii/S0020737384800036},

title        = "Pluto: The 'Other' Red Planet",   author       = "{NASA}",   howpublished = "\url{https://www.nasa.gov/nh/pluto-the-other-red-planet}",

author       = "{NASA}",   howpublished = "\url{https://www.nasa.gov/nh/pluto-the-other-red-planet}",   year         = 2015,

howpublished = "\url{https://www.nasa.gov/nh/pluto-the-other-red-planet}",

\@ifpackageloaded{bbm}%     {%       \PackageError{aaai}{You must not use bbm package in AAAI papers because it introduces Type 3 fonts which are forbidden.}{See https://tex.stackexchange.com/questions/479160/a-replacement-to-mathbbm1-with-

{%       \PackageError{aaai}{You must not use bbm package in AAAI papers because it introduces Type 3 fonts which are forbidden.}{See https://tex.stackexchange.com/questions/479160/a-replacement-to-mathbbm1-with-type-1-fonts for possible al

\PackageError{aaai}{You must not use bbm package in AAAI papers because it introduces Type 3 fonts which are forbidden.}{See https://tex.stackexchange.com/questions/479160/a-replacement-to-mathbbm1-with-type-1-fonts for possible alternative

- as an [Overleaf template](https://www.overleaf.com/latex/templates/association-for-computational-linguistics-acl-conference/jvxskxpnznfj)

- as a [.zip file](https://github.com/acl-org/acl-style-files/archive/refs/heads/master.zip)

Please see [`acl_latex.tex`](https://github.com/acl-org/acl-style-files/blob/master/acl_latex.tex) for an example.

- [Paper formatting guidelines](https://acl-org.github.io/ACLPUB/formatting.html)

- git pull from github to a local repository - then, git push from your local repository to overleaf project      - Overleaf project is https://www.overleaf.com/project/5f64f1fb97c4c50001b60549

- then, git push from your local repository to overleaf project      - Overleaf project is https://www.overleaf.com/project/5f64f1fb97c4c50001b60549     - Overleaf git url is https://git.overleaf.com/5f64f1fb97c4c50001b60549

- Overleaf project is https://www.overleaf.com/project/5f64f1fb97c4c50001b60549

- Overleaf git url is https://git.overleaf.com/5f64f1fb97c4c50001b60549

% The official sources can be found at % %     https://github.com/acl-org/acl-style-files/

% %     https://github.com/acl-org/acl-style-files/ %

%     https://github.com/acl-org/acl-style-files/

\ifacl@linenumbers   % Add draft line numbering via the lineno package   % https://texblog.org/2012/02/08/adding-line-numbers-to-documents/

% Add draft line numbering via the lineno package   % https://texblog.org/2012/02/08/adding-line-numbers-to-documents/   \usepackage[switch,mathlines]{lineno}

% https://texblog.org/2012/02/08/adding-line-numbers-to-documents/

% Patch amsmath commands so that the previous line and the equation itself   % are numbered. Bug: multline has an extra line number.   % https://tex.stackexchange.com/questions/461186/how-to-use-lineno-with-amsmath-align

% are numbered. Bug: multline has an extra line number.   % https://tex.stackexchange.com/questions/461186/how-to-use-lineno-with-amsmath-align   \usepackage{etoolbox} %% <- for \pretocmd, \apptocmd and \patchcmd

% https://tex.stackexchange.com/questions/461186/how-to-use-lineno-with-amsmath-align

% For Vietnamese characters % \usepackage[T5]{fontenc} % See https://www.latex-project.org/help/documentation/encguide.pdf for other character sets

% See https://www.latex-project.org/help/documentation/encguide.pdf for other character sets

These instructions are for authors submitting papers to *ACL conferences using \LaTeX. They are not self-contained. All authors must follow the general instructions for *ACL proceedings,\footnote{\url{http://acl-org.github.io/ACLPUB/formatt

You can obtain the complete ACL Anthology as a Bib\TeX{} file from \url{https://aclweb.org/anthology/anthology.bib.gz}.

%%% Modification of BibTeX style file acl_natbib_nourl.bst %%% ... by urlbst, version 0.9.1 (marked with "% urlbst") %%% See <https://purl.org/nxg/dist/urlbst> and repository <https://heptapod.host/nxg/urlbst>

%%% ... by urlbst, version 0.9.1 (marked with "% urlbst") %%% See <https://purl.org/nxg/dist/urlbst> and repository <https://heptapod.host/nxg/urlbst> %%% Modifications Copyright 2002–23, Norman Gray,

%%% See <https://purl.org/nxg/dist/urlbst> and repository <https://heptapod.host/nxg/urlbst>

"online" 'onlinestring :=	% label that a resource is online   "[link]" 'linktextstring :=	% anonymous link text   "http://www.ncbi.nlm.nih.gov/pubmed/" 'pubmedurl :=	% prefix to make URL from PUBMED

"[link]" 'linktextstring :=	% anonymous link text   "http://www.ncbi.nlm.nih.gov/pubmed/" 'pubmedurl :=	% prefix to make URL from PUBMED   "https://doi.org/" 'doiurl :=	% prefix to make URL from DOI

"http://www.ncbi.nlm.nih.gov/pubmed/" 'pubmedurl :=	% prefix to make URL from PUBMED

"https://doi.org/" 'doiurl :=	% prefix to make URL from DOI

"doi:" 'doiprefix :=	% printed text to introduce DOI   "https://arxiv.org/abs/" 'eprinturl :=	% prefix to make URL from eprint ref   "cited " 'citedstring :=	% label in "lastchecked" remark

"https://arxiv.org/abs/" 'eprinturl :=	% prefix to make URL from eprint ref

{ doi empty$     { "" }     { doi parse.doi % leaves "https://doi.org/DOI" DOI on the stack

{ "" }     { doi parse.doi % leaves "https://doi.org/DOI" DOI on the stack       's := 't :=

{ doi parse.doi % leaves "https://doi.org/DOI" DOI on the stack

% then don't print the URL (thanks to Joseph Wright       % for (the original version of) this code,       % at http://tex.stackexchange.com/questions/5660)

% for (the original version of) this code,       % at http://tex.stackexchange.com/questions/5660)       adddoi

% at http://tex.stackexchange.com/questions/5660)

% author, note, year, month, and lastchecked fields optional % See references %   ISO 690-2 http://www.nlc-bnc.ca/iso/tc46sc9/standard/690-2e.htm

% See references %   ISO 690-2 http://www.nlc-bnc.ca/iso/tc46sc9/standard/690-2e.htm %   http://www.classroom.net/classroom/CitingNetResources.html

%   ISO 690-2 http://www.nlc-bnc.ca/iso/tc46sc9/standard/690-2e.htm

%   http://www.classroom.net/classroom/CitingNetResources.html

%   http://neal.ctstateu.edu/history/cite.html

%   http://www.cas.usf.edu/english/walker/mla.html

For example, https://aclanthology.org/N04-1035 can be cited as \cite{galley-etal-2004-whats}.

The consolidated file can be downloaded from here: - https://aclanthology.org/anthology.bib

- https://aclanthology.org/anthology.bib

There are currently (2025) two files: - https://aclanthology.org/anthology-1.bib

- https://aclanthology.org/anthology-1.bib

- https://aclanthology.org/anthology-2.bib

volume    = {arXiv:1503.06733},     year      = {2015},     url       = {http://arxiv.org/abs/1503.06733},

year      = {2015},     url       = {http://arxiv.org/abs/1503.06733},     note    = {version 2}

url       = {http://arxiv.org/abs/1503.06733},

> https://acl-org.github.io/ACLPUB/

Long titles should be typed on two lines without a blank line intervening. Put the title 2.5 cm from the top of the page. Write the title in [title case](https://apastyle.apa.org/style-grammar-guidelines/capitalization/title-case); do not w

Write the title in [title case](https://apastyle.apa.org/style-grammar-guidelines/capitalization/title-case); do not write the title in all capital letters, except for acronyms (e.g., "BLEU") or proper nouns ("English") that are normally up

Provide as complete a citation as possible, using a consistent format, such as the [one for Computational Linguistics](http://cljournal.org/style_guide_refs.html) or the one in the [Publication Manual of the American Psychological Associati

All references are required to contain DOIs of all cited works when possible, or, as a second resort, links to ACL Anthology pages. Appropriate records should be found for most materials in the current [ACL Anthology](https://aclweb.org/ant

Appropriate records should be found for most materials in the current [ACL Anthology](https://aclweb.org/anthology/).

> Rie Kubota Ando and Tong Zhang. 2005. [A framework for learning predictive structures from multiple tasks and unlabeled data](https://www.jmlr.org/papers/v6/ando05a.html). *Journal of Machine Learning Research*, 6:1817–1853.

> Galen Andrew and Jianfeng Gao. 2007. [Scalable training of L1-regularized log-linear models](https://doi.org/10.1145/1273496.1273501). In *Proceedings of the 24th International Conference on Machine Learning*, pages 33–40.

> James Goodman, Andreas Vlachos, and Jason Naradowsky. 2016. [Noise reduction and targeted exploration in imitation learning for Abstract Meaning Representation parsing](http://dx.doi.org/10.18653/v1/P16-1001). In *Proceedings of the 54th 

> Benjamin Börschinger and Mark Johnson. 2011. [A particle filter algorithm for Bayesian word segmentation](https://www.aclweb.org/anthology/U11-1004/). In *Proceedings of the Australasian Language Technology Association Workshop 2011*, pag

> Mohammad Sadegh Rasooli and Joel R. Tetreault. 2015. [Yara parser: A fast and accurate dependency parser](http://arxiv.org/abs/1503.06733). *Computing Research Repository*, arXiv:1503.06733. Version 2.

% Uses acmart.cls with sigplan option % % Official CFP: https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/

% % Official CFP: https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/ % ACM Template: https://www.acm.org/publications/proceedings-template

% Official CFP: https://www.asplos-conference.org/asplos2026/call-for-papers-asplos27/

% ACM Template: https://www.acm.org/publications/proceedings-template

publisher = {Curran Associates, Inc.},  title = {Attention is All you Need},  url = {https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf},

title = {Attention is All you Need},  url = {https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf},  volume = {30},

url = {https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf},

COLM requires electronic submissions, processed by \url{https://openreview.net/}. See COLM's website for more instructions.

\url{https://openreview.net/}. See COLM's website for more instructions.

The style files for COLM and other conference information are available online at: \begin{center}    \url{http://www.colmweb.org/}

\begin{center}    \url{http://www.colmweb.org/} \end{center}

\url{http://www.colmweb.org/}

We strongly recommend following arXiv's guidelines for making your paper friendly for HTML conversion: \url{https://info.arxiv.org/help/submit_latex_best_practices.html}.

\end{verbatim} for .pdf graphics. See section~4.4 in the graphics bundle documentation (\url{http://www.ctan.org/tex-archive/macros/latex/required/graphics/grfguide.ps})

See section~4.4 in the graphics bundle documentation (\url{http://www.ctan.org/tex-archive/macros/latex/required/graphics/grfguide.ps})

% rm is already a command, just don't name any random variables m

% Optional math commands from https://github.com/goodfeli/dlbook_notation.

ICLR requires electronic submissions, processed by \url{https://openreview.net/}. See ICLR's website for more instructions.

\url{https://openreview.net/}. See ICLR's website for more instructions.

The style files for ICLR and other conference information are available online at: \begin{center}    \url{http://www.iclr.cc/}

\begin{center}    \url{http://www.iclr.cc/} \end{center}

\url{http://www.iclr.cc/}

notation file from the textbook, \textit{Deep Learning} \cite{goodfellow2016deep} available at \url{https://github.com/goodfeli/dlbook_notation/}.  Use of this style

\cite{goodfellow2016deep} available at \url{https://github.com/goodfeli/dlbook_notation/}.  Use of this style is not required and can be disabled by commenting out

\url{https://github.com/goodfeli/dlbook_notation/}.  Use of this style

\end{verbatim} for .pdf graphics. See section~4.4 in the graphics bundle documentation (\url{http://www.ctan.org/tex-archive/macros/latex/required/graphics/grfguide.ps})

See section~4.4 in the graphics bundle documentation (\url{http://www.ctan.org/tex-archive/macros/latex/required/graphics/grfguide.ps})

% rm is already a command, just don't name any random variables m

are available on the conference web site at: \begin{center}   \texttt{http://icml.cc/}

\begin{center}   \texttt{http://icml.cc/} \end{center}

\texttt{http://icml.cc/}

for everyone including people with disabilities and sensory or neurological differences. Tips of how to achieve this and what to pay attention to will be provided on the conference website \url{http://icml.cc/}.

provided on the conference website \url{http://icml.cc/}.

%% license is in: %%  %%    http://www.latex-project.org/lppl.txt

%%  %%    http://www.latex-project.org/lppl.txt %%

%%    http://www.latex-project.org/lppl.txt

Executable file

upgrade: 	curl -O https://media.neurips.cc/Conferences/NeurIPS$(YEAR)/Styles.zip

curl -O https://media.neurips.cc/Conferences/NeurIPS$(YEAR)/Styles.zip

%         Two-column, 10pt on 12pt leading, Times Roman % % Official CFP: https://www.usenix.org/conference/nsdi27/call-for-papers

% % Official CFP: https://www.usenix.org/conference/nsdi27/call-for-papers % Template source: https://www.usenix.org/conferences/author-resources/paper-templates

% Official CFP: https://www.usenix.org/conference/nsdi27/call-for-papers

% Template source: https://www.usenix.org/conferences/author-resources/paper-templates

%   {\rm Author One}\\

%   {\rm Author Two}\\

type        = {RFC},   number      = {2992},   note        = {\url{https://www.rfc-editor.org/rfc/rfc2992}},

number      = {2992},   note        = {\url{https://www.rfc-editor.org/rfc/rfc2992}}, }

note        = {\url{https://www.rfc-editor.org/rfc/rfc2992}},

% % This is the official USENIX style for conferences including OSDI, NSDI, ATC, etc. % Source: https://www.usenix.org/conferences/author-resources/paper-templates

% This is the official USENIX style for conferences including OSDI, NSDI, ATC, etc. % Source: https://www.usenix.org/conferences/author-resources/paper-templates %

% Source: https://www.usenix.org/conferences/author-resources/paper-templates

% NOTE: This is a simplified version for template purposes. % For the latest official version, download from: % https://www.usenix.org/conferences/author-resources/paper-templates

% https://www.usenix.org/conferences/author-resources/paper-templates

% Camera-ready: <= 14 pages (2 extra pages allowed) % % Official CFP: https://www.usenix.org/conference/osdi26/call-for-papers

% % Official CFP: https://www.usenix.org/conference/osdi26/call-for-papers % Template source: https://www.usenix.org/conferences/author-resources/paper-templates

% Official CFP: https://www.usenix.org/conference/osdi26/call-for-papers

% Template source: https://www.usenix.org/conferences/author-resources/paper-templates

%   {\rm Author One}\\

%   {\rm Author Two}\\

% % This is the official USENIX style for conferences including OSDI, NSDI, ATC, etc. % Source: https://www.usenix.org/conferences/author-resources/paper-templates

% This is the official USENIX style for conferences including OSDI, NSDI, ATC, etc. % Source: https://www.usenix.org/conferences/author-resources/paper-templates %

% Source: https://www.usenix.org/conferences/author-resources/paper-templates

% NOTE: This is a simplified version for template purposes. % For the latest official version, download from: % https://www.usenix.org/conferences/author-resources/paper-templates

% https://www.usenix.org/conferences/author-resources/paper-templates

%         Two-column, 8mm separation, 10pt on 12pt leading % % Official CFP: https://sigops.org/s/conferences/sosp/2026/cfp.html

% % Official CFP: https://sigops.org/s/conferences/sosp/2026/cfp.html % ACM Template: https://www.acm.org/publications/proceedings-template

% Official CFP: https://sigops.org/s/conferences/sosp/2026/cfp.html

% ACM Template: https://www.acm.org/publications/proceedings-template

% SOSP offers optional artifact evaluation. If your paper is accepted, % consider preparing your artifact for evaluation. % See: https://sysartifacts.github.io/

% See: https://sysartifacts.github.io/

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

- **GitHub**: https://github.com/huggingface/peft

- **Docs**: https://huggingface.co/docs/peft

- **LoRA Paper**: arXiv:2106.09685 - **QLoRA Paper**: arXiv:2305.14314 - **Models**: https://huggingface.co/models?library=peft

- **Models**: https://huggingface.co/models?library=peft

# Or compile from source for specific CUDA git clone https://github.com/TimDettmers/bitsandbytes.git

git clone https://github.com/TimDettmers/bitsandbytes.git

**Error**: `ValueError: We couldn't connect to 'https://huggingface.co'`

1. **Check PEFT GitHub Issues**: https://github.com/huggingface/peft/issues

2. **HuggingFace Forums**: https://discuss.huggingface.co/

3. **PEFT Documentation**: https://huggingface.co/docs/peft

- **Docs**: https://docs.ray.io/en/latest/data/data.html

- **GitHub**: https://github.com/ray-project/ray ⭐ 36,000+

- **Examples**: https://docs.ray.io/en/latest/data/examples/overview.html

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

- **Documentation**: https://docs.skypilot.co

- **GitHub**: https://github.com/skypilot-org/skypilot

- **Slack**: https://slack.skypilot.co

- **Examples**: https://github.com/skypilot-org/skypilot/tree/master/examples

workdir:   url: https://github.com/user/repo.git

url: https://github.com/user/repo.git

[Credential-related source omitted]

# Test new version curl https://my-service-v2.skypilot.cloud/health

curl https://my-service-v2.skypilot.cloud/health

# Connect clients sky api login --endpoint https://your-server:8000

sky api login --endpoint https://your-server:8000

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

[Credential-related source omitted]

setup: |   # Install specific CUDA version   pip install torch==2.1.0+cu121 -f https://download.pytorch.org/whl/torch_stable.html

pip install torch==2.1.0+cu121 -f https://download.pytorch.org/whl/torch_stable.html

[Credential-related source omitted]

1. **Documentation**: https://docs.skypilot.co

2. **GitHub Issues**: https://github.com/skypilot-org/skypilot/issues

3. **Slack**: https://slack.skypilot.co

4. **Examples**: https://github.com/skypilot-org/skypilot/tree/master/examples

At [Unsloth](https://app.gitbook.com/o/HpyELzcNe0topgVLGCZY/s/xhOjnexMCB3dmuQFQ2Zq/), our mission is to make AI as accurate and accessible as possible. Train, run, evaluate and save gpt-oss, Llama, DeepSeek, TTS, Qwen, Mistral, Gemma LLMs 2

<a href="beginner-start-here" class="button primary">Get started</a> <a href="https://github.com/unslothai/unsloth" class="button secondary">Our GitHub</a>

[Credential-related source omitted]

{% column %} {% content-ref url="fine-tuning-llms-guide" %} [fine-tuning-llms-guide](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide)

{% content-ref url="fine-tuning-llms-guide" %} [fine-tuning-llms-guide](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide) {% endcontent-ref %}

[fine-tuning-llms-guide](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide)

{% content-ref url="unsloth-notebooks" %} [unsloth-notebooks](https://docs.unsloth.ai/get-started/unsloth-notebooks)

[unsloth-notebooks](https://docs.unsloth.ai/get-started/unsloth-notebooks)

{% column %} {% content-ref url="all-our-models" %} [all-our-models](https://docs.unsloth.ai/get-started/all-our-models)

{% content-ref url="all-our-models" %} [all-our-models](https://docs.unsloth.ai/get-started/all-our-models) {% endcontent-ref %}

[all-our-models](https://docs.unsloth.ai/get-started/all-our-models)

{% content-ref url="../models/tutorials-how-to-fine-tune-and-run-llms" %} [tutorials-how-to-fine-tune-and-run-llms](https://docs.unsloth.ai/models/tutorials-how-to-fine-tune-and-run-llms)

[tutorials-how-to-fine-tune-and-run-llms](https://docs.unsloth.ai/models/tutorials-how-to-fine-tune-and-run-llms)

[Credential-related source omitted]

* Unsloth streamlines model training locally and on Colab/Kaggle, covering loading, quantization, training, evaluation, saving, exporting, and integration with inference engines like Ollama, llama.cpp, and vLLM. * We directly collaborate wi

* We directly collaborate with teams behind [gpt-oss](https://docs.unsloth.ai/new/gpt-oss-how-to-run-and-fine-tune#unsloth-fixes-for-gpt-oss), [Qwen3](https://www.reddit.com/r/LocalLLaMA/comments/1kaodxu/qwen3_unsloth_dynamic_ggufs_128k_con

* Unsloth is the only training framework to support all model types:  [vision](https://docs.unsloth.ai/basics/vision-fine-tuning), [text-to-speech (TTS)](https://docs.unsloth.ai/basics/text-to-speech-tts-fine-tuning), BERT, [reinforcement l

* Supports **full-finetuning**, pretraining, 4-bit, 16-bit and **8-bit** training. * The most efficient RL library, using 80% less VRAM. Supports GRPO, GSPO etc. * Supports **all models**: [TTS,](https://docs.unsloth.ai/basics/text-to-speec

* The most efficient RL library, using 80% less VRAM. Supports GRPO, GSPO etc. * Supports **all models**: [TTS,](https://docs.unsloth.ai/basics/text-to-speech-tts-fine-tuning) multimodal, [BERT](https://docs.unsloth.ai/get-started/unsloth-n

* Supports **all models**: [TTS,](https://docs.unsloth.ai/basics/text-to-speech-tts-fine-tuning) multimodal, [BERT](https://docs.unsloth.ai/get-started/unsloth-notebooks#other-important-notebooks) and more. Any model that works in transform

* **0% loss in accuracy** - no approximation methods - all exact. * [MultiGPU](https://docs.unsloth.ai/basics/multi-gpu-training-with-unsloth) works already but a much better version is coming! * Unsloth supports Linux, Windows, Colab, Kagg

* [MultiGPU](https://docs.unsloth.ai/basics/multi-gpu-training-with-unsloth) works already but a much better version is coming!

* Unsloth supports Linux, Windows, Colab, Kaggle, **NVIDIA** and [**AMD**](https://docs.unsloth.ai/new/fine-tuning-llms-on-amd-gpus-with-unsloth) & **Intel**. See:

{% content-ref url="beginner-start-here/unsloth-requirements" %} [unsloth-requirements](https://docs.unsloth.ai/get-started/beginner-start-here/unsloth-requirements)

[unsloth-requirements](https://docs.unsloth.ai/get-started/beginner-start-here/unsloth-requirements)

Use our official **Docker image**: `unsloth/unsloth`. Read our [**Docker guide**](https://docs.unsloth.ai/get-started/install-and-update/docker)**.**

For Windows install instructions, see [here](https://docs.unsloth.ai/get-started/install-and-update/windows-installation).

{% content-ref url="install-and-update" %} [install-and-update](https://docs.unsloth.ai/get-started/install-and-update)

[install-and-update](https://docs.unsloth.ai/get-started/install-and-update)

[**Fine-tuning** an LLM](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide) customizes its behavior, enhances domain knowledge, and optimizes performance for specific tasks. By fine-tuning a pre-trained model (e.g. Llama-3.1-8B) on

[**Reinforcement Learning (RL)**](https://docs.unsloth.ai/get-started/reinforcement-learning-rl-guide) is where an "agent" learns to make decisions by interacting with an environment and receiving **feedback** in the form of **rewards** or 

{% content-ref url="beginner-start-here/faq-+-is-fine-tuning-right-for-me" %} [faq-+-is-fine-tuning-right-for-me](https://docs.unsloth.ai/get-started/beginner-start-here/faq-+-is-fine-tuning-right-for-me)

[faq-+-is-fine-tuning-right-for-me](https://docs.unsloth.ai/get-started/beginner-start-here/faq-+-is-fine-tuning-right-for-me)

{% content-ref url="reinforcement-learning-rl-guide" %} [reinforcement-learning-rl-guide](https://docs.unsloth.ai/get-started/reinforcement-learning-rl-guide)

[reinforcement-learning-rl-guide](https://docs.unsloth.ai/get-started/reinforcement-learning-rl-guide)

[Credential-related source omitted]

If you're a beginner, here might be the first questions you'll ask before your first fine-tune. You can also always ask our community by joining our [Reddit page](https://www.reddit.com/r/unsloth/).

[Credential-related source omitted]

* **Operating System**: Works on Linux and Windows. * Supports NVIDIA GPUs since 2018+ including [Blackwell RTX 50](https://docs.unsloth.ai/basics/fine-tuning-llms-with-blackwell-rtx-50-series-and-unsloth) and [**DGX Spark**](https://docs.u

* Supports NVIDIA GPUs since 2018+ including [Blackwell RTX 50](https://docs.unsloth.ai/basics/fine-tuning-llms-with-blackwell-rtx-50-series-and-unsloth) and [**DGX Spark**](https://docs.unsloth.ai/basics/fine-tuning-llms-with-nvidia-dgx-sp

Minimum CUDA Capability 7.0 (V100, T4, Titan V, RTX 20 & 50, A100, H100, L40 etc) [Check your GPU!](https://developer.nvidia.com/cuda-gpus) GTX 1070, 1080 works, but is slow.

* The official [Unsloth Docker image](https://hub.docker.com/r/unsloth/unsloth) `unsloth/unsloth` is available on Docker Hub.

* Unsloth works on [AMD](https://docs.unsloth.ai/new/fine-tuning-llms-on-amd-gpus-with-unsloth) and [Intel](https://github.com/unslothai/unsloth/pull/2621) GPUs! Apple/Silicon/MLX is in the works.

**For context length benchmarks, see** [**here**](https://docs.unsloth.ai/basics/unsloth-benchmarks#context-length-benchmarks)**.**

**Not necessarily.** Many assume RAG will consistently outperform a fine-tuned model, but that’s not the case when fine-tuning is done properly. In fact, a well-tuned model often matches or even surpasses RAG-based systems on specialized ta

**Not at all!** While full fine-tuning or pretraining can be costly, these are not necessary (pretraining is especially not necessary). In most cases, LoRA or QLoRA fine-tuning can be done for minimal cost. In fact, with Unsloth’s [free not

We recommend starting with **QLoRA**, as it’s one of the most efficient and accessible methods available. Thanks to Unsloth’s [dynamic 4-bit](https://unsloth.ai/blog/dynamic-4bit) quants, the accuracy loss compared to standard 16-bit LoRA f

{% content-ref url="../fine-tuning-llms-guide/lora-hyperparameters-guide" %} [lora-hyperparameters-guide](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide/lora-hyperparameters-guide)

[lora-hyperparameters-guide](https://docs.unsloth.ai/get-started/fine-tuning-llms-guide/lora-hyperparameters-guide)

Also see our GitHub repo for our notebooks: [github.com/unslothai/notebooks](https://github.com/unslothai/notebooks/)

* [**gpt-oss (20b)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-\(20B\)-Fine-tuning.ipynb) • [Inference](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/GPT_OSS_MXFP4_\(20B\)

* [**DeepSeek-OCR**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Deepseek_OCR_\(3B\).ipynb) **- new**

* [Qwen3 (14B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_\(14B\)-Reasoning-Conversational.ipynb) • [**Qwen3-VL (8B)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL

* [**Qwen3-2507-4B**](https://docs.unsloth.ai/models/qwen3-how-to-run-and-fine-tune/qwen3-2507) • [Thinking](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_\(4B\)-Thinking.ipynb) • [Instruct](https://colab.r

* [Gemma 3n (E4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3N_\(4B\)-Conversational.ipynb) • [Text](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3N_\(4B\)-Conversation

* [IBM Granite-4.0-H](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb) - new

* [Gemma 3 (4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(4B\).ipynb) • [Text](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(4B\).ipynb) • [Vision](https://colab

* [Phi-4 (14B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb) 

* [Llama 3.1 (8B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_\(8B\)-Alpaca.ipynb) • [Llama 3.2 (1B + 3B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_\(1B_and_3

* [**gpt-oss-20b**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-\(20B\)-GRPO.ipynb) (automatic kernels creation) - new

* [**gpt-oss-20b**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt_oss_\(20B\)_Reinforcement_Learning_2048_Game.ipynb) (auto win 2048 game) - new

* [**Qwen3-VL (8B)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL_\(8B\)-Vision-GRPO.ipynb) - Vision **GSPO** - new

* [Qwen3 (4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_\(4B\)-GRPO.ipynb) **-** Advanced GRPO LoRA

* [Gemma 3 (4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(4B\)-Vision-GRPO.ipynb) - Vision GSPO - new

* [**DeepSeek-R1-0528-Qwen3 (8B)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/DeepSeek_R1_0528_Qwen3_\(8B\)_GRPO.ipynb) (for multilingual usecase)

* [Gemma 3 (1B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(1B\)-GRPO.ipynb)

* [Llama 3.2 (3B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Advanced_Llama3_2_\(3B\)_GRPO_LoRA.ipynb) - Advanced GRPO LoRA

* [Llama 3.1 (8B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_\(8B\)-GRPO.ipynb)

* [Phi-4 (14B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4_\(14B\)-GRPO.ipynb) 

* [Mistral v0.3 (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_\(7B\)-GRPO.ipynb)

* [Sesame-CSM (1B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Sesame_CSM_\(1B\)-TTS.ipynb) - new

* [Orpheus-TTS (3B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Orpheus_\(3B\)-TTS.ipynb)

* [Whisper Large V3](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Whisper.ipynb) - Speech-to-Text (STT)

* [Llasa-TTS (1B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llasa_TTS_\(1B\).ipynb)

* [Spark-TTS (0.5B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Spark_TTS_\(0_5B\).ipynb)

* [Oute-TTS (1B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Oute_TTS_\(1B\).ipynb)

* [Whisper-Large-V3](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Whisper.ipynb)

* [Gemma 3n (E4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3N_\(4B\)-Audio.ipynb) - Audio

* [**Qwen3-VL (8B)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL_\(8B\)-Vision.ipynb) **- new**

* [**DeepSeek-OCR**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Deepseek_OCR_\(3B\).ipynb) **- new**

* [Gemma 3 (4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(4B\)-Vision.ipynb) - vision

* [Gemma 3n (E4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3N_\(4B\)-Conversational.ipynb) - vision

* [Llama 3.2 Vision (11B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_\(11B\)-Vision.ipynb)

* [Qwen2.5-VL (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_VL_\(7B\)-Vision.ipynb)

* [Pixtral (12B) 2409](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Pixtral_\(12B\)-Vision.ipynb)

* [Qwen3-VL](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL_\(8B\)-Vision-GRPO.ipynb) - Vision GSPO - new

* [Qwen2.5-VL](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2_5_7B_VL_GRPO.ipynb) - Vision GSPO

* [Gemma 3 (4B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(4B\)-Vision-GRPO.ipynb) - Vision GSPO - new

* [gpt-oss-120b ](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-\(120B\)_A100-Fine-tuning.ipynb)- new

* [Qwen3 (32B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_\(32B\)_A100-Reasoning-Conversational.ipynb) - new

* [Llama 3.3 (70B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.3_\(70B\)_A100-Conversational.ipynb) - new

* [Gemma 3 (27B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_\(27B\)_A100-Conversational.ipynb) - new

* [**Customer support agent**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb) **- new**

* [**Automatic Kernel Creation**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-\(20B\)-GRPO.ipynb) with RL **- new**

* [**ModernBERT-large**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/bert_classification.ipynb) **- new** as of Aug 19

* [**Synthetic Data Generation Llama 3.2 (3B)**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Meta_Synthetic_Data_Llama3_2_\(3B\).ipynb) - new

* [**Tool Calling**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_Coder_\(1.5B\)-Tool_Calling.ipynb) **- new**

* [**Customer support agent**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb) **- new**

* [Mistral v0.3 Instruct (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_\(7B\)-Conversational.ipynb)

* [Ollama](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3_\(8B\)-Ollama.ipynb)

* [ORPO](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3_\(8B\)-ORPO.ipynb)

* [Continued Pretraining](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_\(7B\)-CPT.ipynb)

* [DPO Zephyr](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Zephyr_\(7B\)-DPO.ipynb)

* [***Inference only***](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_\(8B\)-Inference.ipynb)

* [Llama 3 (8B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3_\(8B\)-Alpaca.ipynb)

* [**Customer support agent**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb) **- new**

* [**Automatic Kernel Creation**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-\(20B\)-GRPO.ipynb) with RL **- new**

* [DPO Zephyr](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Zephyr_\(7B\)-DPO.ipynb)

* [**BERT - Text Classification**](https://colab.research.google.com/github/timothelaborie/text_classification_scripts/blob/main/unsloth_classification.ipynb) **- new as of Aug 19**

* [Ollama](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3_\(8B\)-Ollama.ipynb)

* [**Tool Calling**](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_Coder_\(1.5B\)-Tool_Calling.ipynb) **- new**

* [Continued Pretraining (CPT)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_\(7B\)-CPT.ipynb)

* [Multiple Datasets](https://colab.research.google.com/drive/1njCCbE1YVal9xC83hjdo2hiGItpY_D6t?usp=sharing) by Flail

* [KTO](https://colab.research.google.com/drive/1MRgGtLWuZX4ypSfGguFgC-IblTvO2ivM?usp=sharing) by Jeffrey

* [Inference chat UI](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Unsloth_Studio.ipynb)

* [Conversational](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_\(1B_and_3B\)-Conversational.ipynb)

* [ChatML](https://colab.research.google.com/drive/15F1xyn8497_dUbxZP4zWmPZ3PJx1Oymv?usp=sharing)

* [Text Completion](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_\(7B\)-Text_Completion.ipynb)

* [Qwen2.5 (3B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_\(3B\)-GRPO.ipynb)

* [Gemma 2 (9B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma2_\(9B\)-Alpaca.ipynb)

* [Mistral NeMo (12B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_Nemo_\(12B\)-Alpaca.ipynb)

* [Phi-3.5 (mini)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_3.5_Mini-Conversational.ipynb)

* [Phi-3 (medium)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_3_Medium-Conversational.ipynb)

* [Gemma 2 (2B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma2_\(2B\)-Alpaca.ipynb)

* [Qwen 2.5 Coder (14B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_Coder_\(14B\)-Conversational.ipynb)

* [Mistral Small (22B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_Small_\(22B\)-Alpaca.ipynb)

* [TinyLlama](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/TinyLlama_\(1.1B\)-Alpaca.ipynb)

* [CodeGemma (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/CodeGemma_\(7B\)-Conversational.ipynb)

* [Mistral v0.3 (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_\(7B\)-Alpaca.ipynb)

* [Qwen2 (7B)](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2_\(7B\)-Alpaca.ipynb)

* [**gpt-oss (20B)**](https://www.kaggle.com/notebooks/welcome?src=https://github.com/unslothai/notebooks/blob/main/nb/Kaggle-gpt-oss-\(20B\)-Fine-tuning.ipynb\&accelerator=nvidiaTeslaT4) **- new**

* [Gemma 3n (E4B)](https://www.kaggle.com/code/danielhanchen/gemma-3n-4b-multimodal-finetuning-inference)

* [Qwen3 (14B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Qwen3_\(14B\).ipynb)

* [Magistral-2509 (24B)](https://www.kaggle.com/notebooks/welcome?src=https://github.com/unslothai/notebooks/blob/main/nb/Kaggle-Magistral_\(24B\)-Reasoning-Conversational.ipynb\&accelerator=nvidiaTeslaT4) - new

* [Gemma 3 (4B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Gemma3_\(4B\).ipynb)

* [Phi-4 (14B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Phi_4-Conversational.ipynb)

* [Llama 3.1 (8B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3.1_\(8B\)-Alpaca.ipynb)

* [Llama 3.2 (1B + 3B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3.2_\(1B_and_3B\)-Conversational.ipynb)

* [Qwen 2.5 (7B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Qwen2.5_\(7B\)-Alpaca.ipynb)

* [**Qwen2.5-VL**](https://www.kaggle.com/notebooks/welcome?src=https://github.com/unslothai/notebooks/blob/main/nb/Kaggle-Qwen2_5_7B_VL_GRPO.ipynb\&accelerator=nvidiaTeslaT4) - Vision GRPO - new

* [Qwen3 (4B)](https://www.kaggle.com/notebooks/welcome?src=https://github.com/unslothai/notebooks/blob/main/nb/Kaggle-Qwen3_\(4B\)-GRPO.ipynb\&accelerator=nvidiaTeslaT4)

* [Gemma 3 (1B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Gemma3_\(1B\)-GRPO.ipynb)

* [Llama 3.1 (8B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3.1_\(8B\)-GRPO.ipynb)

* [Phi-4 (14B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Phi_4_\(14B\)-GRPO.ipynb)

* [Qwen 2.5 (3B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Qwen2.5_\(3B\)-GRPO.ipynb)

* [Sesame-CSM (1B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Sesame_CSM_\(1B\)-TTS.ipynb)

* [Orpheus-TTS (3B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Orpheus_\(3B\)-TTS.ipynb)

* [Whisper Large V3](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Whisper.ipynb) – Speech-to-Text

* [Llasa-TTS (1B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llasa_TTS_\(1B\).ipynb)

* [Spark-TTS (0.5B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Spark_TTS_\(0_5B\).ipynb)

* [Oute-TTS (1B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Oute_TTS_\(1B\).ipynb)

* [Llama 3.2 Vision (11B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3.2_\(11B\)-Vision.ipynb)

* [Qwen 2.5-VL (7B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Qwen2.5_VL_\(7B\)-Vision.ipynb)

* [Pixtral (12B) 2409](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Pixtral_\(12B\)-Vision.ipynb)

* [Tool Calling](https://www.kaggle.com/notebooks/welcome?src=https://github.com/unslothai/notebooks/blob/main/nb/Kaggle-Qwen2.5_Coder_\(1.5B\)-Tool_Calling.ipynb\&accelerator=nvidiaTeslaT4)

* [ORPO](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3_\(8B\)-ORPO.ipynb)

* [Continued Pretraining](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Mistral_v0.3_\(7B\)-CPT.ipynb)

* [DPO Zephyr](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Zephyr_\(7B\)-DPO.ipynb)

* [Inference only](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3.1_\(8B\)-Inference.ipynb)

* [Ollama](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Llama3_\(8B\)-Ollama.ipynb)

* [Text Completion](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Mistral_\(7B\)-Text_Completion.ipynb)

* [CodeForces-cot (Reasoning)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-CodeForces-cot-Finetune_for_Reasoning_on_CodeForces.ipynb)

* [Unsloth Studio (chat UI)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Unsloth_Studio.ipynb)

* [Gemma 2 (9B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Gemma2_\(9B\)-Alpaca.ipynb)

* [Gemma 2 (2B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Gemma2_\(2B\)-Alpaca.ipynb)

* [CodeGemma (7B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-CodeGemma_\(7B\)-Conversational.ipynb)

* [Mistral NeMo (12B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Mistral_Nemo_\(12B\)-Alpaca.ipynb)

* [Mistral Small (22B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-Mistral_Small_\(22B\)-Alpaca.ipynb)

* [TinyLlama (1.1B)](https://www.kaggle.com/notebooks/welcome?src=https%3A%2F%2Fgithub.com%2Funslothai/notebooks/blob/main/nb/Kaggle-TinyLlama_\(1.1B\)-Alpaca.ipynb)

To view a complete list of all our Kaggle notebooks, [click here](https://github.com/unslothai/notebooks#-kaggle-notebooks).

{% hint style="info" %} Feel free to contribute to the notebooks by visiting our [repo](https://github.com/unslothai/notebooks)!

Feel free to contribute to the notebooks by visiting our [repo](https://github.com/unslothai/notebooks)!

Unsloth model catalog for all our [Dynamic](https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs) GGUF, 4-bit, 16-bit models on Hugging Face.

| Model                                                                                      | Variant                | GGUF                                                                            | Instruct (4-bit)                      

| ------------------------------------------------------------------------------------------ | ---------------------- | ------------------------------------------------------------------------------- | --------------------------------------

| [**gpt-oss** ](https://docs.unsloth.ai/models/gpt-oss-how-to-run-and-fine-tune)            | 120b                   | [link](https://huggingface.co/unsloth/gpt-oss-120b-GGUF)                        | [link](https://huggingface.co/unsloth/

|                                                                                            | 20b                    | [link](https://huggingface.co/unsloth/gpt-oss-20b-GGUF)                         | [link](https://huggingface.co/unsloth/

| [**DeepSeek-V3.1**](https://docs.unsloth.ai/models/deepseek-v3.1-how-to-run-locally)       | Terminus               | [link](https://huggingface.co/unsloth/DeepSeek-V3.1-Terminus-GGUF)              | —                                     

|                                                                                            | V3.1                   | [link](https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF)                       | —                                     

| [**Qwen3-VL**](https://docs.unsloth.ai/models/qwen3-vl-how-to-run-and-fine-tune)           | 2B-Instruct            | [link](https://huggingface.co/unsloth/Qwen3-VL-2B-Instruct-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 2B-Thinking            | [link](https://huggingface.co/unsloth/Qwen3-VL-2B-Thinking-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 4B-Instruct            | [link](https://huggingface.co/unsloth/Qwen3-VL-4B-Instruct-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 4B-Thinking            | [link](https://huggingface.co/unsloth/Qwen3-VL-4B-Thinking-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 8B-Instruct            | [link](https://huggingface.co/unsloth/Qwen3-VL-8B-Instruct-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 8B-Thinking            | [link](https://huggingface.co/unsloth/Qwen3-VL-8B-Thinking-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | 30B-A3B-Instruct       | [link](https://huggingface.co/unsloth/Qwen3-VL-30B-A3B-Instruct-GGUF)           | —                                     

|                                                                                            | 30B-A3B-Thinking       | [link](https://huggingface.co/unsloth/Qwen3-VL-30B-A3B-Thinking-GGUF)           | —                                     

|                                                                                            | 32B-Instruct           | [link](https://huggingface.co/unsloth/Qwen3-VL-32B-Instruct-GGUF)               | [link](https://huggingface.co/unsloth/

|                                                                                            | 32B-Thinking           | [link](https://huggingface.co/unsloth/Qwen3-VL-32B-Thinking-GGUF)               | [link](https://huggingface.co/unsloth/

|                                                                                            | 235B-A22B-Instruct     | [link](https://huggingface.co/unsloth/Qwen3-VL-235B-A22B-Instruct-GGUF)         | —                                     

|                                                                                            | 235B-A22B-Thinking     | [link](https://huggingface.co/unsloth/Qwen3-VL-235B-A22B-Thinking-GGUF)         | —                                     

| [**Qwen3-2507**](https://docs.unsloth.ai/models/qwen3-how-to-run-and-fine-tune/qwen3-2507) | 30B-A3B-Instruct       | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF)         | —                                     

|                                                                                            | 30B-A3B-Thinking       | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Thinking-2507-GGUF)         | —                                     

|                                                                                            | 235B-A22B-Thinking     | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B-Thinking-2507-GGUF/)      | —                                     

|                                                                                            | 235B-A22B-Instruct     | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B-Instruct-2507-GGUF/)      | —                                     

| **Qwen3-Coder**                                                                            | 30B-A3B                | [link](https://huggingface.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF)        | —                                     

|                                                                                            | 480B-A35B              | [link](https://huggingface.co/unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF)      | —                                     

| **Granite-4.0 (new)**                                                                      | H-Small                | [link](https://huggingface.co/unsloth/granite-4.0-h-small-GGUF)                 | [link](https://huggingface.co/unsloth/

| **GLM (new)**                                                                              | 4.6                    | [link](https://huggingface.co/unsloth/GLM-4.6-GGUF)                             | —                                     

|                                                                                            | 4.5-Air                | [link](https://huggingface.co/unsloth/GLM-4.5-Air-GGUF)                         | —                                     

| **Kimi-K2-0905**                                                                           | 1T                     | [link](https://huggingface.co/unsloth/Kimi-K2-Instruct-0905-GGUF)               | —                                     

| **Gemma 3n**                                                                               | E2B                    | [link](https://huggingface.co/unsloth/gemma-3n-E2B-it-GGUF)                     | [link](https://huggingface.co/unsloth/

|                                                                                            | E4B                    | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it-GGUF)                     | [link](https://huggingface.co/unsloth/

| **DeepSeek-R1-0528**                                                                       | R1-0528-Qwen3-8B       | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF)           | [link](https://huggingface.co/unsloth/

|                                                                                            | R1-0528                | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF)                    | —                                     

| **Mistral**                                                                                | Magistral Small (2509) | [link](https://huggingface.co/unsloth/Magistral-Small-2509-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | Magistral Small (2507) | [link](https://huggingface.co/unsloth/Magistral-Small-2507-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | Small 3.2 24B (2506)   | [link](https://huggingface.co/unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF) | [link](https://huggingface.co/unsloth/

| FLUX.1                                                                                     | Kontext-dev            | [link](https://huggingface.co/unsloth/FLUX.1-Kontext-dev-GGUF)                  | —                                     

| **Qwen3**                                                                                  | 0.6 B                  | [link](https://huggingface.co/unsloth/Qwen3-0.6B-GGUF)                          | [link](https://huggingface.co/unsloth/

|                                                                                            | 1.7 B                  | [link](https://huggingface.co/unsloth/Qwen3-1.7B-GGUF)                          | [link](https://huggingface.co/unsloth/

|                                                                                            | 4 B                    | [link](https://huggingface.co/unsloth/Qwen3-4B-GGUF)                            | [link](https://huggingface.co/unsloth/

|                                                                                            | 8 B                    | [link](https://huggingface.co/unsloth/Qwen3-8B-GGUF)                            | [link](https://huggingface.co/unsloth/

|                                                                                            | 14 B                   | [link](https://huggingface.co/unsloth/Qwen3-14B-GGUF)                           | [link](https://huggingface.co/unsloth/

|                                                                                            | 30B-A3B                | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-GGUF)                       | [link](https://huggingface.co/unsloth/

|                                                                                            | 32 B                   | [link](https://huggingface.co/unsloth/Qwen3-32B-GGUF)                           | [link](https://huggingface.co/unsloth/

|                                                                                            | 235B-A22B              | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B-GGUF)                     | —                                     

| **Llama 4**                                                                                | Scout 17B 16E          | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF)      | [link](https://huggingface.co/unsloth/

|                                                                                            | Maverick 17B 128E      | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF)  | —                                     

| **Grok 2**                                                                                 | 270B                   | [link](https://huggingface.co/unsloth/grok-2-GGUF)                              | —                                     

| **Qwen-2.5 Omni**                                                                          | 3 B                    | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-3B-GGUF)                     | —                                     

|                                                                                            | 7 B                    | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-7B-GGUF)                     | —                                     

| **Phi-4**                                                                                  | Reasoning-plus         | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus-GGUF)                | [link](https://huggingface.co/unsloth/

|                                                                                            | Reasoning              | [link](https://huggingface.co/unsloth/Phi-4-reasoning-GGUF)                     | [link](https://huggingface.co/unsloth/

| Model             | Variant                | GGUF                                                                      | Instruct (4-bit)                                                                      | | ----------------- | -------

| ----------------- | ---------------------- | ------------------------------------------------------------------------- | ------------------------------------------------------------------------------------- | | **DeepSeek-V3.1** | Terminu

| **DeepSeek-V3.1** | Terminus               | [link](https://huggingface.co/unsloth/DeepSeek-V3.1-Terminus-GGUF)        |                                                                                       |

|                   | V3.1                   | [link](https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF)                 |                                                                                       |

| **DeepSeek-V3**   | V3-0324                | [link](https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF)              | —                                                                                     |

|                   | V3                     | [link](https://huggingface.co/unsloth/DeepSeek-V3-GGUF)                   | —                                                                                     |

| **DeepSeek-R1**   | R1-0528                | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF)              | —                                                                                     |

|                   | R1-0528-Qwen3-8B       | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF)     | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit)     |

|                   | R1                     | [link](https://huggingface.co/unsloth/DeepSeek-R1-GGUF)                   | —                                                                                     |

|                   | R1 Zero                | [link](https://huggingface.co/unsloth/DeepSeek-R1-Zero-GGUF)              | —                                                                                     |

|                   | Distill Llama 3 8 B    | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF)  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit)  |

|                   | Distill Llama 3.3 70 B | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF) | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit)         |

|                   | Distill Qwen 2.5 1.5 B | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF) | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit) |

|                   | Distill Qwen 2.5 7 B   | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF)   | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit)   |

|                   | Distill Qwen 2.5 14 B  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-14B-GGUF)  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit)  |

|                   | Distill Qwen 2.5 32 B  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF)  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit)          |

| Model         | Variant             | GGUF                                                                           | Instruct (4-bit)                                                                       | | ------------- | ------------

| ------------- | ------------------- | ------------------------------------------------------------------------------ | -------------------------------------------------------------------------------------- | | **Llama 4**   | Scout 17 B-1

| **Llama 4**   | Scout 17 B-16 E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF)     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit) |

|               | Maverick 17 B-128 E | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF) | —                                                                                      |

| **Llama 3.3** | 70 B                | [link](https://huggingface.co/unsloth/Llama-3.3-70B-Instruct-GGUF)             | [link](https://huggingface.co/unsloth/Llama-3.3-70B-Instruct-bnb-4bit)                 |

| **Llama 3.2** | 1 B                 | [link](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-bnb-4bit)                  |

|               | 3 B                 | [link](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct-bnb-4bit)                  |

|               | 11 B Vision         | —                                                                              | [link](https://huggingface.co/unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit)  |

|               | 90 B Vision         | —                                                                              | [link](https://huggingface.co/unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit)          |

| **Llama 3.1** | 8 B                 | [link](https://huggingface.co/unsloth/Llama-3.1-8B-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit)             |

|               | 70 B                | —                                                                              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit)            |

|               | 405 B               | —                                                                              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit)           |

| **Llama 3**   | 8 B                 | —                                                                              | [link](https://huggingface.co/unsloth/llama-3-8b-Instruct-bnb-4bit)                    |

|               | 70 B                | —                                                                              | [link](https://huggingface.co/unsloth/llama-3-70b-bnb-4bit)                            |

| **Llama 2**   | 7 B                 | —                                                                              | [link](https://huggingface.co/unsloth/llama-2-7b-chat-bnb-4bit)                        |

|               | 13 B                | —                                                                              | [link](https://huggingface.co/unsloth/llama-2-13b-bnb-4bit)                            |

| **CodeLlama** | 7 B                 | —                                                                              | [link](https://huggingface.co/unsloth/codellama-7b-bnb-4bit)                           |

|               | 13 B                | —                                                                              | [link](https://huggingface.co/unsloth/codellama-13b-bnb-4bit)                          |

|               | 34 B                | —                                                                              | [link](https://huggingface.co/unsloth/codellama-34b-bnb-4bit)                          |

| Model        | Variant       | GGUF                                                         | Instruct (4-bit)                                                             | | ------------ | ------------- | --------------------------------

| ------------ | ------------- | ------------------------------------------------------------ | ---------------------------------------------------------------------------- | | **Gemma 3n** | E2B           | <U+200B>[link](https://huggingface.co/u

| **Gemma 3n** | E2B           | <U+200B>[link](https://huggingface.co/unsloth/gemma-3n-E2B-it-GGUF) | [link](https://huggingface.co/unsloth/gemma-3n-E2B-it-unsloth-bnb-4bit)      |

| **Gemma 3n** | E2B           | <U+200B>[link](https://huggingface.co/unsloth/gemma-3n-E2B-it-GGUF) | [link](https://huggingface.co/unsloth/gemma-3n-E2B-it-unsloth-bnb-4bit)      |

|              | E4B           | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it-GGUF)  | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit)      |

| **Gemma 3**  | 270M          | [link](https://huggingface.co/unsloth/gemma-3-270m-it-GGUF)  | [link](https://huggingface.co/unsloth/gemma-3-270m-it)                       |

|              | 1 B           | [link](https://huggingface.co/unsloth/gemma-3-1b-it-GGUF)    | [link](https://huggingface.co/unsloth/gemma-3-1b-it-unsloth-bnb-4bit)        |

|              | 4 B           | [link](https://huggingface.co/unsloth/gemma-3-4b-it-GGUF)    | [link](https://huggingface.co/unsloth/gemma-3-4b-it-unsloth-bnb-4bit)        |

|              | 12 B          | [link](https://huggingface.co/unsloth/gemma-3-12b-it-GGUF)   | [link](https://huggingface.co/unsloth/gemma-3-12b-it-unsloth-bnb-4bit)       |

|              | 27 B          | [link](https://huggingface.co/unsloth/gemma-3-27b-it-GGUF)   | [link](https://huggingface.co/unsloth/gemma-3-27b-it-unsloth-bnb-4bit)       |

| **MedGemma** | 4 B (vision)  | [link](https://huggingface.co/unsloth/medgemma-4b-it-GGUF)   | [link](https://huggingface.co/unsloth/medgemma-4b-it-unsloth-bnb-4bit)       |

|              | 27 B (vision) | [link](https://huggingface.co/unsloth/medgemma-27b-it-GGUF)  | [link](https://huggingface.co/unsloth/medgemma-27b-text-it-unsloth-bnb-4bit) |

| **Gemma 2**  | 2 B           | [link](https://huggingface.co/unsloth/gemma-2-it-GGUF)       | [link](https://huggingface.co/unsloth/gemma-2-2b-it-bnb-4bit)                |

|              | 9 B           | —                                                            | [link](https://huggingface.co/unsloth/gemma-2-9b-it-bnb-4bit)                |

|              | 27 B          | —                                                            | [link](https://huggingface.co/unsloth/gemma-2-27b-it-bnb-4bit)               |

| Model                      | Variant    | GGUF                                                                         | Instruct (4-bit)                                                                | | -------------------------- | ----

| -------------------------- | ---------- | ---------------------------------------------------------------------------- | ------------------------------------------------------------------------------- | | **Qwen 3**                 | 0.6 

| **Qwen 3**                 | 0.6 B      | [link](https://huggingface.co/unsloth/Qwen3-0.6B-GGUF)                       | [link](https://huggingface.co/unsloth/Qwen3-0.6B-unsloth-bnb-4bit)              |

|                            | 1.7 B      | [link](https://huggingface.co/unsloth/Qwen3-1.7B-GGUF)                       | [link](https://huggingface.co/unsloth/Qwen3-1.7B-unsloth-bnb-4bit)              |

|                            | 4 B        | [link](https://huggingface.co/unsloth/Qwen3-4B-GGUF)                         | [link](https://huggingface.co/unsloth/Qwen3-4B-unsloth-bnb-4bit)                |

|                            | 8 B        | [link](https://huggingface.co/unsloth/Qwen3-8B-GGUF)                         | [link](https://huggingface.co/unsloth/Qwen3-8B-unsloth-bnb-4bit)                |

|                            | 14 B       | [link](https://huggingface.co/unsloth/Qwen3-14B-GGUF)                        | [link](https://huggingface.co/unsloth/Qwen3-14B-unsloth-bnb-4bit)               |

|                            | 30 B-A3B   | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-GGUF)                    | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-bnb-4bit)                   |

|                            | 32 B       | [link](https://huggingface.co/unsloth/Qwen3-32B-GGUF)                        | [link](https://huggingface.co/unsloth/Qwen3-32B-unsloth-bnb-4bit)               |

|                            | 235 B-A22B | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B-GGUF)                  | —                                                                               |

| **Qwen 2.5 Omni**          | 3 B        | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-3B-GGUF)                  | —                                                                               |

|                            | 7 B        | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-7B-GGUF)                  | —                                                                               |

| **Qwen 2.5 VL**            | 3 B        | [link](https://huggingface.co/unsloth/Qwen2.5-VL-3B-Instruct-GGUF)           | [link](https://huggingface.co/unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit)  |

|                            | 7 B        | [link](https://huggingface.co/unsloth/Qwen2.5-VL-7B-Instruct-GGUF)           | [link](https://huggingface.co/unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit)  |

|                            | 32 B       | [link](https://huggingface.co/unsloth/Qwen2.5-VL-32B-Instruct-GGUF)          | [link](https://huggingface.co/unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit) |

|                            | 72 B       | [link](https://huggingface.co/unsloth/Qwen2.5-VL-72B-Instruct-GGUF)          | [link](https://huggingface.co/unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit) |

| **Qwen 2.5**               | 0.5 B      | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit)           |

|                            | 1.5 B      | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit)           |

|                            | 3 B        | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-3B-Instruct-bnb-4bit)             |

|                            | 7 B        | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-7B-Instruct-bnb-4bit)             |

|                            | 14 B       | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-14B-Instruct-bnb-4bit)            |

|                            | 32 B       | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-32B-Instruct-bnb-4bit)            |

|                            | 72 B       | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2.5-72B-Instruct-bnb-4bit)            |

| **Qwen 2.5 Coder (128 K)** | 0.5 B      | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-0.5B-Instruct-128K-GGUF) | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-0.5B-Instruct-bnb-4bit)     |

|                            | 1.5 B      | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-1.5B-Instruct-128K-GGUF) | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit)     |

|                            | 3 B        | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-3B-Instruct-128K-GGUF)   | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit)       |

|                            | 7 B        | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-7B-Instruct-128K-GGUF)   | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit)       |

|                            | 14 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-14B-Instruct-128K-GGUF)  | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-14B-Instruct-bnb-4bit)      |

|                            | 32 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-32B-Instruct-128K-GGUF)  | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-32B-Instruct-bnb-4bit)      |

| **QwQ**                    | 32 B       | [link](https://huggingface.co/unsloth/QwQ-32B-GGUF)                          | [link](https://huggingface.co/unsloth/QwQ-32B-unsloth-bnb-4bit)                 |

| **QVQ (preview)**          | 72 B       | —                                                                            | [link](https://huggingface.co/unsloth/QVQ-72B-Preview-bnb-4bit)                 |

| **Qwen 2 (chat)**          | 1.5 B      | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-1.5B-Instruct-bnb-4bit)             |

|                            | 7 B        | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-7B-Instruct-bnb-4bit)               |

|                            | 72 B       | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-72B-Instruct-bnb-4bit)              |

| **Qwen 2 VL**              | 2 B        | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit)    |

|                            | 7 B        | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit)    |

|                            | 72 B       | —                                                                            | [link](https://huggingface.co/unsloth/Qwen2-VL-72B-Instruct-bnb-4bit)           |

<table><thead><tr><th width="174">Model</th><th>Variant</th><th>GGUF</th><th>Instruct (4-bit)</th></tr></thead><tbody><tr><td><strong>Mistral Small</strong></td><td>3.2-24 B (2506)</td><td><a href="https://huggingface.co/unsloth/Mistral-Sma

| Model       | Variant          | GGUF                                                             | Instruct (4-bit)                                                             | | ----------- | ---------------- | ------------------------

| ----------- | ---------------- | ---------------------------------------------------------------- | ---------------------------------------------------------------------------- | | **Phi-4**   | Reasoning-plus   | [link](https://huggingfa

| **Phi-4**   | Reasoning-plus   | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus-GGUF) | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus-unsloth-bnb-4bit) |

|             | Reasoning        | [link](https://huggingface.co/unsloth/Phi-4-reasoning-GGUF)      | [link](https://huggingface.co/unsloth/phi-4-reasoning-unsloth-bnb-4bit)      |

|             | Mini-Reasoning   | [link](https://huggingface.co/unsloth/Phi-4-mini-reasoning-GGUF) | [link](https://huggingface.co/unsloth/Phi-4-mini-reasoning-unsloth-bnb-4bit) |

|             | Phi-4 (instruct) | [link](https://huggingface.co/unsloth/phi-4-GGUF)                | [link](https://huggingface.co/unsloth/phi-4-unsloth-bnb-4bit)                |

|             | mini (instruct)  | [link](https://huggingface.co/unsloth/Phi-4-mini-instruct-GGUF)  | [link](https://huggingface.co/unsloth/Phi-4-mini-instruct-unsloth-bnb-4bit)  |

| **Phi-3.5** | mini             | —                                                                | [link](https://huggingface.co/unsloth/Phi-3.5-mini-instruct-bnb-4bit)        |

| **Phi-3**   | mini             | —                                                                | [link](https://huggingface.co/unsloth/Phi-3-mini-4k-instruct-bnb-4bit)       |

|             | medium           | —                                                                | [link](https://huggingface.co/unsloth/Phi-3-medium-4k-instruct-bnb-4bit)     |

| Model          | Variant           | GGUF                                                                           | Instruct (4-bit)                                                          | | -------------- | ----------------- | -----

| -------------- | ----------------- | ------------------------------------------------------------------------------ | ------------------------------------------------------------------------- | | GLM            | 4.5-Air           | [link

| GLM            | 4.5-Air           | [link](https://huggingface.co/unsloth/GLM-4.5-Air-GGUF)                        |                                                                           |

|                | 4.5               | [4.5](https://huggingface.co/unsloth/GLM-4.5-GGUF)                             |                                                                           |

|                | 4-32B-0414        | [4-32B-0414](https://huggingface.co/unsloth/GLM-4-32B-0414-GGUF)               |                                                                           |

| Hunyuan        | A13B              | [link](https://huggingface.co/unsloth/Hunyuan-A13B-Instruct-GGUF)              | —                                                                         |

| Orpheus        | 0.1-ft (3B)       | [link](https://app.gitbook.com/o/HpyELzcNe0topgVLGCZY/s/xhOjnexMCB3dmuQFQ2Zq/) | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit) |

| **LLava**      | 1.5 (7 B)         | —                                                                              | [link](https://huggingface.co/unsloth/llava-1.5-7b-hf-bnb-4bit)           |

|                | 1.6 Mistral (7 B) | —                                                                              | [link](https://huggingface.co/unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit)  |

| **TinyLlama**  | Chat              | —                                                                              | [link](https://huggingface.co/unsloth/tinyllama-chat-bnb-4bit)            |

| **SmolLM 2**   | 135 M             | [link](https://huggingface.co/unsloth/SmolLM2-135M-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/SmolLM2-135M-Instruct-bnb-4bit)     |

|                | 360 M             | [link](https://huggingface.co/unsloth/SmolLM2-360M-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/SmolLM2-360M-Instruct-bnb-4bit)     |

|                | 1.7 B             | [link](https://huggingface.co/unsloth/SmolLM2-1.7B-Instruct-GGUF)              | [link](https://huggingface.co/unsloth/SmolLM2-1.7B-Instruct-bnb-4bit)     |

| **Zephyr-SFT** | 7 B               | —                                                                              | [link](https://huggingface.co/unsloth/zephyr-sft-bnb-4bit)                |

| **Yi**         | 6 B (v1.5)        | —                                                                              | [link](https://huggingface.co/unsloth/Yi-1.5-6B-bnb-4bit)                 |

|                | 6 B (v1.0)        | —                                                                              | [link](https://huggingface.co/unsloth/yi-6b-bnb-4bit)                     |

|                | 34 B (chat)       | —                                                                              | [link](https://huggingface.co/unsloth/yi-34b-chat-bnb-4bit)               |

|                | 34 B (base)       | —                                                                              | [link](https://huggingface.co/unsloth/yi-34b-bnb-4bit)                    |

| Model                | Variant                | Instruct (16-bit)                                                          | | -------------------- | ---------------------- | ---------------------------------------------------------------

| -------------------- | ---------------------- | -------------------------------------------------------------------------- | | **gpt-oss** (new)    | 20b                    | [link](https://huggingface.co/unsloth/gpt-oss-20b)             

| **gpt-oss** (new)    | 20b                    | [link](https://huggingface.co/unsloth/gpt-oss-20b)                         |

|                      | 120b                   | [link](https://huggingface.co/unsloth/gpt-oss-120b)                        |

| **Gemma 3n**         | E2B                    | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it)                     |

|                      | E4B                    | [link](https://huggingface.co/unsloth/gemma-3n-E2B-it)                     |

| **DeepSeek-R1-0528** | R1-0528-Qwen3-8B       | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B)           |

|                      | R1-0528                | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528)                    |

| **Mistral**          | Small 3.2 24B (2506)   | [link](https://huggingface.co/unsloth/Mistral-Small-3.2-24B-Instruct-2506) |

|                      | Small 3.1 24B (2503)   | [link](https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruct-2503) |

|                      | Small 3.0 24B (2501)   | [link](https://huggingface.co/unsloth/Mistral-Small-24B-Instruct-2501)     |

|                      | Magistral Small (2506) | [link](https://huggingface.co/unsloth/Magistral-Small-2506)                |

| **Qwen 3**           | 0.6 B                  | [link](https://huggingface.co/unsloth/Qwen3-0.6B)                          |

|                      | 1.7 B                  | [link](https://huggingface.co/unsloth/Qwen3-1.7B)                          |

|                      | 4 B                    | [link](https://huggingface.co/unsloth/Qwen3-4B)                            |

|                      | 8 B                    | [link](https://huggingface.co/unsloth/Qwen3-8B)                            |

|                      | 14 B                   | [link](https://huggingface.co/unsloth/Qwen3-14B)                           |

|                      | 30B-A3B                | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B)                       |

|                      | 32 B                   | [link](https://huggingface.co/unsloth/Qwen3-32B)                           |

|                      | 235B-A22B              | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B)                     |

| **Llama 4**          | Scout 17B-16E          | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct)      |

|                      | Maverick 17B-128E      | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct)  |

| **Qwen 2.5 Omni**    | 3 B                    | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-3B)                     |

|                      | 7 B                    | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-7B)                     |

| **Phi-4**            | Reasoning-plus         | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus)                |

|                      | Reasoning              | [link](https://huggingface.co/unsloth/Phi-4-reasoning)                     |

| Model           | Variant               | Instruct (16-bit)                                                    | | --------------- | --------------------- | -------------------------------------------------------------------- | | **DeepSe

| --------------- | --------------------- | -------------------------------------------------------------------- | | **DeepSeek-V3** | V3-0324               | [link](https://huggingface.co/unsloth/DeepSeek-V3-0324)              | |         

| **DeepSeek-V3** | V3-0324               | [link](https://huggingface.co/unsloth/DeepSeek-V3-0324)              |

|                 | V3                    | [link](https://huggingface.co/unsloth/DeepSeek-V3)                   |

| **DeepSeek-R1** | R1-0528               | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528)              |

|                 | R1-0528-Qwen3-8B      | [link](https://huggingface.co/unsloth/DeepSeek-R1-0528-Qwen3-8B)     |

|                 | R1                    | [link](https://huggingface.co/unsloth/DeepSeek-R1)                   |

|                 | R1 Zero               | [link](https://huggingface.co/unsloth/DeepSeek-R1-Zero)              |

|                 | Distill Llama 3 8B    | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-8B)  |

|                 | Distill Llama 3.3 70B | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-70B) |

|                 | Distill Qwen 2.5 1.5B | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-1.5B) |

|                 | Distill Qwen 2.5 7B   | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B)   |

|                 | Distill Qwen 2.5 14B  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-14B)  |

|                 | Distill Qwen 2.5 32B  | [link](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-32B)  |

| Family        | Variant           | Instruct (16-bit)                                                         | | ------------- | ----------------- | ------------------------------------------------------------------------- | | **Llama 4*

| ------------- | ----------------- | ------------------------------------------------------------------------- | | **Llama 4**   | Scout 17B-16E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct)     | |           

| **Llama 4**   | Scout 17B-16E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct)     |

|               | Maverick 17B-128E | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct) |

| **Llama 3.3** | 70 B              | [link](https://huggingface.co/unsloth/Llama-3.3-70B-Instruct)             |

| **Llama 3.2** | 1 B               | [link](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct)              |

|               | 3 B               | [link](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct)              |

|               | 11 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-11B-Vision-Instruct)      |

|               | 90 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-90B-Vision-Instruct)      |

| **Llama 3.1** | 8 B               | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct)         |

|               | 70 B              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-70B-Instruct)        |

|               | 405 B             | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-405B-Instruct)       |

| **Llama 3**   | 8 B               | [link](https://huggingface.co/unsloth/llama-3-8b-Instruct)                |

|               | 70 B              | [link](https://huggingface.co/unsloth/llama-3-70b-Instruct)               |

| **Llama 2**   | 7 B               | [link](https://huggingface.co/unsloth/llama-2-7b-chat)                    |

| Model        | Variant | Instruct (16-bit)                                      | | ------------ | ------- | ------------------------------------------------------ | | **Gemma 3n** | E2B     | [link](https://huggingface.co/unsloth/gemma-3

| ------------ | ------- | ------------------------------------------------------ | | **Gemma 3n** | E2B     | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it) | |              | E4B     | [link](https://huggingface.co/unsloth/gemma-3

| **Gemma 3n** | E2B     | [link](https://huggingface.co/unsloth/gemma-3n-E4B-it) |

|              | E4B     | [link](https://huggingface.co/unsloth/gemma-3n-E2B-it) |

| **Gemma 3**  | 1 B     | [link](https://huggingface.co/unsloth/gemma-3-1b-it)   |

|              | 4 B     | [link](https://huggingface.co/unsloth/gemma-3-4b-it)   |

|              | 12 B    | [link](https://huggingface.co/unsloth/gemma-3-12b-it)  |

|              | 27 B    | [link](https://huggingface.co/unsloth/gemma-3-27b-it)  |

| **Gemma 2**  | 2 B     | [link](https://huggingface.co/unsloth/gemma-2b-it)     |

|              | 9 B     | [link](https://huggingface.co/unsloth/gemma-9b-it)     |

|              | 27 B    | [link](https://huggingface.co/unsloth/gemma-27b-it)    |

| Family                   | Variant   | Instruct (16-bit)                                                       | | ------------------------ | --------- | ----------------------------------------------------------------------- | | **Qwen 3

| ------------------------ | --------- | ----------------------------------------------------------------------- | | **Qwen 3**               | 0.6 B     | [link](https://huggingface.co/unsloth/Qwen3-0.6B)                       | |         

| **Qwen 3**               | 0.6 B     | [link](https://huggingface.co/unsloth/Qwen3-0.6B)                       |

|                          | 1.7 B     | [link](https://huggingface.co/unsloth/Qwen3-1.7B)                       |

|                          | 4 B       | [link](https://huggingface.co/unsloth/Qwen3-4B)                         |

|                          | 8 B       | [link](https://huggingface.co/unsloth/Qwen3-8B)                         |

|                          | 14 B      | [link](https://huggingface.co/unsloth/Qwen3-14B)                        |

|                          | 30B-A3B   | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B)                    |

|                          | 32 B      | [link](https://huggingface.co/unsloth/Qwen3-32B)                        |

|                          | 235B-A22B | [link](https://huggingface.co/unsloth/Qwen3-235B-A22B)                  |

| **Qwen 2.5 Omni**        | 3 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-3B)                  |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Omni-7B)                  |

| **Qwen 2.5 VL**          | 3 B       | [link](https://huggingface.co/unsloth/Qwen2.5-VL-3B-Instruct)           |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2.5-VL-7B-Instruct)           |

|                          | 32 B      | [link](https://huggingface.co/unsloth/Qwen2.5-VL-32B-Instruct)          |

|                          | 72 B      | [link](https://huggingface.co/unsloth/Qwen2.5-VL-72B-Instruct)          |

| **Qwen 2.5**             | 0.5 B     | [link](https://huggingface.co/unsloth/Qwen2.5-0.5B-Instruct)            |

|                          | 1.5 B     | [link](https://huggingface.co/unsloth/Qwen2.5-1.5B-Instruct)            |

|                          | 3 B       | [link](https://huggingface.co/unsloth/Qwen2.5-3B-Instruct)              |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2.5-7B-Instruct)              |

|                          | 14 B      | [link](https://huggingface.co/unsloth/Qwen2.5-14B-Instruct)             |

|                          | 32 B      | [link](https://huggingface.co/unsloth/Qwen2.5-32B-Instruct)             |

|                          | 72 B      | [link](https://huggingface.co/unsloth/Qwen2.5-72B-Instruct)             |

| **Qwen 2.5 Coder 128 K** | 0.5 B     | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-0.5B-Instruct-128K) |

|                          | 1.5 B     | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-1.5B-Instruct-128K) |

|                          | 3 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-3B-Instruct-128K)   |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-7B-Instruct-128K)   |

|                          | 14 B      | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-14B-Instruct-128K)  |

|                          | 32 B      | [link](https://huggingface.co/unsloth/Qwen2.5-Coder-32B-Instruct-128K)  |

| **QwQ**                  | 32 B      | [link](https://huggingface.co/unsloth/QwQ-32B)                          |

| **QVQ (preview)**        | 72 B      | —                                                                       | | **Qwen 2 (Chat)**        | 1.5 B     | [link](https://huggingface.co/unsloth/Qwen2-1.5B-Instruct)              | |         

| **Qwen 2 (Chat)**        | 1.5 B     | [link](https://huggingface.co/unsloth/Qwen2-1.5B-Instruct)              |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2-7B-Instruct)                |

|                          | 72 B      | [link](https://huggingface.co/unsloth/Qwen2-72B-Instruct)               |

| **Qwen 2 VL**            | 2 B       | [link](https://huggingface.co/unsloth/Qwen2-VL-2B-Instruct)             |

|                          | 7 B       | [link](https://huggingface.co/unsloth/Qwen2-VL-7B-Instruct)             |

|                          | 72 B      | [link](https://huggingface.co/unsloth/Qwen2-VL-72B-Instruct)            |

| Model            | Variant        | Instruct (16-bit)                                                  | | ---------------- | -------------- | ------------------------------------------------------------------ | | **Mistral**      | Small

| ---------------- | -------------- | ------------------------------------------------------------------ | | **Mistral**      | Small 2409-22B | [link](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) | | **Mistral**      | Large

| **Mistral**      | Small 2409-22B | [link](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409) |

| **Mistral**      | Large 2407     | [link](https://huggingface.co/unsloth/Mistral-Large-Instruct-2407) |

| **Mistral**      | 7B v0.3        | [link](https://huggingface.co/unsloth/mistral-7b-instruct-v0.3)    |

| **Mistral**      | 7B v0.2        | [link](https://huggingface.co/unsloth/mistral-7b-instruct-v0.2)    |

| **Pixtral**      | 12B 2409       | [link](https://huggingface.co/unsloth/Pixtral-12B-2409)            |

| **Mixtral**      | 8×7B           | [link](https://huggingface.co/unsloth/Mixtral-8x7B-Instruct-v0.1)  |

| **Mistral NeMo** | 12B 2407       | [link](https://huggingface.co/unsloth/Mistral-Nemo-Instruct-2407)  |

| **Devstral**     | Small 2505     | [link](https://huggingface.co/unsloth/Devstral-Small-2505)         |

| Model       | Variant        | Instruct (16-bit)                                               | | ----------- | -------------- | --------------------------------------------------------------- | | **Phi-4**   | Reasoning-plus | [link](ht

| ----------- | -------------- | --------------------------------------------------------------- | | **Phi-4**   | Reasoning-plus | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus)     | |             | Reasoning      | [link](ht

| **Phi-4**   | Reasoning-plus | [link](https://huggingface.co/unsloth/Phi-4-reasoning-plus)     |

|             | Reasoning      | [link](https://huggingface.co/unsloth/Phi-4-reasoning)          |

|             | Phi-4 (core)   | [link](https://huggingface.co/unsloth/Phi-4)                    |

|             | Mini-Reasoning | [link](https://huggingface.co/unsloth/Phi-4-mini-reasoning)     |

|             | Mini           | [link](https://huggingface.co/unsloth/Phi-4-mini)               |

| **Phi-3.5** | Mini           | [link](https://huggingface.co/unsloth/Phi-3.5-mini-instruct)    |

| **Phi-3**   | Mini           | [link](https://huggingface.co/unsloth/Phi-3-mini-4k-instruct)   |

|             | Medium         | [link](https://huggingface.co/unsloth/Phi-3-medium-4k-instruct) |

| Model                  | Instruct (16-bit)                                                | | ---------------------- | ---------------------------------------------------------------- | | Orpheus-3B (v0.1 ft)   | [link](https://huggingfac

| ---------------------- | ---------------------------------------------------------------- | | Orpheus-3B (v0.1 ft)   | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-ft)         | | Orpheus-3B (v0.1 pt)   | [link](https://huggingfac

| Orpheus-3B (v0.1 ft)   | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-ft)         |

| Orpheus-3B (v0.1 pt)   | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-pretrained) |

| Sesame-CSM 1B          | [link](https://huggingface.co/unsloth/csm-1b)                    |

| Whisper Large V3 (STT) | [link](https://huggingface.co/unsloth/whisper-large-v3)          |

| Llasa-TTS 1B           | [link](https://huggingface.co/unsloth/Llasa-1B)                  |

| Spark-TTS 0.5B         | [link](https://huggingface.co/unsloth/Spark-TTS-0.5B)            |

| Oute-TTS 1B            | [link](https://huggingface.co/unsloth/Llama-OuteTTS-1.0-1B)      |

| Model        | Variant           | Base (16-bit)                                                    | Base (4-bit)                                                                           | | ------------ | ----------------- | ----------

| ------------ | ----------------- | ---------------------------------------------------------------- | -------------------------------------------------------------------------------------- | | **Gemma 3n** | E2B               | [link](htt

| **Gemma 3n** | E2B               | [link](https://huggingface.co/unsloth/gemma-3n-E2B)              | [link](https://huggingface.co/unsloth/gemma-3n-E2B-unsloth-bnb-4bit)                   |

|              | E4B               | [link](https://huggingface.co/unsloth/gemma-3n-E4B)              | [link](https://huggingface.co/unsloth/gemma-3n-E4B-unsloth-bnb-4bit)                   |

| **Qwen 3**   | 0.6 B             | [link](https://huggingface.co/unsloth/Qwen3-0.6B-Base)           | [link](https://huggingface.co/unsloth/Qwen3-0.6B-Base-unsloth-bnb-4bit)                |

|              | 1.7 B             | [link](https://huggingface.co/unsloth/Qwen3-1.7B-Base)           | [link](https://huggingface.co/unsloth/Qwen3-1.7B-Base-unsloth-bnb-4bit)                |

|              | 4 B               | [link](https://huggingface.co/unsloth/Qwen3-4B-Base)             | [link](https://huggingface.co/unsloth/Qwen3-4B-Base-unsloth-bnb-4bit)                  |

|              | 8 B               | [link](https://huggingface.co/unsloth/Qwen3-8B-Base)             | [link](https://huggingface.co/unsloth/Qwen3-8B-Base-unsloth-bnb-4bit)                  |

|              | 14 B              | [link](https://huggingface.co/unsloth/Qwen3-14B-Base)            | [link](https://huggingface.co/unsloth/Qwen3-14B-Base-unsloth-bnb-4bit)                 |

|              | 30B-A3B           | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Base)        | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Base-bnb-4bit)                     |

| **Llama 4**  | Scout 17B 16E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E)     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit) |

|              | Maverick 17B 128E | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E) | —                                                                                      |

| Model         | Variant           | Base (16-bit)                                                    | Base (4-bit)                                                | | ------------- | ----------------- | -----------------------------------

| ------------- | ----------------- | ---------------------------------------------------------------- | ----------------------------------------------------------- | | **Llama 4**   | Scout 17B 16E     | [link](https://huggingface.co/unslo

| **Llama 4**   | Scout 17B 16E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E)     | —                                                           |

|               | Maverick 17B 128E | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E) | —                                                           |

| **Llama 3.3** | 70 B              | [link](https://huggingface.co/unsloth/Llama-3.3-70B)             | —                                                           |

| **Llama 3.2** | 1 B               | [link](https://huggingface.co/unsloth/Llama-3.2-1B)              | —                                                           |

|               | 3 B               | [link](https://huggingface.co/unsloth/Llama-3.2-3B)              | —                                                           |

|               | 11 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-11B-Vision)      | —                                                           |

|               | 90 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-90B-Vision)      | —                                                           |

| **Llama 3.1** | 8 B               | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-8B)         | —                                                           |

|               | 70 B              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-70B)        | —                                                           |

| **Llama 3**   | 8 B               | [link](https://huggingface.co/unsloth/llama-3-8b)                | [link](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit)  |

| **Llama 2**   | 7 B               | [link](https://huggingface.co/unsloth/llama-2-7b)                | [link](https://huggingface.co/unsloth/llama-2-7b-bnb-4bit)  |

|               | 13 B              | [link](https://huggingface.co/unsloth/llama-2-13b)               | [link](https://huggingface.co/unsloth/llama-2-13b-bnb-4bit) |

| Model        | Variant | Base (16-bit)                                             | Base (4-bit)                                                               | | ------------ | ------- | -------------------------------------------------

| ------------ | ------- | --------------------------------------------------------- | -------------------------------------------------------------------------- | | **Qwen 3**   | 0.6 B   | [link](https://huggingface.co/unsloth/Qwen3-0.6B-

| **Qwen 3**   | 0.6 B   | [link](https://huggingface.co/unsloth/Qwen3-0.6B-Base)    | [link](https://huggingface.co/unsloth/Qwen3-0.6B-Base-unsloth-bnb-4bit)    |

|              | 1.7 B   | [link](https://huggingface.co/unsloth/Qwen3-1.7B-Base)    | [link](https://huggingface.co/unsloth/Qwen3-1.7B-Base-unsloth-bnb-4bit)    |

|              | 4 B     | [link](https://huggingface.co/unsloth/Qwen3-4B-Base)      | [link](https://huggingface.co/unsloth/Qwen3-4B-Base-unsloth-bnb-4bit)      |

|              | 8 B     | [link](https://huggingface.co/unsloth/Qwen3-8B-Base)      | [link](https://huggingface.co/unsloth/Qwen3-8B-Base-unsloth-bnb-4bit)      |

|              | 14 B    | [link](https://huggingface.co/unsloth/Qwen3-14B-Base)     | [link](https://huggingface.co/unsloth/Qwen3-14B-Base-unsloth-bnb-4bit)     |

|              | 30B-A3B | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Base) | [link](https://huggingface.co/unsloth/Qwen3-30B-A3B-Base-unsloth-bnb-4bit) |

| **Qwen 2.5** | 0.5 B   | [link](https://huggingface.co/unsloth/Qwen2.5-0.5B)       | [link](https://huggingface.co/unsloth/Qwen2.5-0.5B-bnb-4bit)               |

|              | 1.5 B   | [link](https://huggingface.co/unsloth/Qwen2.5-1.5B)       | [link](https://huggingface.co/unsloth/Qwen2.5-1.5B-bnb-4bit)               |

|              | 3 B     | [link](https://huggingface.co/unsloth/Qwen2.5-3B)         | [link](https://huggingface.co/unsloth/Qwen2.5-3B-bnb-4bit)                 |

|              | 7 B     | [link](https://huggingface.co/unsloth/Qwen2.5-7B)         | [link](https://huggingface.co/unsloth/Qwen2.5-7B-bnb-4bit)                 |

|              | 14 B    | [link](https://huggingface.co/unsloth/Qwen2.5-14B)        | [link](https://huggingface.co/unsloth/Qwen2.5-14B-bnb-4bit)                |

|              | 32 B    | [link](https://huggingface.co/unsloth/Qwen2.5-32B)        | [link](https://huggingface.co/unsloth/Qwen2.5-32B-bnb-4bit)                |

|              | 72 B    | [link](https://huggingface.co/unsloth/Qwen2.5-72B)        | [link](https://huggingface.co/unsloth/Qwen2.5-72B-bnb-4bit)                |

| **Qwen 2**   | 1.5 B   | [link](https://huggingface.co/unsloth/Qwen2-1.5B)         | [link](https://huggingface.co/unsloth/Qwen2-1.5B-bnb-4bit)                 |

|              | 7 B     | [link](https://huggingface.co/unsloth/Qwen2-7B)           | [link](https://huggingface.co/unsloth/Qwen2-7B-bnb-4bit)                   |

| Model         | Variant           | Base (16-bit)                                                    | Base (4-bit)                                                | | ------------- | ----------------- | -----------------------------------

| ------------- | ----------------- | ---------------------------------------------------------------- | ----------------------------------------------------------- | | **Llama 4**   | Scout 17B 16E     | [link](https://huggingface.co/unslo

| **Llama 4**   | Scout 17B 16E     | [link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E)     | —                                                           |

|               | Maverick 17B 128E | [link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E) | —                                                           |

| **Llama 3.3** | 70 B              | [link](https://huggingface.co/unsloth/Llama-3.3-70B)             | —                                                           |

| **Llama 3.2** | 1 B               | [link](https://huggingface.co/unsloth/Llama-3.2-1B)              | —                                                           |

|               | 3 B               | [link](https://huggingface.co/unsloth/Llama-3.2-3B)              | —                                                           |

|               | 11 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-11B-Vision)      | —                                                           |

|               | 90 B Vision       | [link](https://huggingface.co/unsloth/Llama-3.2-90B-Vision)      | —                                                           |

| **Llama 3.1** | 8 B               | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-8B)         | —                                                           |

|               | 70 B              | [link](https://huggingface.co/unsloth/Meta-Llama-3.1-70B)        | —                                                           |

| **Llama 3**   | 8 B               | [link](https://huggingface.co/unsloth/llama-3-8b)                | [link](https://huggingface.co/unsloth/llama-3-8b-bnb-4bit)  |

| **Llama 2**   | 7 B               | [link](https://huggingface.co/unsloth/llama-2-7b)                | [link](https://huggingface.co/unsloth/llama-2-7b-bnb-4bit)  |

|               | 13 B              | [link](https://huggingface.co/unsloth/llama-2-13b)               | [link](https://huggingface.co/unsloth/llama-2-13b-bnb-4bit) |

| Model       | Variant | Base (16-bit)                                         | Base (4-bit)                                                           | | ----------- | ------- | ----------------------------------------------------- | ---

| ----------- | ------- | ----------------------------------------------------- | ---------------------------------------------------------------------- | | **Gemma 3** | 1 B     | [link](https://huggingface.co/unsloth/gemma-3-1b-pt)  | [li

| **Gemma 3** | 1 B     | [link](https://huggingface.co/unsloth/gemma-3-1b-pt)  | [link](https://huggingface.co/unsloth/gemma-3-1b-pt-unsloth-bnb-4bit)  |

|             | 4 B     | [link](https://huggingface.co/unsloth/gemma-3-4b-pt)  | [link](https://huggingface.co/unsloth/gemma-3-4b-pt-unsloth-bnb-4bit)  |

|             | 12 B    | [link](https://huggingface.co/unsloth/gemma-3-12b-pt) | [link](https://huggingface.co/unsloth/gemma-3-12b-pt-unsloth-bnb-4bit) |

|             | 27 B    | [link](https://huggingface.co/unsloth/gemma-3-27b-pt) | [link](https://huggingface.co/unsloth/gemma-3-27b-pt-unsloth-bnb-4bit) |

| **Gemma 2** | 2 B     | [link](https://huggingface.co/unsloth/gemma-2-2b)     | —                                                                      |

|             | 9 B     | [link](https://huggingface.co/unsloth/gemma-2-9b)     | —                                                                      |

|             | 27 B    | [link](https://huggingface.co/unsloth/gemma-2-27b)    | —                                                                      |

| Model       | Variant          | Base (16-bit)                                                      | Base (4-bit)                                                    | | ----------- | ---------------- | -----------------------------------

| ----------- | ---------------- | ------------------------------------------------------------------ | --------------------------------------------------------------- | | **Mistral** | Small 24B 2501   | [link](https://huggingface.co/unslo

| **Mistral** | Small 24B 2501   | [link](https://huggingface.co/unsloth/Mistral-Small-24B-Base-2501) | —                                                               |

|             | NeMo 12B 2407    | [link](https://huggingface.co/unsloth/Mistral-Nemo-Base-2407)      | —                                                               |

|             | 7B v0.3          | [link](https://huggingface.co/unsloth/mistral-7b-v0.3)             | [link](https://huggingface.co/unsloth/mistral-7b-v0.3-bnb-4bit) |

|             | 7B v0.2          | [link](https://huggingface.co/unsloth/mistral-7b-v0.2)             | [link](https://huggingface.co/unsloth/mistral-7b-v0.2-bnb-4bit) |

|             | Pixtral 12B 2409 | [link](https://huggingface.co/unsloth/Pixtral-12B-Base-2409)       | —                                                               |

| Model          | Variant        | Base (16-bit)                                                    | Base (4-bit)                                                                      | | -------------- | -------------- | -----------------

| -------------- | -------------- | ---------------------------------------------------------------- | --------------------------------------------------------------------------------- | | **TinyLlama**  | 1.1 B (Base)   | [link](https://hu

| **TinyLlama**  | 1.1 B (Base)   | [link](https://huggingface.co/unsloth/tinyllama)                 | [link](https://huggingface.co/unsloth/tinyllama-bnb-4bit)                         |

| **Orpheus-3b** | 0.1-pretrained | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-pretrained) | [link](https://huggingface.co/unsloth/orpheus-3b-0.1-pretrained-unsloth-bnb-4bit) |

Unsloth works on Linux, Windows, NVIDIA, AMD, Google Colab and more. See our [system requirements](https://docs.unsloth.ai/get-started/beginner-start-here/unsloth-requirements).

<pre class="language-bash"><code class="lang-bash">pip install --upgrade --force-reinstall --no-cache-dir --no-deps git+https://github.com/unslothai/unsloth.git

<strong>pip install --upgrade --force-reinstall --no-cache-dir --no-deps git+https://github.com/unslothai/unsloth-zoo.git