# Llm Inference

> Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model s…

Use when "LLM inference", "serving LLM", "vLLM", "llama.cpp", "GGUF", "text generation", "model serving", "inference optimization", "KV cache", "continuous batching", "speculative decoding", "local LLM", "CPU inference"

- Page: https://ss33.ai/skills/eyadsibai/llm-inference-19277044961
- Publisher: eyadsibai
- Category: [Data & Analytics](https://ss33.ai/skills/category/data-and-analytics-m1r3i9) › [Machine learning & training](https://ss33.ai/skills/category/data-and-analytics-m1r3i9/machine-learning-and-training-d194fk)
- Source: https://github.com/eyadsibai/ltk/blob/f8e85697b95d8e4968cff3c49d20e632048faae9/plugins/ltk-data/skills/llm-inference/SKILL.md

## Skill

This skill's licence does not allow redistribution, so the store does not serve its text. Get it from the author: https://github.com/eyadsibai/ltk/blob/f8e85697b95d8e4968cff3c49d20e632048faae9/plugins/ltk-data/skills/llm-inference/SKILL.md