Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding

Hugging Face Blog · 2024-01-30

Chinese Original

Related items

AIHugging Face Blog2022-11-02

Accelerate your models with 🤗 Optimum Intel and OpenVINO

AIHugging Face Blog2024-11-20

Faster Text Generation with Self-Speculative Decoding

AIHugging Face Blog2023-05-25

Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

AIHugging Face Blog2024-04-03

Blazing Fast SetFit Inference with 🤗 Optimum Intel on Xeon

AIHugging Face Blog2025-03-28

🚀 Accelerating LLM Inference with TGI on Intel Gaudi

AIHugging Face Blog2024-01-15

Accelerating SD Turbo and SDXL Turbo Inference with ONNX Runtime and Olive

Feedback

TypeMessage