Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Hugging Face Blog · 2025-01-16

Chinese Original

Original text is not available for public display.

Related items

AIHugging Face Blog2024-05-29

Benchmarking Text Generation Inference

AIHugging Face Blog2024-02-01

Hugging Face Text Generation Inference available for AWS Inferentia2

AIHugging Face Blog2023-05-31

Introducing the Hugging Face LLM Inference Container for Amazon SageMaker

AIHugging Face Blog2024-06-04

Faster assisted generation support for Intel Gaudi

AIHugging Face Blog2023-09-13

Introducing Würstchen: Fast Diffusion for Image Generation

AIHugging Face Blog2025-04-29

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

Feedback

TypeMessage