Speculative Decoding for 2x Faster Whisper Inference

Hugging Face Blog · 2023-12-20

Chinese Original

Original text is not available for public display.

Related items

AIHugging Face Blog2024-11-20

Faster Text Generation with Self-Speculative Decoding

AIHugging Face Blog2024-05-01

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

AIHugging Face Blog2025-02-24

Remote VAEs for decoding with Inference Endpoints 🤗

AIHugging Face Blog2025-05-13

Blazingly fast whisper transcriptions with Inference Endpoints

AIHugging Face Blog2024-01-30

Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding

AIHugging Face Blog2023-09-22

Inference for PROs

Feedback

TypeMessage