Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Hugging Face Blog · 2023-05-24

Chinese Original

Related items

AIHugging Face Blog2024-09-18

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

AIHugging Face Blog2023-07-27

Stable Diffusion XL on Mac with Advanced Core ML Quantization

AIHugging Face Blog2023-02-21

Hugging Face and AWS partner to make AI more accessible

AIHugging Face Blog2025-04-29

Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs

AIHugging Face Blog2023-08-23

Making LLMs lighter with AutoGPTQ and transformers

AIHugging Face Blog2022-08-17

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Feedback

TypeMessage