Fine-tuning Llama 2 70B using PyTorch FSDP

Hugging Face Blog · 2023-09-13

Chinese Original

Original text is not available for public display.

Related items

AIHugging Face Blog2023-08-08

Fine-tune Llama 2 with DPO

AIHugging Face Blog2023-02-10

Parameter-Efficient Fine-Tuning using 🤗 PEFT

AIHugging Face Blog2023-01-26

Using LoRA for Efficient Stable Diffusion Fine-Tuning

AIHugging Face Blog2021-11-19

Accelerating PyTorch distributed fine-tuning with Intel technologies

AIHugging Face Blog2024-01-10

Make LLM Fine-tuning 2x faster with Unsloth and 🤗 TRL

AIHugging Face Blog2023-03-09

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Feedback

TypeMessage