[HPU] [Train] Add a Stable Diffusion fine-tuning and serving example (#…

…45217) This PR adds an example for stable diffusion model fine-tuning and serving using HPU. Moreover, it also covers how to adapt an existing HPU example to run on Ray, so that users can use Ray to run the examples on huggingface/optimum-habana. --------- Signed-off-by: Zhi Lin <[email protected]> Signed-off-by: Yunxuan Xiao <[email protected]> Signed-off-by: Samuel Chan <[email protected]> Co-authored-by: Yunxuan Xiao <[email protected]> Co-authored-by: Yunxuan Xiao <[email protected]> Co-authored-by: Samuel Chan <[email protected]> Co-authored-by: Peyton Murray <[email protected]>
ray-project · May 30, 2024 · 18eb433 · 18eb433
1 parent ff3e393
commit 18eb433
Show file tree

Hide file tree

Showing 2 changed files with 437 additions and 0 deletions.
diff --git a/doc/source/train/examples.yml b/doc/source/train/examples.yml
@@ -73,6 +73,16 @@ examples:
  - computer vision
  - generative ai
  link: examples/pytorch/dreambooth_finetuning
+ - title: Finetune Stable Diffusion and generate images with Intel Gaudi
+ skill_level: intermediate
+ frameworks:
+ - accelerate
+ - transformers
+ use_cases:
+ - computer vision
+ - generative ai
+ contributor: community
+ link: examples/intel_gaudi/sd
  - title: Train a text classifier with PyTorch Lightning and Ray Data
  frameworks:
  - lightning