Create LLM section and add examples (ray-project#34614)

Surface LLM/Generative AI use cases.

Signed-off-by: angelinalg <[email protected]>
Signed-off-by: elliottower <[email protected]>

doc/source/ray-overview/use-cases.rst

@@ -5,6 +5,89 @@ Ray Use Cases
 
 This page indexes common Ray use cases for scaling ML. It contains highlighted references to blogs, examples, and tutorials also located elsewhere in the Ray documentation.
 
+.. _ref-use-cases-llm:
+
+Large Language Models and Generative AI
+---------------------------------------
+
+The following highlights feature projects that use Ray to implement Large Language Models and Generative AI applications.
+
+.. panels::
+ :container: container pb-3
+ :column: col-md-3 px-1 py-1
+ :img-top-cls: p-2 w-75 d-block mx-auto fixed-height-img
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: https://www.anyscale.com/blog/ray-common-production-challenges-for-generative-ai-infrastructure
+ :type: url
+ :text: [Blog] How Ray solves common production challenges for generative AI infrastructure
+ :classes: btn-link btn-block stretched-link webCrawler
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: https://www.anyscale.com/blog/training-175b-parameter-language-models-at-1000-gpu-scale-with-alpa-and-ray
+ :type: url
+ :text: [Blog] Training 175B Parameter Language Models at 1000 GPU scale with Alpa and Ray
+ :classes: btn-link btn-block stretched-link webCrawler
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: https://www.anyscale.com/blog/faster-stable-diffusion-fine-tuning-with-ray-air
+ :type: url
+ :text: [Blog] Faster stable diffusion fine-tuning with Ray AIR
+ :classes: btn-link btn-block stretched-link webCrawler
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: https://www.anyscale.com/blog/how-to-fine-tune-and-serve-llms-simply-quickly-and-cost-effectively-using
+ :type: url
+ :text: [Blog] How to fine tune and serve LLMs simply, quickly and cost effectively using Ray + DeepSpeed + HuggingFace
+ :classes: btn-link btn-block stretched-link webCrawler
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: https://www.businessinsider.com/openai-chatgpt-trained-on-anyscale-ray-generative-lifelike-ai-models-2022-12
+ :type: url
+ :text: [Blog] How OpenAI Uses Ray to Train Tools like ChatGPT
+ :classes: btn-link btn-block stretched-link chatgpt
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: /ray-air/examples/gptj_deepspeed_fine_tuning
+ :type: ref
+ :text: [Example] GPT-J-6B Fine-Tuning with Ray AIR and DeepSpeed
+ :classes: btn-link btn-block stretched-link antServing
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: /ray-air/examples/dreambooth_finetuning
+ :type: ref
+ :text: [Example] Fine-tuning DreamBooth with Ray AIR
+ :classes: btn-link btn-block stretched-link rayForward
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: /ray-air/examples/stablediffusion_batch_prediction
+ :type: ref
+ :text: [Example] Stable Diffusion Batch Prediction with Ray AIR
+ :classes: btn-link btn-block stretched-link rayForward
+
+ ---
+ :img-top: /images/ray_logo.png
+
+ .. link-button:: /ray-air/examples/gptj_serving
+ :type: ref
+ :text: [Example] GPT-J-6B Serving with Ray AIR
+ :classes: btn-link btn-block stretched-link webCrawler
+
 .. _ref-use-cases-batch-infer:
 
 Batch Inference
@@ -530,13 +613,6 @@ The following highlights feature projects leveraging Ray Core's distributed APIs
  ---
  :img-top: /images/ray_logo.png
 
- .. link-button:: https://www.businessinsider.com/openai-chatgpt-trained-on-anyscale-ray-generative-lifelike-ai-models-2022-12
- :type: url
- :text: [Blog] How OpenAI Uses Ray to Train Tools like ChatGPT
- :classes: btn-link btn-block stretched-link chatgpt
- ---
- :img-top: /images/ray_logo.png
-
  .. link-button:: https://www.anyscale.com/blog/building-highly-available-and-scalable-online-applications-on-ray-at-ant
  :type: url
  :text: [Blog] Highly Available and Scalable Online Applications on Ray at Ant Group
@@ -564,4 +640,4 @@ The following highlights feature projects leveraging Ray Core's distributed APIs
  .. link-button:: /ray-core/examples/web-crawler
  :type: ref
  :text: [Example] Speed up your web crawler by parallelizing it with Ray
- :classes: btn-link btn-block stretched-link webCrawler
+ :classes: btn-link btn-block stretched-link webCrawler