Skip to content

SkyPilot v0.4.0
Compare
Choose a tag to compare
@romilbhardwaj romilbhardwaj released this 19 Sep 16:57
v0.4.0
c324612

SkyPilot v0.4.0: Kubernetes, native containers, ports and new clouds

We are excited to release SkyPilot v0.4.0, which brings a host of new features and improvements, including Kubernetes support, native container support, ability to open ports, and more.

Release Highlights

New Features

  • Kubernetes support: SkyPilot tasks and clusters can now run on Kubernetes clusters, including on-prem and cloud hosted deployments (GKE, EKS).
    • If you have a working kubeconfig, simply run sky check and sky launch --cloud kubernetes to run your task on Kubernetes.
    • If desired, tasks can also failover to the cloud when the Kubernetes cluster does not have enough resources. The same SkyPilot YAMLs and CLI works seamlessly across Kubernetes and clouds.
  • Opening ports on clusters: Open ports on your clusters with the ports field. These ports are publicly accessible and can be used for hosting LLM inference endpoints, Jupyter notebooks, web servers, Tensorboard, and other services.
  • Native container support: If your task uses docker containers, SkyPilot's setup and run commands can now directly be executed in that container. This allows you to wrap your environment in a container and run it on any cloud with SkyPilot.
  • Reservation support: This release adds support for GCP reservations. SkyPilot will now prioritize using your reservations on the cloud to save costs and get higher availability.
  • New Managed Spot Features

New LLM Recipes

More Clouds

SkyPilot now supports 8 clouds, including community contributed support for two new clouds:

SkyPilot now also supports IBM COS buckets (#1966).

Core and UX Improvements

  • Faster failover: 30x faster failover with our new quota optimization which checks if quotas are available before launching a cluster (Supported on GCP, AWS).
  • Easily get VM IPs: The new --ip flag for sky status returns the public IP address of the cluster (e.g., sky status --ip mycluster). Use this to access services such as LLM inference endpoints, jupyter notebooks and more.
  • Improved scriptability: SkyPilot YAMLs and CLI are more scriptable than ever - file_mounts can be dynamically defined with environment variables (docs, example), environment variables can be set through a dotenv file with the new --env-file flag (#2296).
  • Core optimizations: Multi-node clusters stop 4x faster (#2199), sky status updates for stopped clusters are 10x faster (#2288), and the job queue is more memory efficient (#1636).
  • Nightly releases: We now release nightly versions of SkyPilot. To get the cutting edge of SkyPilot without installing from source, run pip install skypilot-nightly (#1446)

Deprecation

  • SkyPilot On-prem is now deprecated and Kubernetes will be the recommended mode of running SkyPilot on on-prem clusters.

Below is a detailed list of changes.

Managed Spot

New Features

  • Spot pipeline support: automatically handles a pipeline of spot jobs. (#1982)
  • Spot dashboard is now available with sky spot dashboard: you can now see all your spot jobs in GUI (#2103, #2136)
  • Spot callback - users can now run custom code when spot job status changes (#2106, #2364)
  • Resource configuration of the spot controller can now be customized (docs, #2040)

Enhancements

  • SkyPilot now shows the spot job's resources and estimated cost before confirmation (#2524)
  • Switch to eager failover recovery policy for better spot lifetime (#2234)
  • Reduce the logging for launching spot controller (#2056)

Fixes

CLI & YAML interfaces

New Features

  • Users can now use environment variables to dynamically define file_mounts (docs, #2146)
  • sky status can now show the head IP of the cluster with -a or --ip flags (#2305, #2563)
  • sky down/stop/start defaults to a unique cluster if it exists and sky cancel without cluster cancels the latest task (#2325)

Enhancement

Fixes

  • Fixed the order of VMs in optimizer table when --cpus is provided (#2037)
  • Better handling when sky launch is interrupted (#2206, #2252)

Backend

New Features

  • Users can now open ports for their clusters with the ports field (docs, #2210, #2477)
  • Docker support in image_id - tasks can now be run inside docker containers (docs, #1910)
  • Users can now clone a cluster from an existing cluster's disk with the --clone-disk-from flag (#2098)
  • Users can now launch their own ray cluster on a SkyPilot cluster (#2020)

Enhancements

  • 30x faster failover for AWS and GCP when quotas are not available (#1953, #2187, #2313)
  • Faster sky launch by caching cluster IP address (#2400)
  • Job queue is now more resource efficient, with significant memory consumption reduction on remote cluster (#1636)
  • Cluster names no longer map directly to cloud cluster names. Instead, they are mapped to a unique cluster name on the cloud. This helps with isolation across users sharing cloud accounts. (#2403)
  • More efficient and robust stopping/termination for AWS (#2121)
  • sky status --refresh for STOPPED cluster is 10x faster (#2079)
  • Empty YAML fields are now allowed (#1890)

Fixes

Storage

New Features

  • IBM COS is now supported (#1966)
  • sky spot launch will now exclude files from .gitignore (#2018)

Enhancements

  • Deletion is now parallelized for faster deletion (#2058)
  • UX improvements for sky storage CLI (#2063, #2177)
  • GCS bucket mounting now uses gcsfuse v1.0.1 (#2470)

Fixes

Dependencies

  • Avoid buggy grpcio versions (#2055)
  • Pydantic is pinned to <2.0 (#2157)
  • PyYAML is pinned to >3.13, != 5.4.* to avoid issues with Cython 3 (#2256, #2514)
  • Ray <= 2.6.3 is supported on local machines (#2401)
  • pycryptodome, oauth2client are no longer required (#2515)

Clouds

AWS

  • H100 GPUs are now supported (#2323)
  • New docs for AWS cloud administrator about advanced login option (SSO and account switching) (#1888)
  • Insufficient permission is now handled gracefully (#2415, #2456)
  • Fixed a bug where existing AWS cluster would end up in INIT state after changing identity (#2442)
  • Fix fetching AZ when describe zones permission does not exist in all regions (#2463)

GCP

Azure

  • westus3 region is now supported (#2149)
  • Fix status refresh for Azure (#2120)
  • Fix Azure disk tier interruption for optimize progress (#2111)
  • Azure catalog fetching is more robust (#2115, #2553)

Lambda

  • Add H100 support for Lambda Cloud (#2010, #2323)
  • API rate limit is now handled with backoff and retry (#2265)
  • Errors are now more detailed (#2371)

Oracle Cloud Infrastructure (OCI)

Samsung Cloud Platform (SCP)

  • Samsung Cloud Platform (SCP) is now supported for single-node clusters (#1941, # 2001, #2014)

Examples

Full changelog

Thanks to all contributors!

New contributors: @JGoo1, @tobi, @HysunHe, @blucz, @shethhriday29, @MaoZiming, @ksasi, @pushmatrix, @hzeng-0, @saihtaungkham, @fozziethebeat, @n10dollar, @asaiacai, @mtaku3, @gbmarc1, @alex000kim, @steve-marmalade, @xzrderek, @sunny0826.

Many thanks to all contributors who contributed to this release!

@Michaelvll, @concretevitamin, @romilbhardwaj, @cblmemo, @HysunHe, @landscapepainter, @shethhriday29, @infwinston, @alex000kim, @suquark, @sunny0826, @gbmarc1, @MaoZiming, @xzrderek, @tobi, @steve-marmalade, @saihtaungkham, @pushmatrix, @n10dollar, @mtaku3, @ksasi, @hzeng-0, @fozziethebeat, @blucz, @asiaacai, @WoosukKwon, @JGoo1, @mraheja, @iojw, @hemildesai, @ewzeng, @aviweit, @Saikrishna-Achalla, @Cohen-J-Omer

Contributors

tobi, pushmatrix, and 32 other contributors
Assets 2