Release 2023.09.01

Saturn Cloud release notes for 2023.09.01

Recipes

Recipe schema refactored so we have better support for different recipe types, as well as representing (optionally) the state of resources within the recipe. Now recipes have the following top level fields:

  • schema_version
  • type
  • spec
  • state

Jobs

Saturn Cloud jobs now supports running on multiple instances, complete with passing worker rank to the instance via environment variables and having clear logs that indicate which job is being executed

LLM Studio

Saturn cloud is now a complete end to end solution for fine tuning and serving LLMs. Templates have been deployed for

  • fine tuning LLMs
  • LLM model serving endpoints

Images

Images have been built to support CUDA 11.8 and 12.1. We are no longer building images for previous versions of CUDA. This should not impact users because CUDA 11.x code installs and runs fine with CUDA 11.8