Improvements & Fixes
Improvements
Upgrade to Monthly: switch your billing cycle from hourly to monthly and save 5% by reserving instances on a monthly basis. To do that, access your server dashboard, select a server, navigate to the Details section, then click on the option for monthly billing located below. Check out the docs to learn more.
Schedule Server Deletion: it is now possible to schedule the deletion of reserved servers at the end of the billing cycle.
Launchpad Blueprints: the feature lets you easily deploy your existing models and save new ones for quick deployment in the future.
New SDK Versions
GO SDK
Version 1.3.0 is now available
Updated with resource tagging
NodeJS SDK
Version 1.7.0 is now available
Updated with resource tagging and scheduled server deletion
Terraform
Version 1.0.0 is now stable
Updated with resource tagging.
Resource Tagging
Categorize and manage resources using Tags.
You can now assign Tags to your Servers and VLANs to organize them by purpose, environment, or any other criteria relevant to your workflow.
Tagging makes it easier to search, filter, and group resources based on your specific needs.
You can create, edit, and delete tags through the Latitude.sh dashboard, API, or CLI. To access the new tagging feature on lsh, make sure you update it to Version 1.3.0.
Announcing Latitude.sh Launchpad
Today we are excited to announce that Latitude.sh Launchpad is now in public beta. Launchpad is a container-based GPU cloud for model fine-tuning and inference.
Our goal is to do as much of the heavy lifting as possible to give developers the tools they need to build on and serve open-source AI.
Sign up for the beta today →
We provision the containers directly on bare metal, which means your container's resources are fully dedicated. All containers are powered by 16 CPUs, 185 GB of RAM, 1 TB of NVMe Storage, and a single GPU, which you can choose from the two options available in our beta:
NVIDIA's H100 (80 GB vRAM)
NVIDIA's L40S (48 GB vRAM)
Multi-GPU containers and more GPU options will be available soon. Check out the docs →
NVIDIA's L40S is Now Available
We are excited to introduce a new GPU option to our products, NVIDIA's L40S. This new chip from NVIDIA is powered by the Ada Lovelace Architecture, designed with 4th Generation Tensor Cores, 3rd Generation Ray-Tracing Cores, and CUDA cores, bringing 91.6 Teraflops of FP32 tensor compute.
With 48 GB of vRAM, this new GPU is a great option for running inference and has enough memory to train models with up to 24 Billion parameters in FP16.
The L40S is now available for Latitude.sh Accelerate and Latitude.sh Launchpad.
Accelerate - From $1.04/hr
8 x NVIDIA L40S
Dual AMD 9354, 64 Cores @ 3.25 GHz
1536 GB RAM
4 x 3.8TB NVME
2 x 10 Gbps NIC
Launchpad - From $1.32/hr
1x NVIDIA L40S
16 CPUs
185 GB of RAM
1 TB of NVMe Storage
Introducing lsh, the Latitude.sh CLI
The Latitude.sh command-line interface, lsh, is now available!
The CLI brings Latitude.sh straight to your terminal: from auditing to provisioning, lsh makes it easy to retrieve data about your infrastructure and perform a variety of key actions.
With a simple command, you can quickly check out available plans, get information about your servers, assign a server to a virtual network, and scale your infrastructure up or down by adding or deleting servers, projects, API keys, SSH keys and VLANs. Getting started with the CLI is as easy as installing it and adding your API token. For more information about it, including the full list of commands and examples, click on the link below.
Our CLI is fully open source and we'll improve it based on your contributions. Go to the project repo and give us your feedback.