This page contains some of the more commonly used CLI commands for your convenience to reference.

For the entire list of Vast CLI commands visit our 

Just about everything! Vast's CLI repository is open-source and we are constantly improving our CLI functions! For more information about our CLI visit our 

 for the comprehensive list of the current commands.

Keys

The Vast PyWorker is a Python web server designed to run alongside a machine learning model instance, providing autoscaler compatibility.

PyWorker

A lower level organization that lives within an Endpoint. It consists of a template (with extra filters for search), a set of GPU instances (workers) created from that template, and hyperparameters.

Worker_Group

The highest level clustering of instances for the autoscaler, consisting of a named endpoint string, a collection of Worker groups, and hyperparameters.

Endpoint

The minimum number of workers you want to keep "cold" (meaning stopped and fully loaded) when your group has no load.

min_cold_workers

The maximum number of workers your router group can have.

max_workers

Instance Portal

Templates

Guides

Introduction

QuickStart

Instances Help

Billing Help

Networking

Troubleshooting

Data Movement

overview

Creating Templates for GROBID

Creating a Custom Template

PyTorch

AI/ML Frameworks

CUDA

GPU Programming

Linux Virtual Desktop

Linux Virtual Machines

Virtual Computing

TTS with Nari Labs Dia

AI Audio Generation

Ollama + Webui

Oobabooga (LLM webui)

Huggingface TGI with LLama3

Quantized GGUF models (cloned)

vLLM (LLM inference and serving)

AI Text Generation

Image Generation

Stable Diffusion

Disco Diffusion

AI Image Generation

Video Generation

AI Video Generation

Infinity Embeddings

Text Embeddings

Blender in the Cloud

Blender Batch Rendering

3D Rendering

Mining on Bittensor

Cryptocurrency

Google Colab

Development Tools

Whisper ASR Guide

Audio-to-Text

use-cases

Teams Overview

Edit team

Teams Quickstart

Team Creation

Teams Invitations

Teams Roles

Transfer Team Ownership

team

Overview

Guide to Taxes

Datacenter Status

Payment

Verification Stages

hosting

Create Your Own Multi-Node Cluster

distributed-computing

Settings

Volumes

Billing

Earning

Instances Guide

Search

Referral Program

Members

Console

RTX 5 Series

Specific GPUs