Introduction

A lower level organization that lives within an Endpoint. It consists of a template (with extra filters for search), a set of GPU instances (workers) created from that template, and hyperparameters.

Worker_Groups

The highest level clustering of instances for the Serverless engine, consisting of a named endpoint string, a collection of Workergroups, and hyperparameters.

Endpoints

The Vast PyWorker is a Python web server designed to run alongside a machine learning model instance, providing Vast.ai Serverless compatibility.

PyWorker

Workergroup

Endpoint

The minimum number of workers you want to keep "cold" (meaning stopped and fully loaded) when your group has no load.

min_cold_workers

The maximum number of workers your router group can have.

max_workers

Overview & quickstart

Commands

Permissions-and-authorization

Python SDK Usage

attach ssh-key

cancel copy

copy

cancel sync

cloud copy

change bid

create instance

destroy instance

manage instance

show instance

detach ssh-key

execute

show logs

prepay instance

reboot instance

recycle instance

show ssh-keys

show instances

Instances

cancel maint

cleanup machine

list machine

remove defjob

show reports

schedule maint

set defjob

set min-bid

show machines

unlist machine

Machines

create api-key

show api keys

create env-var

delete env var

show env vars

update env var

create ssh-key

show ssh keys

create subaccount

set user

delete api key

show api key

delete ssh key

update ssh key

reset api key

show connections

show ipaddrs

show subaccounts

show team role

show user

transfer credit

Accounts

create workergroup

show workergroup

create endpoint

show endpoints

delete workergroup

update workergroup

delete endpoint

update endpoint

get workergroup logs

get workergroup workers

get endpoint logs

get endpoint workers

route

Serverless

create team

create team role

destroy team

invite team member

remove team member

remove team role

show team members

update team role

show team roles

Team

create template

Templates

search templates

search benchmarks

search offers

Search

delete volume

rent volume

list volumes

search volumes

unlist volume

Volumes

search invoices

show deposit

show earnings

show invoices

Billing

Vast.ai API

cli