> ## Documentation Index
> Fetch the complete documentation index at: https://docs.vast.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# vastai update endpoint

Update an existing endpoint group

## Usage

```bash theme={null}
vastai update endpoint ID [OPTIONS]
```

## Arguments

<ParamField path="id" type="integer" required>
  id of endpoint group to update
</ParamField>

## Options

<ParamField path="--min_load" type="number">
  minimum floor load in perf units/s  (token/s for LLms)
</ParamField>

<ParamField path="--min_cold_load" type="number">
  minimum floor load in perf units/s  (token/s for LLms), but allow handling with cold workers
</ParamField>

<ParamField path="--endpoint_state" type="string">
  active, suspended, or stopped
</ParamField>

<ParamField path="--target_util" type="number">
  target capacity utilization (fraction, max 1.0, default 0.9)
</ParamField>

<ParamField path="--cold_mult" type="number">
  cold/stopped instance capacity target as multiple of hot capacity target (default 2.5)
</ParamField>

<ParamField path="--cold_workers" type="integer">
  min number of workers to keep 'cold' when you have no load (default 5)
</ParamField>

<ParamField path="--max_workers" type="integer">
  max number of workers your endpoint group can have (default 20)
</ParamField>

<ParamField path="--endpoint_name" type="string">
  deployment endpoint name (allows multiple workergroups to share same deployment endpoint)
</ParamField>

<ParamField path="--max_queue_time" type="number">
  maximum seconds requests may be queued on each worker (default 30.0)
</ParamField>

<ParamField path="--target_queue_time" type="number">
  target seconds for the queue to be cleared (default 10.0)
</ParamField>

<ParamField path="--inactivity_timeout" type="integer">
  seconds of no traffic before the endpoint can scale to zero active workers
</ParamField>

## Description

Example: vastai update endpoint 4242 `--min_load` 100 `--target_util` 0.9 `--cold_mult` 2.0 `--endpoint_name` "LLama"

## Examples

```bash theme={null}
vastai update endpoint <ID>
```

## Global Options

The following options are available for all commands:

| Option          | Description                                           |
| --------------- | ----------------------------------------------------- |
| `--url URL`     | Server REST API URL                                   |
| `--retry N`     | Retry limit                                           |
| `--raw`         | Output machine-readable JSON                          |
| `--explain`     | Verbose explanation of API calls                      |
| `--api-key KEY` | API key (defaults to `~/.config/vastai/vast_api_key`) |