Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.vast.ai/llms.txt

Use this file to discover all available pages before exploring further.

Benchmark a template against one or more GPUs and report performance per dollar.

​
Usage

vastai run benchmarks [OPTIONS]

​
Options

​
--template_hash
string
Template hash to benchmark. One of --template_hash or --template_id is required.
​
--template_id
integer
Template ID to benchmark. Wins over --template_hash if both are passed. One of --template_hash or --template_id is required.
​
--gpus
string
Comma-separated GPU names, same format as vastai search offers (e.g. RTX_4090,RTX_3090). An optional Nx prefix per token requests a multi-GPU configuration (e.g. "2x RTX_4090"). Defaults to RTX_5090,RTX_4090,RTX_3090,RTX_A6000.
​
--num_gpus
integer
GPUs per instance for tokens without an Nx prefix. If omitted, the count is auto-sized from the template’s gpu_total_ram filter so VRAM fits.
​
--timeout
integer
default:"3600"
Per-GPU safety ceiling in seconds. Each rental is torn down at this point even if no measured_perf was reported.
​
-y, --yes
flag
Skip the cost confirmation prompt.

​
Examples

# auto-sweep the default GPUs
vastai run benchmarks --template_hash 79ebdd2ebfb9d42cedf7a221c42d37a5

# specific GPUs
vastai run benchmarks --template_hash 393fa8572e6c73c927c8275fe4dffd53 --gpus RTX_4090,RTX_3090

# multi-GPU configurations via inline Nx prefix
vastai run benchmarks --template_hash 40ef49becc953aa910ee05bd4653b9b3 --gpus "2x RTX_4090, 2x RTX_3090"

# raw JSON output for piping into another tool
vastai run benchmarks --template_hash 40ef49becc953aa910ee05bd4653b9b3 --raw

​
Global Options

The following options are available for all commands:
OptionDescription
--url URLServer REST API URL
--retry NRetry limit
--rawOutput machine-readable JSON
--explainVerbose explanation of API calls
--api-key KEYAPI key (defaults to ~/.config/vastai/vast_api_key)