Vast.ai Docs

⌘K
Overview
Introduction
QuickStart
FAQ
Guides
Windows SSH/SCP Guide
Oobabooga (LLM webui)
Stable Diffusion
Disco Diffusion
Google Colab
GPU Instances
Launch Modes
Rental Types
Search Interface
Templates
SSH/SCP
Jupyter
Data Movement
Cloud Sync
Docker Execution Environment
CLI
Overview & Quickstart
CLI Commands
API Reference
Instances
Accounts
Machines
Hosts
Data Movement
Search
Docs powered by
Archbee
API Reference
Search

Search GPUs Advanced

2min
POST

Search for available GPUs to rent. Default options available for any parameter are gt, gte, lt, lte, and eq. Multiple options can be used simultaneously per filter.

BODY PARAMETERS
body
SearchGPUsRequest
*
Example: [object Object]
verified
object
Example: [object Object]
Whether the machine is verified.
compute_cap
object
Example: [object Object]
CUDA compute capability (multiplied by 100).
disk_space
object
Example: [object Object]
Disk storage space in GB.
order
array[]
Example:
Sorting order for the results. Formatted like ["dphtotal, "desc"], where the first option is the attribute to sort by, and the second option is the order. Options include ["score", dphtotal", "total_flops", "flops_per_dphtotal", "dlperf", "dlperf_per_dphtotal"]. The second options are ["asc", "desc"] for ascending and descending resepectively.
type
string
Type of GPU search (e.g., "on-demand").
bw_nvlink
number
Bandwidth NVLink.
cpu_cores
integer
Number of virtual CPUs.
cpu_cores_effective
number
Number of virtual CPUs you get.
cpu_ram
number
System RAM in gigabytes.
cuda_vers
number
CUDA version.
direct_port_count
integer
Open ports on the host's router.
disk_bw
number
Disk read bandwidth in MB/s.
dlperf
number
DL-perf score.
dlperf_usd
number
DL-perf per dollar.
dph
number
Hourly rental cost.
driver_version
string
Driver version in use on a host.
duration
number
Maximum rental duration in days.
external
boolean
Show external offers in addition to datacenter offers.
flops_usd
number
TFLOPs per dollar.
gpu_mem_bw
number
GPU memory bandwidth in GB/s.
gpu_name
string
GPU model name.
gpu_ram
number
GPU RAM in GB.
gpu_frac
number
Ratio of GPUs in the offer to GPUs in the system.
has_avx
boolean
Whether the CPU supports AVX instruction set.
id
integer
Unique ID of the instance.
inet_down
number
Internet download speed in Mb/s.
inet_down_cost
number
Internet download bandwidth cost in dollars per GB.
inet_up
number
Internet upload speed in Mb/s.
inet_up_cost
number
Internet upload bandwidth cost in dollars per GB.
machine_id
integer
Machine ID of the instance.
min_bid
number
Current minimum bid price in dollars per hour for interruptible instances.
num_gpus
integer
Number of GPUs.
pci_gen
number
PCIE generation.
pcie_bw
number
PCIE bandwidth (CPU to GPU).
reliability
number
Machine reliability score.
rentable
boolean
Whether the instance is currently rentable.
rented
boolean
Whether the instance is currently rented.
storage_cost
number
Storage cost in dollars per GB per month.
total_flops
number
Total TFLOPs from all GPUs.
RESPONSES
200
Successful response
SearchGPUs
offers
Offer[]
*




Updated 20 Jul 2023
Did this page help you?
PREVIOUS
Search GPUs
Docs powered by
Archbee