1usage: ./vast search offers [--help] [--api-key API_KEY] [--raw] <query>
2
3positional arguments:
4 query Query to search for. default: 'external=false
5 rentable=true verified=true', pass -n to ignore
6 default
7
8options:
9 -h, --help show this help message and exit
10 -t TYPE, --type TYPE Show 'bid'(interruptible) or 'on-demand' offers.
11 default: on-demand
12 -i, --interruptible Alias for --type=bid
13 -b, --bid Alias for --type=bid
14 -d, --on-demand Alias for --type=on-demand
15 -n, --no-default Disable default query
16 --disable-bundling Show identical offers. This request is more heavily
17 rate limited.
18 --storage STORAGE Amount of storage to use for pricing, in GiB.
19 default=5.0GiB
20 -o ORDER, --order ORDER
21 Comma-separated list of fields to sort on. postfix
22 field with - to sort desc. ex: -o
23 'num_gpus,total_flops-'. default='score-'
24 --url URL server REST api url
25 --raw output machine-readable json
26 --explain output verbose explanation of mapping of CLI calls to
27 HTTPS API endpoints
28 --api-key API_KEY api key. defaults to using the one stored in
29 ~/.vast_api_key
30
31Query syntax:
32
33 query = comparison comparison...
34 comparison = field op value
35 field = <name of a field>
36 op = one of: <, <=, ==, !=, >=, >, in, notin
37 value = <bool, int, float, etc> | 'any'
38
39note: to pass '>' and '<' on the command line, make sure to use quotes
40note: to encode a string query value (ie for gpu_name), replace any spaces ' ' with underscore '_'
41
42Examples:
43
44 ./vast search offers 'compute_cap > 610 total_flops < 5 datacenter=true'
45 ./vast search offers 'reliability > 0.99 num_gpus>=4 verified=false' -o 'num_gpus-'
46 ./vast search offers 'rentable = any'
47 ./vast search offers 'reliability > 0.98 num_gpus=1 gpu_name=RTX_3090'
48
49Available fields:
50
51 Name Type Description
52
53 bw_nvlink float bandwidth NVLink
54 compute_cap: int cuda compute capability*100 (ie: 650 for 6.5, 700 for 7.0)
55 cpu_cores: int # virtual cpus
56 cpu_cores_effective: float # virtual cpus you get
57 cpu_ram: float system RAM in gigabytes
58 cuda_vers: float cuda version
59 datacenter: bool show only datacenter offers
60 direct_port_count int open ports on host's router
61 disk_bw: float disk read bandwidth, in MB/s
62 disk_space: float disk storage space, in GB
63 dlperf: float DL-perf score (see FAQ for explanation)
64 dlperf_usd: float DL-perf/$
65 dph: float $/hour rental cost
66 driver_version string driver version in use on a host.
67 duration: float max rental duration in days
68 external: bool show external offers in addition to datacenter offers
69 flops_usd: float TFLOPs/$
70 geolocation: string Two letter country code. Works with operators =, !=, in, not in (e.g. geolocation not in [XV,XZ])
71 gpu_mem_bw: float GPU memory bandwidth in GB/s
72 gpu_name: string GPU model name (no quotes, replace spaces with underscores, ie: RTX_3090 rather than 'RTX 3090')
73 gpu_ram: float GPU RAM in GB
74 gpu_frac: float Ratio of GPUs in the offer to gpus in the system
75 gpu_display_active: bool True if the GPU has a display attached
76 has_avx: bool CPU supports AVX instruction set.
77 id: int instance unique ID
78 inet_down: float internet download speed in Mb/s
79 inet_down_cost: float internet download bandwidth cost in $/GB
80 inet_up: float internet upload speed in Mb/s
81 inet_up_cost: float internet upload bandwidth cost in $/GB
82 machine_id int machine id of instance
83 min_bid: float current minimum bid price in $/hr for interruptible
84 num_gpus: int # of GPUs
85 pci_gen: float PCIE generation
86 pcie_bw: float PCIE bandwidth (CPU to GPU)
87 reliability: float machine reliability score (see FAQ for explanation)
88 rentable: bool is the instance currently rentable
89 rented: bool is the instance currently rented
90 storage_cost: float storage cost in $/GB/month
91 total_flops: float total TFLOPs from all GPUs
92 verified: bool is the machine verified
93