Usage
Arguments
Options
template hash (Note: if you use this field, you can skip search_params, as they are automatically inferred from the template)
search param string for search offers ex: “gpu_ram>=23 num_gpus=2 gpu_name=RTX_4090 inet_down>200 direct_port_count>2 disk_space>=64”
launch args string for create instance ex: “
--onstart onstart_wget.sh --env ‘-e ONSTART_PATH=https://s3.amazonaws.com/public.vast.ai/onstart_OOBA.sh’ --image atinoda/text-generation-webui:default-nightly --disk 64”Description
Example: vastai update workergroup 4242--search_params “gpu_ram>=23 num_gpus=2 gpu_name=RTX_4090 inet_down>200 direct_port_count>2 disk_space>=64” --launch_args “--onstart onstart_wget.sh --env ‘-e ONSTART_PATH=https://s3.amazonaws.com/public.vast.ai/onstart_OOBA.sh’ --image atinoda/text-generation-webui:default-nightly --disk 64” --gpu_ram 32.0 --endpoint_name “LLama” --endpoint_id 2