endpoints
Route

4min
The https://run.vast.ai/route/ endpoint retrieves a worker to process a request.
Inputs
endpoint: The name of the endpoint group to use.
api_key: The api_key from Vast.ai associated with the account that controls the endpoint group.
cost: The estimated compute resources for the request.
Outputs
On Successful Worker Return
url: The address of the worker instance to send the request to.
reqnum: The request number corresponding to this worker instance. Note that workers expect to receive
requests in approximately the same order as these reqnums, but some flexibility is allowed due to potential
out-of-order requests caused by concurrency or small delays on the proxy server.
signature: The signature signed by the private key corresponding to the public key associated with the
autoscaler, available at https://run.vast.ai/pubkey/.
endpoint: Same as the input parameter to /route/.
cost: Same as the input parameter to /route/.
On Failure to Find Ready Worker
endpoint: Same as the input parameter to /route/.
status: The breakdown of workers in your endpoint group by status.
Calling the Route Endpoint in Python
For a guide on creating a client, refer to this section.
Updated 13 Jan 2025
Did this page help you?
Performance Tracking
Stats