Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
Docker image path
"ghcr.io/huggingface/text-generation-inference:1.0.3"
Docker image tag
Docker environment variables and run arguments
"-p 3000:3000 -e MODEL_ARGS='--model-id TheBloke/Llama-2-7B-chat-GPTQ'"
Command to run on instance startup
Enable direct Jupyter connection
Enable direct SSH connection
Use JupyterLab instead of Jupyter Notebook
Type of instance runtime
jupyter
, ssh
, args
Enable SSH access
Jupyter notebook directory
Docker repository requiring authentication
Additional machine search filters
Recommended disk space in GB