GPU Instances

Launch Modes

3min

We currently support 3 launch modes: entrypoint, ssh, and jupyter.

Entrypoint

For this launch mode we simply run a docker container from your specified image as is. The docker image entrypoint is the main run process. Your docker image is then responsible for setting up ssh, jupyter, or other connections.

SSH

For this launch option we setup an ssh connection using proxy and or direct connections where appropriate. If the machine supports open ports our system will try to setup both a direct ssh connection and a backup proxy connection. This is mostly automatic under the hood, but it does require that your docker image is compatible with typical ssh daemon setup.

With the SSH launch option your docker image entrypoint is not called as we must override it. Instead we allow you to specify an onstart script which is called as part of the new entrypoint.

So if you are using making a template from an existing docker image, you typically will want to find its entrypoint command and move that to the onstart.

Jupyter

For this launch option we setup a jupyter using a proxy and or direct connections where appropriate. If the machine supports open ports our system will try to setup a direct jupyter connection with a custom HTTPS certificate. This is mostly automatic under the hood, but it does require that your docker image is compatible with typical jupyter setup.

With the Jupyter launch option your docker image entrypoint is not called as we must override it. Instead we allow you to specify an onstart script which is called as part of the new entrypoint.

So if you are using making a template from an existing docker image, you typically will want to find its entrypoint command and move that to the onstart.

Updated 25 Mar 2024
Doc contributor
Did this page help you?