Instances Guide

overview this page contains all the info and actions for managing already rented instances on this page you can view your instances and their information connect to your instance/check networking info on your instance stop, destroy, or restart your instance copy data between instances or between an instance and cloud storage view debug info for your instance page walkthrough instance page understanding the main button on the right of every instance card is the main button ins main button when your instance is fully loaded and running, clicking on the main button allows you to access/connect to the instance for more details, see the "connecting to an instance" section below otherwise, the main button will show the status of your instance possible main button statuses open the instance is loaded clicking will attempt to access the instance through the browser connect the instance is loaded clicking will open a popup with ssh info inactive the instance is stopped, but the machine it is on is still running the instance may be restarted if the gpu on the machine is still available (i e , has not been rented out by another user) you will still be able to view logs on or copy data from your instance offline the machine your instance is on is offline your machine's host has been notified about the problem vast is unable to access the machine in any way scheduling the instance is attempting to restart the instance will restart as soon as the gpu on the machine is still available creating vast is telling the host machine to create your instance loading the host machine is trying to get your instance's docker image and run it connecting your instance's docker image is running, but vast is unable to verify that the instance can be connected to connecting to an instance ins connecting buttons vast provides several options to connect to your instance the image above shows a pytorch instance with both jupyter and ssh configured, and the buttons for connecting to the instance circled note that these buttons will not show unless the instance is loaded and running circled on the right are three quick access buttons, from top to bottom ssh (blue shell prompt) shows commands for ssh (circled in purple in the image above) open opens the web ui for your instance if one exists in this case, it opens jupyter replaced by a connect button if the instance used "run ssh" launch mode (circled in green in the image above) jupyter (jupyter logo) opens jupyter in the browser (circled in orange in the image above) circled in the top center in the image above in red is the ip/ports info button (gray) clicking this will give you information about ip addresses, open ports, and port mappings/forwardings to allow you to manually connect to your instance quick access ssh click the ssh (blue shell prompt) quick access button, as shown above if your instance was launched using the "run ssh" run mode, your main action button will read connect and will also be an ssh button you will see the following popup ssh popup it will display the commands for direct ssh connect (if your instance supports it) and proxy ssh connect we recommend using direct ssh connect if it is available it is faster and more reliable on linux or mac osx, you can simply copy and paste the ssh command from the ssh popup into your terminal for instructions on using ssh on windows, see the windows ssh guide https //docs vast ai/windows ssh guide we recommend, however, that windows users install windows subsystem for linux (wsl) for more convenient ssh access to vast you should not be asked for a password when accessing vast instances via ssh vast instances are designed to use keyfiles for authentication make sure you've set up an ssh key on your keys page in your account view my instance's ip addresses and open ports click on the button on your instance card showing an ip address you should now see a popup showing your ip address and port mappings you will see a listing of port mappings formatted as ip address\ external port > internal port in the popup you can also see whether the instance has a dynamic or static ip address if you want a static ip address, when renting new instance on the search page, you can check the "static ip address" checkbox to narrow your results accordingly to access an application listening at internal port from the outside, you must use the corresponding external port mapped to it stopping, restarting and destroying an instance on the right of your instance cards will be the destroy (trash can) and stop buttons ins start stop destroy button the button with the trashcan icon on it (circled in red in the image above) clicking this button will effectively destroy/delete this instance once an instance is destroyed no data from the instance or history of the instance will remain stop button the button with the square/stop icon on it (circled in purple in the image above) clicking this button will stop your instance from running your data will still be stored on the disk, so you will still be able to view logs and copy data in and out you will be able to restart the instance with all your data still there if the gpu has not been rented out by another user if your instance is stopped but not destroyed, you will still incur disk storage charges, possibly indefinitely make sure to destroy your instances when you no longer need your data if your instance is stopped/inactive, the stop button will be replaced with a restart button ins start button clicking the restart button (circled in red in the image above) will schedule your instance to restart as soon as the gpu is available again your instance will go into scheduling mode if it stays in scheduling mode for more than 30 seconds, it is likely that another user has rented the gpu you can cancel scheduling by clicking the stop button again if your instance seems that it is currently being rented by someone else, you can copy your data over to a new instance transfer data ins data buttons copy data button you can use this button to easily copy your data to another one of your instances (circled in red in the image above with the arrows icon on it) you can refer to our data movement documentation https //docs vast ai/instances/cloud sync for more information on this cloud sync button when you click this button you can set up syncing between the given instance and a cloud provider directory (circled in purple in the image above with the cloud icon on it) it is recommended to only use cloud sync feature on trusted datacenters instance card details id info on the top left of your instance cards you will see several id numbers associated with your instance ins id numbers from right to left they are instance id the unique identifying number associated with your instance (circled in red in the image above) machine id begins with m the unique identifying number associated with the machine your instance is on (circled in blue in the image above) host id begins with host a unique number identifying the host providing your machine (circled in green in the image above) machine info on the middle left of your instance card you will see a description of the hardware resources provided to your instance ins hardware resources status message on the bottom left you will see a status message emitted by docker when the machine attempts to load your docker container ins status contract info in the section of the instance care circled in red below, you can find the contract information for the given instance the age of the instance since its creation and the expiry date of the instance will be listed here ins contract buttons to manage the instance ins logs reboot label label the instance button (circled in red in the image above) reboot the instance button (circled in green in the image above) view the logs button (circled in green in the image above) common issues & questions can i change my existing instance's template? you can't change existing instances templates are recipes for new instances, so any changes to a template only effect new instances how can i increase the storage of the running instance? you can't increase the amount of disk space on an existing instance, but you can create a new instance with more storage, and then transfer your data from the existing instance to the new instance here's our documentation https //docs vast ai/instances/data movement on moving data from one instance to another why is my instance taking so long to start upon creation? start up time depends on the template and is usually under 5 minutes if you’ve been waiting over 20 minutes, you should make sure you are using a recommended template and try a different machine you are not charged while instances are loading note keep in mind some templates and some machines are not "compatible" in special circumstances why is my instance stuck on "loading" upon creation? with slow internet and a big image, it can take an hour or more to download pick a machine with faster internet why is my instance stuck on "scheduling" when trying to restart it? when you stop an instance, the gpu(s) it was using may get reassigned when you later then try to restart the instance, it tries to get those gpu(s) back that is the "scheduling" phase if another high priority job is currently using any of the same gpu(s), your instance will be stuck in "scheduling" phase until the conflicting jobs are done we know this is not ideal, and we are working on ways to migrate containers across gpus and machines, but until then we recommend not stopping an instance unless you are ok with the risk of waiting a while to restart it what can i do if my instance is stuck on "scheduling" when trying to restart it? you can copy data over, if any additional installation steps were done on top of the template, that wil need to be redone why did i get the error "offer is no longer avaliable"? if you get an error like "offer is no longer available" when clicking the rent button, this means that the specific machine/gpu slot you requested is no longer available in situations of low availability due to demand surges, many people are trying to rent the same offers at once, and only one can succeed why is my instance stuck on "connecting"? the port set up on the machine you are using may be broken report the machine and try another why is this machine shown as offline? if the machine is showing offline, that indicates it has lost connection to our servers often it is an unanticipated internet or power issue sometimes it is because the machine was taken offline by the host due to either maintenance, or unforeseen circumstances if you didn't get a message from the host that the machine was going down for maintenance, then its probably an unforeseen problem the host operator gets an automatic notification, the better hosts will fix most problems the same day, but it depends on the reason what happens to my data when i destroy/delete my instance? your data will get deleted when your instance gets deleted/destroyed you can stop it before deleting and copy data or use the cloud storage integration to synchronize your data before you destroy your instance can i view past instances? unfortunately, no your recent template history does save a decent amount of your config options can a host see or access my files? hosts can generally see or access your files they're not allowed to do so, but we have no way of making it impossible for them to see things that are on machines they physically control if you have sensitive data, we recommend using a datacenter is there any way to execute my dockerfile? you cannot run docker in our instances because they are docker containers themselves how come some machines say only ", us" with no state? are they more sketchy to deploy on? no, it just means that the exact geolocation isn't working at a state level it is not sketchy can i change my ssh key when i already have an instance? any ssh key changes should propagate to existing instances i get the error "permission denied (publickey) " when trying to ssh? you can find documentation on the ssh setup in our docs https //docs vast ai/instances/sshscp we suggest you go step by step through this page to ensure your ssh key is set up properly why don't i see the remaining time of my instance i'm renting? if it doesn't show a remaining duration, it has expired do you only have dockerized instances? yes, currently we provide linux docker instances we do not offer vm or bare metal yet, but plan to in the near future am i charged for "loading" instances? no, you are not charged when it says "loading" what's the difference between on demand and reserved machines? we currently offer three main rental pricing options on demand (high priority), reserved (high priority), and interruptible (low priority) on demand instances have a fixed price set by the host and run for as long as the client wants prepaid instances are created from on demand by depositing credits to purchase longer time blocks (months) in advance, in exchange for significant discounts (up to 50%, depending on the provider) interruptible instances use a bidding system clients set a bid price for each instance; the host then decides which instances run when to maximize revenue (naturally favoring higher bidders) for more information on we have additional docs on rental types https //docs vast ai/instances/rental types and reserving instances https //docs vast ai/instances/reserved instance discounts can i have external storage that can store the checkpoint models and use it when i connect to an instance? we don't have external storage volumes at this time, but you can store checkpoints to disk you can access instance storage even when the instance is stopped for information on data movement, check out our docs https //docs vast ai/instances/data movement i am trying to launch a docker container in the cloud instance i get this error "cannot connect to the docker daemon at unix ///var/run/docker sock is the docker daemon running?" you cannot run docker in our instances because they are docker containers themselves my instance is broken, please fix my machine? although we make every effort to remove faulty systems from our verified list, there is still a possibility that the hardware may fail it's important to note that we do not own or manage the hardware on the list as vastai is simply a third party marketplace if you encounter any difficulties, we suggest that you try a few other instances on different machines before assuming that the docker image is faulty if you do encounter any issues, please report them and destroy your instance to avoid unnecessary costs my instance is stuck on loading? this is normal this usually takes about 30 seconds if the image is fully cached, and can take anywhere from minutes to hours if it is not cached my instance is giving me this error "unable to find image 'ubuntu20 04 latest/ssh ' locally error response from daemon get "https /v2/" http no host in request url" you set the docker image path/tag correctly a lot of times we see invalid docker image paths such as "ubuntu20 04 latest/ssh " when you actually want something like this "nvidia/cuda 12 0 1 devel ubuntu20 04" if you run into an error like this we recommend using a recommended template to ensure the docker image path is valid if you cannot run docker pull \<your docker image path> in your local terminal successfully and you get "error response from daemon get "https /v2/" http no host in request url", then your docker image path is incorrect why did my instance's ip address change? some instances have dynamic ip addresses while others have static ones you can click the blue ip button on your instance card to see which kind your current instances are if you want to ensure you are renting instances with static ips when renting new instance on the search page you can check the "static ip address" checkbox to narrow your results accordingly