Instances Guide

overview this page contains all the info and actions for managing already rented instances on this page you can view your instances and their information connect to your instance/check networking info on your instance stop, destroy, or restart your instance copy data between instances or between an instance and cloud storage view debug info for your instance page walkthrough understanding the main button on the left of every instance card is the main button when your instance is fully loaded and running, clicking on the main button allows you to access/connect to the instance for more details, see the "connecting to an instance" section below otherwise, the main button will show the status of your instance possible main button statuses open the instance is loaded clicking will attempt to access the instance through the browser connect the instance is loaded clicking will open a popup with ssh info inactive the instance is stopped, but the machine it is on is still running the instance may be restarted if the gpu on the machine is still available (i e , has not been rented out by another user) you will still be able to view logs on or copy data from your instance offline the machine your instance is on is offline your machine's host has been notified about the problem vast is unable to access the machine in any way scheduling the instance is attempting to restart the instance will restart as soon as the gpu on the machine is still available creating vast is telling the host machine to create your instance loading the host machine is trying to get your instance's docker image and run it connecting your instance's docker image is running, but vast is unable to verify that the instance can be connected to connecting to an instance vast provides several options to connect to your instance the image above shows a pytorch instance with both jupyter and ssh configured there are three quick access buttons available once your instance is fully loaded and running ssh (shell prompt) displays the ssh command needed to connect to your instance (indicated by the purple arrow in the image above) open launches the web ui associated with your instance, such as jupyter if the instance was launched using the "run ssh" mode, this button will appear as a connect button instead (green arrow in the image) jupyter (jupyter logo) directly opens jupyter in your browser (orange arrow in the image above) circled in the top center in the image above in red is the ip/ports info button clicking this will give you information about ip addresses, open ports, and port mappings/forwardings to allow you to manually connect to your instance quick access ssh click the ssh (shell prompt) quick access button, as shown above if your instance was launched using the "run ssh" run mode, your main action button will read connect and will also be an ssh button you will see the following popup it will display the commands for direct ssh connect (if your instance supports it) and proxy ssh connect we recommend using direct ssh connect if it is available it is faster and more reliable on linux or mac osx, you can simply copy and paste the ssh command from the ssh popup into your terminal for instructions on using ssh on windows, see the windows ssh guide https //docs vast ai/windows ssh guide we recommend, however, that windows users install windows subsystem for linux (wsl) for more convenient ssh access to vast you should not be asked for a password when accessing vast instances via ssh vast instances are designed to use keyfiles for authentication make sure you've set up an ssh key on your account page view my instance's ip addresses and open ports click on the button on your instance card showing an ip address you should now see a popup showing your ip address and port mappings you will see a listing of port mappings formatted as ip address\ external port > internal port in the popup you can also see whether the instance has a dynamic or static ip address if you want a static ip address, when renting new instance on the search page, you can check the "static ip address" checkbox to narrow your results accordingly to access an application listening at internal port from the outside, you must use the corresponding external port mapped to it stopping, restarting and destroying an instance on the left of your instance cards will be the destroy (trash can) and stop buttons destroy button the button with the trashcan icon on it (circled in red in the image above) clicking this button will effectively destroy/delete this instance once an instance is destroyed no data from the instance or history of the instance will remain stop button the button with the square/stop icon on it (circled in purple in the image above) clicking this button will stop your instance from running your data will still be stored on the disk, so you will still be able to view logs and copy data in and out you will be able to restart the instance with all your data still there if the gpu has not been rented out by another user if your instance is stopped but not destroyed, you will still incur disk storage charges, possibly indefinitely make sure to destroy your instances when you no longer need your data if your instance is stopped/inactive, the stop button will be replaced with a restart button clicking the restart button (circled in red in the image above) will schedule your instance to restart as soon as the gpu is available again your instance will go into scheduling mode if it stays in scheduling mode for more than 30 seconds, it is likely that another user has rented the gpu you can cancel scheduling by clicking the stop button again if your instance seems that it is currently being rented by someone else, you can copy your data over to a new instance transfer data copy data button you can use this button to easily copy your data to another one of your instances (circled in red in the image above with the arrows icon on it) you can refer to our data movement documentation https //docs vast ai/instances/cloud sync for more information on this cloud sync button when you click this button you can set up syncing between the given instance and a cloud provider directory (circled in blue in the image above with the cloud icon on it) it is recommended to use the cloud sync feature only on trusted data centers, indicated by the secure icon on the instance card instance card details id info on the left side of your instance cards, you'll find several id numbers associated with your instance instance id this is the unique identifier for your instance host / datacenter id this is the unique identifier for the host providing the machine machine id this is the unique identifier for the machine hosting your instance machine info here, you’ll find machine details including a description of the hardware resources allocated to your instance status message on the bottom left you will see a status message emitted by docker when the machine attempts to load your docker container contract info on the top of the instance card, you can find the contract information for the given instance the age of the instance since its creation (indicated by green arrow) and the expiry date of the instance (indicated by blue arrow) buttons to manage the instance label the instance – allows you to assign a custom label for easier identification (circled in red in the image above ) reboot the instance – restarts the instance without deleting any data (circled in green in the image above ) view the logs – opens the log viewer to help you troubleshoot or monitor activity (circled in pink in the image above ) common issues & questions can i change my existing instance's template? you can't change existing instances templates are recipes for new instances, so any changes to a template only effect new instances how can i increase the storage of the running instance? you can't increase the amount of disk space on an existing instance, but you can create a new instance with more storage, and then transfer your data from the existing instance to the new instance here's our documentation https //docs vast ai/instances/data movement on moving data from one instance to another why is my instance taking so long to start upon creation? start up time depends on the template and is usually under 5 minutes if you’ve been waiting over 20 minutes, you should make sure you are using a recommended template and try a different machine you are not charged while instances are loading note keep in mind some templates and some machines are not "compatible" in special circumstances why is my instance stuck on "loading" upon creation? with slow internet and a big image, it can take an hour or more to download pick a machine with faster internet why is my instance stuck on "scheduling" when trying to restart it? when you stop an instance, the gpu(s) it was using may get reassigned when you later then try to restart the instance, it tries to get those gpu(s) back that is the "scheduling" phase if another high priority job is currently using any of the same gpu(s), your instance will be stuck in "scheduling" phase until the conflicting jobs are done we know this is not ideal, and we are working on ways to migrate containers across gpus and machines, but until then we recommend not stopping an instance unless you are ok with the risk of waiting a while to restart it what can i do if my instance is stuck on "scheduling" when trying to restart it? you can copy data over, if any additional installation steps were done on top of the template, that wil need to be redone why did i get the error "offer is no longer avaliable"? if you get an error like "offer is no longer available" when clicking the rent button, this means that the specific machine/gpu slot you requested is no longer available in situations of low availability due to demand surges, many people are trying to rent the same offers at once, and only one can succeed why is my instance stuck on "connecting"? the port set up on the machine you are using may be broken report the machine and try another why is this machine shown as offline? if the machine is showing offline, that indicates it has lost connection to our servers often it is an unanticipated internet or power issue sometimes it is because the machine was taken offline by the host due to either maintenance, or unforeseen circumstances if you didn't get a message from the host that the machine was going down for maintenance, then its probably an unforeseen problem the host operator gets an automatic notification, the better hosts will fix most problems the same day, but it depends on the reason what happens to my data when i destroy/delete my instance? your data will get deleted when your instance gets deleted/destroyed you can stop it before deleting and copy data or use the cloud storage integration to synchronize your data before you destroy your instance can i view past instances? unfortunately, no your recent template history does save a decent amount of your config options can a host see or access my files? hosts can generally see or access your files they're not allowed to do so, but we have no way of making it impossible for them to see things that are on machines they physically control if you have sensitive data, we recommend using a datacenter is there any way to execute my dockerfile? you cannot run docker in our instances because they are docker containers themselves how come some machines say only ", us" with no state? are they more sketchy to deploy on? no, it just means that the exact geolocation isn't working at a state level it is not sketchy can i change my ssh key when i already have an instance? any ssh key changes should propagate to existing instances i get the error "permission denied (publickey) " when trying to ssh? you can find documentation on the ssh setup in our docs https //docs vast ai/instances/sshscp we suggest you go step by step through this page to ensure your ssh key is set up properly why don't i see the remaining time of my instance i'm renting? if it doesn't show a remaining duration, it has expired do you only have dockerized instances? yes, currently we provide linux docker instances we do not offer vm or bare metal yet, but plan to in the near future am i charged for "loading" instances? no, you are not charged when it says "loading" what's the difference between on demand and reserved machines? we currently offer three main rental pricing options on demand (high priority), reserved (high priority), and interruptible (low priority) on demand instances have a fixed price set by the host and run for as long as the client wants prepaid instances are created from on demand by depositing credits to purchase longer time blocks (months) in advance, in exchange for significant discounts (up to 50%, depending on the provider) interruptible instances use a bidding system clients set a bid price for each instance; the host then decides which instances run when to maximize revenue (naturally favoring higher bidders) for more information on we have additional docs on rental types https //docs vast ai/instances/rental types and reserving instances https //docs vast ai/instances/reserved instance discounts can i have external storage that can store the checkpoint models and use it when i connect to an instance? at this time, we only offer docker volumes for storage on machines, meaning you must rent a storage contract on the same machine you plan on running an instance on to use it you can copy this volume to other machines with available storage contracts to use the volume there as well you can also always store checkpoints directly on the instance,which you can access even when the instance is stopped for information on data movement, check out our docs https //docs vast ai/instances/data movement i am trying to launch a docker container in the cloud instance i get this error "cannot connect to the docker daemon at unix ///var/run/docker sock is the docker daemon running?" you cannot run docker in our instances because they are docker containers themselves my instance is broken, please fix my machine? although we make every effort to remove faulty systems from our verified list, there is still a possibility that the hardware may fail it's important to note that we do not own or manage the hardware on the list as vastai is simply a third party marketplace if you encounter any difficulties, we suggest that you try a few other instances on different machines before assuming that the docker image is faulty if you do encounter any issues, please report them and destroy your instance to avoid unnecessary costs my instance is stuck on loading? this is normal this usually takes about 30 seconds if the image is fully cached, and can take anywhere from minutes to hours if it is not cached my instance is giving me this error "unable to find image 'ubuntu20 04 latest/ssh ' locally error response from daemon get "https /v2/" http no host in request url" you set the docker image path/tag correctly a lot of times we see invalid docker image paths such as "ubuntu20 04 latest/ssh " when you actually want something like this "nvidia/cuda 12 0 1 devel ubuntu20 04" if you run into an error like this we recommend using a recommended template to ensure the docker image path is valid if you cannot run docker pull \<your docker image path> in your local terminal successfully and you get "error response from daemon get "https /v2/" http no host in request url", then your docker image path is incorrect why did my instance's ip address change? some instances have dynamic ip addresses while others have static ones you can click the blue ip button on your instance card to see which kind your current instances are if you want to ensure you are renting instances with static ips when renting new instance on the search page you can check the "static ip address" checkbox to narrow your results accordingly