FAQ

introduction what is vast ai? vast ai is a cloud computing, matchmaking, and aggregation service focused on lowering the price of compute intensive workloads our software allows anyone to easily become a host by renting out their hardware our web search interface allows users to quickly find the best deals for compute according to their specific requirements what is the secure cloud (only trusted datacenters) filter? vast ai partners with vetted datacenter providers all over the globe these partners have their equipment in certified locations that are current with iso 27001 https //www iso org/standard/27001 and/or tier 3/4 https //uptimeinstitute com/tiers standards vast ai has verified that this equipment is in these facilities and that their certifications are up to date for sensitive or production workloads, we recommend checking the "secure cloud" filter look for the blue datacenter label how does vast ai work in a nutshell? hosts download and run our management software, list their machines, configure prices, and set any default jobs clients then find suitable machines using our flexible search interface, rent their desired machines, and finally run commands or start ssh sessions with a few clicks what are vast's advantages? vast ai provides a simple interface to rent powerful machines at the best possible prices, reducing gpu cloud computing costs by 3x to 5x consumer computers and consumer gpus, in particular, are considerably more cost effective than equivalent enterprise hardware we are helping the millions of underutilized consumer gpus around the world enter the cloud computing market for the first time what operating systems are provided? windows? vast currently provides linux docker instances, mostly ubuntu based, no windows what interface is provided? currently, vast has ssh access (for ssh instances), jupyter instances with jupyter gui, or a command only instance mode we do not provide remote desktop dlperf what is dlperf? dlperf (deep learning performance) is our own scoring function it is an approximate estimate of performance for typical deep learning tasks currently, dlperf predicts performance well in terms of iters/second for a few common tasks such as training resnet50 cnns for example, on these tasks, a v100 instance with a dlperf score of 21 is roughly 2x faster than a 1080ti with a dlperf of 10 it turns out that many tasks have similar performance characteristics, but naturally, if your task is very unusual in its compute requirements, the dlperf score may not be very predictive a single score can never be accurate for predicting performance across a wide variety of tasks; the best we can do is approximate performance on many tasks with a weighted combination although far from perfect, dlperf is more useful for predicting performance than tflops for most tasks rental types we currently offer two rental types on demand (high priority) and interruptible (low priority) on demand instances have a fixed price set by the host and run for as long as the client wants interruptible instances use a bidding system clients set a bid price for their instance; the current highest bid is the instance that runs, the others are paused are vast ai interruptible instances the same as aws spot or gce interruptible? they are similar but have a few key differences aws spot instances and gce interruptible instances both can be interrupted by on demand instances, but they do not use a direct bidding system in addition, gce interruptible instances can only run for 24 hours vast ai interruptible instances use a direct bidding system but are otherwise not limited what happens when my interruptible instance loses the bid? if another user places a higher bid or creates an on demand rental for the same resources, then your instance will be stopped stopping an instance kills the running processes, so when you are using interruptible instances, it's important to save your work to disk also, we highly recommend having your script periodically save your outputs to cloud storage as well because once your instance is interrupted, it could be a long wait until it resumes instances how can i find open button token in my container? ssh into the machine where your contaner is running (instance) or open jupyter terminal via instance portal run the following command to print the token echo $open button token alternatively, check the instance logs how can i restart my programs once the instance restarts? if you use the "custom command" option, then your command will run automatically when the instance starts up however, if you are using an ssh instance, there is no default startup command you can put startup commands in "/root/onstart sh" this startup script will be found and run automatically on container startup i see my instance has a lifetime what does that mean? every instance offer on the create page has a max duration when you accept an offer and create an instance, this max duration becomes the instance lifetime and begins ticking down when the lifetime expires, the instance is automatically stopped the host can extend the contract, which will add more lifetime to your instance, or they may not it's up to them assume your instance will be lost once the lifetime expires; copy out any important data before then how can i set environment variables? use the e docker syntax in the docker create/run options for example, to set the env variables tzc to utc and taskid to "test" e tz=utc e taskid="test" any environment variables you set will be visible only to your onstart script (or your entrypoint for entrypoint launch mode) when using the ssh or jupyter launch modes, your env variables will not be visible inside your ssh/tmux/jupyter session by default to make custom environment variables visible to the shell, you need to export them to /etc/environment add something like the following to the end of your onstart to export any env variables containing an underscore ' ' env | grep >> /etc/environment; or to export all env variables env >> /etc/environment; environment variables can also be set in the user account settings page, in which case the env variables will be injected into every container onstart how can i get the instance id from within the container? the environment variable vast containerlabel is defined in the container ex root\@c 38250 $ echo $vast containerlabel c 38250 how can i stop the instance from within the instance? a special instance api key should already be installed in your container you can just install the vastai cli and use the stop command root\@c 38250 $ pip install vastai; then test it by starting the instance (which is a no op as the instance is already running) vastai start instance $container id; if that works then you can stop the instance as well vastai stop instance $container id; if $container id is not defined check your environment variables using the 'env' command if you are missing the predefined env variables from an ssh session you may need to add a command to export them to /etc/environment (see above) if you don't have the instance api key for whatever reason, you can also generate it first run the following from inside the instance to create a special per instance api key and save it in the appropriate location cat / ssh/authorized keys | md5sum | awk '{print $1}' > ssh key hv; echo n $vast containerlabel | md5sum | awk '{print $1}' > instance id hv; head c 1 q ssh key hv instance id hv > / vast api key; then install the cli with pip or download latest from github apt get install y wget; wget https //raw\ githubusercontent com/vast ai/vast python/master/vast py o vast; chmod +x vast; how can i launch another docker container from within the instance? vast currently does not currently support docker within docker due to security constraints you will need to launch each docker container on a separate instance networking how can i open custom ports? add p arguments in the docker create/run options box in the template configuration or image config editor pop up menu to open ports 8081 and 8082, use something like this p 8081 8081 p 8082 8082 this will result in additional arguments to docker create/run to expose those internal ports, which will be mapped to random external ports any ports exposed in these docker options are in addition to ports exposed through expose commands in the docker image, and the ports 22 or 8080 which may be opened automatically for ssh or jupyter after the instance has loaded, you can find the corresponding external public ip by opening the ip port info pop up (button on top of the instance) and then looking for something like 65 130 162 74 33526 > 8081/tcp in this case, the public ip 65 130 162 74 33526 can be used to access anything you run on port 8081 inside the instance as a simple test case, you can run a simple minimal web browser inside the instance with the following command python m http server 8081 which you would then access in this example by loading 65 130 162 74 33526 in your web browser how can i open an identity port map like 32001 32001 where external are the same? just use an out of range port above 70000 p 70000 70000 p 70001 70001 jupyter i'm getting very slow transfer speeds using the jupyter download/upload? you probably created a proxy instance, which is the default the proxy instance is still useful for some use cases as you can get full speed downloading files with wget, git, external ftp, cloud storage, etc however the built in upload/download buttons can be very slow (especially when the proxy servers are overloaded) so if you want full speed transfers using the jupyter upload/download gui, you need to create a direct https instance on the create page, select edit image & config, open your image template (usually pytorch), then select the direct https mode under jupyter then create a new instance you will need to import a certificate (see below) what is this https website unsecure warning? the jupyter direct https option is faster than the proxy option, but it requires installing a new certificate in your browser download the certificate file https //console vast ai/static/jvastai root cer , then go into your browser certificate settings and add the new certificate in google chrome you click the little 3 dot menu in the top right corner, then settings in the drop down menu, then privacy and security on the left, then security in the middle, then scroll down to the advanced section and click on manage certificates, then the authorities tab, and finally the import button and select the certificate file you just downloaded (jvastai root cer) i'm deleting files in juypter but it's not freeing disk space! how do i truly delete? by design/default the delete button in jupyter does not actually delete files, it just moves them to the trash folder, which is located at / local/share/trash so you can delete the trash folder in a terminal using rm r rm r / local/share/trash how do i run colab notebooks? just select the recommended pytorch image https //cloud vast ai/?ref id=43484\&template id=e4c5e88bc289f4eecb0c955c4fe7430d which has the jupyter launch mode pre enabled select a gpu and start the instance once it loads, click on the jupyter button on the bottom right of the instance card to start jupyter then download the colab notebook as a ipynb file and upload it to the instance in jupyter then just click on that to run the notebook depending on the notebook you may need to install additional dependencies with apt get or pip as of now we don't have a recommended colab emulating docker image i'm getting some missing library or package error? depending on the notebook, you may have to install additional dependencies you can do this by opening a terminal in jupyter and then using regular apt get install package or pip install package how can i more easily download many files? jupyter labs supports downloading multiple files by shift click to select multiple and then right click download option but jupyter notebook only supports downloading individual files, and neither supports downloading folders/directories you can use zip to more quickly download directories and large numbers of files first open a terminal, and then in the terminal you can install zip and use that to zip up many files into a single package apt get install y zip and then to zip all of the files in the "images out/timetodisco" (only) directory zip all images zip images out/timetodisco/ or zip all of the files in "images out" including sub directories zip r all images zip images out/ jupyter is ok, but can i run colab directly with a vast instance? yes please follow our colab guide https //docs vast ai/google colab ssh how do i connect to an ssh instance on linux/mac? on ubuntu or mac, first you need to generate an rsa ssh public/private keypair using the command ssh keygen t rsa next you may need to force the daemon to load the new private key, and confirm it's loaded ssh add; ssh add l then get the contents of the public key with cat / ssh/id rsa pub copy the entire output to your clipboard, then paste that into a new ssh key in your keys section the key text includes the opening "ssh rsa" part and the ending "user\@something" part if you don't copy the entire thing, it won't work example ssh key text ssh rsa aaaab3nzac1yc2eaaaadaqabaazbaqddxwwxwn5lz7ubkmrxm57chhvzonzult5fhi7j8zfxcjhfr96w+ccbobo2rtbbttrdlnjjisklgbcc3+jgyzhpunmfrvij7meqdehghfvuuv/ubkb7rjbyyfcb4bcsyngguzkmnnongea3aqtbszt47bnugqkszs9bfacapftr9wo0b8p4iyil/gfoy5kusvwkqrbcwrg53/+t2rak/02mwnhxybktjau1q9qtwcyo68jtdd0sa+4apsu+csjmbjs3fcddral3bcpikwrbckq+n63ol4xdv3zqrebuc98cjph04gnc41w02lmdqfl2xg5u/rv8/jm7cawkiiz3dbkv bob\@velocity you can add multiple keys in this section how do i connect to an ssh instance from windows? you can use windows subsystem for linux and then follow the ssh instructions for linux/mac but some windows users prefer a gui tool, so here https //docs vast ai/windows ssh guide is a quick guide to connecting to an ssh instance from windows using putty make sure you save the key in ssh rsa 2 format what is this tmux thing? how do i create multiple bash terminals on my ssh instance? we connect you to a tmux session by default for reliability you can create a new bash terminal window with "ctrl+b,c" (press ctrl and b, followed by c), and switch with "ctrl+b,n" but google "tmux cheat sheet" or "tmux guide" for more info ok but how can i disable tmux? we don't recommend this generally as ssh (especially the proxy ssh connection) can be unstable, but if you know what you are doing and need raw ssh you can add the following to your onstart touch / no auto tmux; security how do you protect my data from other clients? clients are isolated to unprivileged docker containers and only have access to their own data how do you protect my data from providers? there are many providers on vast ai, ranging from tier 4 datacenters with extensive physical and operational security down to individual hobbyists renting out a few machines in their home our vetted datacenter partners can provide data security similar to other large cloud providers if data security is important for your use case, you may want to rent only from our datacenter partners even though our smaller community providers generally do not have datacenter level physical or operational security, they have little to gain and much to lose from stealing customer data it can take months for providers to accumulate trust and verified status on vast these verified providers are thus incentivized to maintain their reputational standing just like larger cloud providers hosts generally have many different clients, and there are significant costs to identifying, saving, copying, and exploiting any interesting datasets, let alone any particular client's data you can also roughly see the relative age of a provider by their id billing how does billing work? once you enter a credit card and an email address and both are verified you can then increase your credit balance using one time payments with the add credit button whenever your credit balance hits zero or below, your instances will be stopped automatically, but not destroyed you are still charged storage costs for stopped instances, so it is important to destroy instances when you are done using them your credit card will be automatically charged periodically to pay off any outstanding negative balance can you bill my card automatically so i don't have to add credit in advance? you can set a balance threshold to configure auto billing, which will attempt to maintain your balance above the threshold we recommend setting a threshold around your daily or weekly spend, and then setting an balance email notification threshold around 75% of that value, so that you get notified if the auto billing fails but long before your balance depletes to zero there is also an optional debit mode feature which can be enabled by request for older accounts when debit mode is enabled, your account balance is allowed to go negative (without immediately stopping your instances) i didn't enable debit mode what are these automatic charges to my card? your card is charged automatically regardless of whether or not you have debit mode enabled instances are never free even stopped instances have storage charges make sure you delete instances when you are done with them otherwise, your card will continue to be periodically charged indefinitely how does pricing work? there are separate prices and charges for active rental (gpu) costs storage costs bandwidth costs you are charged the base active rental cost for every second your instance is in the active/connected state you are charged the storage cost (which depends on the size of your storage allocation) for every second your instance exists and is online, regardless of what state it is in active, inactive, loading, etc stopping an instance does not avoid storage costs you are charged bandwidth prices for every byte sent or received to or from the instance, regardless of what state it is in the prices for base rental, storage, and bandwidth vary considerably from machine to machine, so make sure to check them you are not charged active rental or storage costs for instances that are currently offline what is the billing frequency? balances are updated about once every few seconds why should i trust vast ai with my credit card info? you don't need to vast ai does not see, store or process your credit card numbers, they are passed directly to stripe (which you can verify in the javascript) do you support paypal? what about cryptocurrency? we currently support major credit cards through stripe and crypto payments through coinbase and crypto com data movement how do i upload/download to/from my instance? you can use the cli copy command to copy from/to directories on a remote instance and your local machine, or to copy data between two remote instances you can use the copy buttons in the gui to copy data between two remote instances the copy command uses rsync and is generally fast and efficient, subject to single link upload/download constraints example /vastai copy /workspace 4330147 /workspace currently, one endpoint of the copy must involve a vast instance with open ports for a remote >local copy or local >remote copy, the remote instance must be on a machine with open ports (although the instance itself does not need open ports), and the remote instance can be stopped/inactive for instances on machines without open ports, copy to/from local is not available, but you can still copy to a 2nd vast instance with open ports for a remote >remote copy (copy between 2 instances), the src can be stopped and does not need open ports, but the dst must be a running instance with open ports it is not sufficient that the instance is on a machine with open ports, the instance itself must have been created with open port mappings if the instance is created with the direct connect option (for jupyter or ssh launch modes), the instance will have at least one open port otherwise, for proxy or entrypoint instance types, you can get open ports using the p option to reserve a port in the instance configuration under run options (and you must also then pick a machine with open ports) if your data is already stored in the cloud (s3, gdrive, etc) then you should naturally use the appropriate linux cli or commands to download and upload data directly this generally will be one the fastest methods for moving large quantities of data, as it can fully saturate a large number of download links if you are using multiple instances with significant data movement requirements you will want to use high bandwidth cloud storage and avoid any single machine bottlenecks if you launched a jupyter notebook instance, you can use its upload feature, but this has a file size limit and can be slow you can also use standard linux tools like scp, ftp, rclone, or rsync to move data for moving code and smaller files scp is fast enough and convenient however, be warned that the default ssh connection uses a proxy and can be slow for large transfers how do i upload/download to/from my instance using scp? if you launched an ssh instance, you can copy files using scp the default ssh connection uses a proxy and thus can be slow (in terms of latency and bandwidth) thus we recommend only using scp over the default ssh connection for smaller transfers (less than 1 gb) for larger inbound transfers, a direct connection is recommended downloading from a cloud data store using wget or curl can have much higher performance the relevant scp command syntax is scp p port local file root\@ipaddr /remotedir the port and ipaddr fields must match those from the ssh command the "connect" button on the instance will give you these fields in the form ssh p port root\@ipaddr l 8080\ localhost 8080 for example, if connect gives you this ssh p 7417 root\@52 204 230 7 l 8080\ localhost 8080 you could use scp to upload a local file called "myfile tar gz" to a remote folder called "mydir" like so scp p 7417 myfile tar gz root\@52 204 230 7 /path/to/mydir i'm getting a connectionreseterror downloading files? this seems to be due to bugs in the urllib3 and or requests libraries used by many python packages we recommend using wget to download large files it is quite robust and recovers from errors gracefully how can i download a kaggle dataset using wget? first, you need to get the raw https link using the chrome browser, on the kaggle website go to the relevant dataset or competition page and start downloading the file you want then cancel the download and press ctrl+j to bring up the chrome downloads page at the top is the most recent download with a name and a link under it right click on the url link and use "copy link address" then you can use wget with that url as follows wget 'url' no check certificate o filename notice the url needs to be wrapped in ' ' single quotes examples disco diffusion disco diffusion is powerful free and open source ai image generator, which is easy to use on vast ai with the right settings and powerful gpus, it can generate artist quality high res images for a wide variety of subjects /uploads/dd crashed ship 1 jpeg /uploads/dd last tower 1 jpeg last tower crashed ship there are numerous options for running disco diffusion on vast, but two good options are 1 ) using the pytorch docker image and a slightly modified notebook, or 2 ) using a custom docker image (fork) made specifically to run dd in docker, such as jinaai/discoart https //github com/jina ai/discoart the latter custom docker image can spin up somewhat faster and has a number of advanced features beyond the original notebook, but currently requries cuda >= 11 6, which limits machine options the disco diffusion notebooks were created for colab, but they will run in docker on vast using the common pytorch image with some slight modifications (to install a few required libs) you can use one of our slightly modified dd notebooks ( 5 6 https //colab research google com/github/jsbcannell/misc/blob/master/disco diffusion v5 6 vastai ipynb , 5 4 https //colab research google com/github/jsbcannell/misc/blob/master/disco diffusion v5 4 vastai ipynb , 5 2 https //colab research google com/drive/13zkuzdqolbfbvdcew8eyfnz mrnvpbbp?usp=sharing#scrollto=installlibs ) to get started quickly here https //www youtube com/watch?v=xwta ctxksq is a quick video tutorial you'll want to create a jupyter instance with the pytorch image, and you'll probably want about 30 gb of disk to store the various models and to save all the beautiful high res images you will be generating (this is important! make sure to choose a storage allocation before creating the instance as you currently can not resize the instance disk allocation and running out of space can be catastrophic ) download the notebook ( 5 6 https //colab research google com/github/jsbcannell/misc/blob/master/disco diffusion v5 6 vastai ipynb , 5 4 https //colab research google com/github/jsbcannell/misc/blob/master/disco diffusion v5 4 vastai ipynb , 5 2 https //colab research google com/drive/13zkuzdqolbfbvdcew8eyfnz mrnvpbbp?usp=sharing#scrollto=installlibs ) as a ipynb file, then upload it to your jupyter instance created from the pytorch/pytorch image click on the notebook to run it then just run fast forward the notebook or step through each cell it can take 15 minutes or so to download the models, depending on instance internet speed the cell (4 diffuse) near the end shows the in progress output image by default it only updates every 50 steps, but you can change this via the display rate variable in that cell setting it to 1 shows the result of each iteration instead of the pytorch image, you can use the custom jinaai/discoart docker image for this image we recommend adding the environment variable option e jupyter dir=discoart (or jupyter dir=/ ) to your docker run options (directly under the image tag) this will instruct jupyter to start in a more sensible directory rather than /app which is basically empty if you set this env variable you'll see the discoart ipynb notebook file is already there in the /discoart folder, no need to upload if you are using jupyter labs you can select multiple files (using the shift key), and then download all of them one after another jupyter notebook only supports downloading individual files, and neither labs nor notebook support downloading folders to more conveniently download folders or a number of files, you can use the command line zip tool first open a new terminal, and then in the terminal run the following apt get install y zip and then to zip all of the files in the default images out/timetodisco directory zip all images zip images out/timetodisco/ note do no use spaces in your folder names, they cause headaches on linux! use the '\\ ' underscore instead for discussion/help/advice running dd on vast find us on our discord https //discord gg/hsuebsq4x8 , and make sure to check out the main dd discord https //discord gg/pvsbc9gz stable diffusion stable diffusion is a newer image diffusion generator which is generally much faster that disco diffusion, and requires less ram it is easy to use on vast ai with the automatic111 web ui simply select the stable diffusion recommended template to do so, navigate to the create https //cloud vast ai/create/ page, click the edit image & config button and then the recommended tab from there the stable diffusion template is visible once selected, it will then load the correct image and port settings for the web ui to load select a 1x gpu instance once the instance starts up, simply click the open button to open the web ui interface nvidia glx desktop nvidia glx desktop https //github com/selkies project/docker nvidia glx desktop is a docker image which provides a virtual desktop with gpu acceleration on some (but not all) machines it requires specifying an external webrtc turn server to run this image on vast, just use the recommended docker image navigate to the create https //cloud vast ai/create/ page, click the edit image & config button and then the recommended tab select the glx template the default username is user and the default password is mypasswd you can change these with e env variables (see the linked page for details) nvidia glx requires a fast internet connection on both the host and local machines make sure to use a inet up and inet down filter set appropriately to 300mbps open the readme file on the glx template for more information bittensor bittensor https //docs bittensor com/index html is a decentralized, blockchain based machine learning network the latest recommended template uses bittensor version 3 70 (finney) and installs cubit on start vast has a wide variety of affordable gpus which are ideal for running the bittensor gpu miner the setup is mostly straightforward bittensor expects an open port which is identity mapped (external and internal are the same), which is possible on vast using out of range 'virtual' ports that is handled in the recommended template using p to setup the virutal ports navigate to the create https //cloud vast ai/create/ page, click the edit image & config button and then the recommended tab pick the bittensor recommended docker image that will configure the latest version of bittensor along with the correct port settings open up the readme file associated with the template follow the instructions to create a cold and hot wallet on your local machine and to then run bittensor the first step is to register on the bittensor network for more info see the bittensor installation documentation https //docs bittensor com/getting started/installation troubleshooting all my instances keep stopping, switching to inactive status, even though i didn't press the stop button what's going on? check your credit balance if it hits zero or below, your instances will be stopped automatically i keep getting this error spend rate limit what's going on? there is a spend rate limit for new accounts the limit is extremely small for unverified accounts, so make sure to verify your email the limit increases over time, so try a cheaper instance type or wait a few hours if you are still having trouble, use the online support chat in the lower right i tried to connect with ssh and it asked for a password what is the password? there is no ssh password, we use ssh key authentication if ssh asks for a password, typically this means there is something wrong with the ssh key that you entered or your ssh client is misconfigured on ubuntu or mac, first you need to generate an rsa ssh public/private keypair using the command ssh keygen t rsa next you may need to force the daemon to load the new private key, and confirm it's loaded ssh add; ssh add l then get the contents of the public key with cat / ssh/id rsa pub copy the entire output to your clipboard, then paste that into the "ssh key" section under the keys section in your console the key text includes the opening "ssh rsa" part and the ending "user\@something" part if you don't copy the entire thing, it won't work example ssh key text ssh rsa aaaab3nzac1yc2eaaaadaqabaaabaqddxwwxwn5lz7ubkmrxm5fchhvzonzult5fhi7j8zfxcjhfr96w+ccbobo2rtbbttrdlnjjisklgbcc3+jgyzhpunmfrvij7meqdehghfvuuv/ubkb7rjbyyfcb4bcsyngguzkmnnongea3aqtbszt47bnugqqszs9bfdcapftr9wo0b8p4iyil/gfoybkusvwkqrbcwrg53/+t2rak/02mwnhxybktjau1q7qtwcyo68jtdd0sa+4apsu+csjmbjs3fcddral3bcpikwrbckq+n6sol4xdv3zqrebuc98cjph04gnc41w02lmdqgl2xg5u/rv8/jm7cawkiiz3dbkv bob\@velocity i stopped my instance, and now when i try to restart it the status is stuck on "scheduling" what is wrong? when you stop an instance, the gpu(s) it was using may get reassigned when you later then try to restart the instance, it tries to get those gpu(s) back that is the "scheduling" phase if another high priority job is currently using any of the same gpu(s), your instance will be stuck in "scheduling" phase until the conflicting jobs are done we know this is not ideal, and we are working on ways to migrate containers across gpus and machines, but until then we recommend not stopping an instance unless you are ok with the risk of waiting a while to restart it " hosting how much money can a host make? it's complicated; it depends on many factors (hardware performance, price, reliablity, etc) you can estimate your hardware's earning potential by comparing to similar hardware already rented on vast ai pricing statistics over time are tracked on 500farm https //500 farm/vastai/charts/d/a6rgl05nk/vast ai stats or got to the create console page https //cloud vast ai/create/ select "include unavailable offers" and the nvidia/opencl image to see most instance types including those fully rented hosts can run low priority jobs on their own machines, so there is always a fallback when high priority jobs are not available how and when will i be paid for hosting? for users in the us and internationally, we support payout to a bank account (ach) via stripe connect check to see if your country is supported here https //support remote com/hc/en us/articles/7046120384909 stripe connect country availability for local currency payouts hosts can also receive payout through paypal or wise due to various transaction fees, there is a minimum payout of $20 (or equivalent in other currencies) host billing runs on a regular weekly schedule every friday host invoices are then paid out the following week, depending on bank transfer times do you support payout in any crypto currencies? no, not at this time what is the payout structure? hosts receive 100% of the revenue earned from successful jobs all income for vast comes from our surge pricing structure that we manage internally what happens if i turn off my machine or just lose internet during a compute job? hosts are expected to provide reliable machines we track data on disconnects, outages, and other errors; this data is then be used to estimate a host machine's future reliability these reliability score estimates are displayed on the listing cards and also used as a factor in the default 'auto' ranking criteria what security measures protect my machine and my network? guests are contained to an isolated operating system image using linux containers containers provide the right combination of performance, security, and reliability for our use case the guest only has access to devices and resources explicitly granted to them by their contract will guests be able to determine my ip address? we do not by default prevent a guest from finding your router or nat's external facing ip address by visiting some third party website, as this would require a full proxy network and all the associated bandwidth charges it is essential that guests be able to download large datasets affordably for many users a properly configured nat/firewall should already provide protection enough against any consequences of a revealed ip address for those who want additional peace of mind, we suggest configuring a separate network for your hosted machines (but do make sure they can reach each other locally!) how do i set prices? there are two prices to consider the max price and the min price the max price is what on demand rentals pay, and as a host you can set that price on the host/machines page with the set prices button as a host you can set a min bid price for your machine by creating an idle job at that price on the host/create job page if you don't want to setup a true mining idle job, you can just use "ubuntu" as the image and "bash" as the command see the host setup page https //cloud vast ai/host/setup/ for more info on idle jobs someone is renting my machine for less than my price, what's happening? they are using a bid the price that hosts set on the host/machines page is not the rental price it is the maximum rental price on demand instances pay the max price, but interruptible instances use a bidding system you can control the min bid price by setting up an idle job alternatively, you can use the cli to set a per machine min bid (reserve) price how do i remove a gpu from my machine? removing gpus is currently not supported if you really need to remove a gpu, you will need to unlist the machine and wait for 0 rentals then, when it is safe, you can recreate the machine you can do this by deleting the file /var/lib/vastai kaalia/machine id what will the stability of earnings be like? the demand for dl compute has grown stably and significantly in the last few years; this growth is expected to continue for the forseeable future by most market analysts, and nvidia's stock has skyrocketed accordingly demand for general gpu compute is less volatile than demand for cryptocurrency hashing the stability of any particular host's earnings naturally depends on their hardware relative to the rest of the evolving market the slowdown in moore's law implies that hardware will last longer in the future amazon is still running tesla k80's profitably now almost 4 years after their release, and the kepler architecture they use is now about 6 years old what operating systems are supported for hosting? initially we are supporting ubuntu linux, more specifically ubuntu 16 04 lts https //www ubuntu com/download we expect that deep learning is the most important initial use case and currently the deep learning software ecosystem runs on ubuntu if you are a windows or mac user, don't worry, ubuntu is easy and quick to install if you are a current windows user, it is also simple to setup ubuntu in a dual boot mode our software automatically helps you install the required dependencies on top of ubuntu 16 04 hardware what are the hardware requirements for hosting? technically if our software detects recent/decent nvidia gpus (gtx 10xx series) we will probably allow you to join, but naturally that doesn't guarantee any revenue what truly matters is your hardware's actual performance on real customer workloads, which can be estimated from benchmarks deep learning is gpu intensive but also requires some io and cpu performance per gpu to feed them with data multi gpu systems are preferable for faster training through parallelization but also require more total system performance in proportion, and parallel training can require more pcie bandwidth per gpu in particular rendering and many other workloads have similiar requirements what kind of hardware works best for deep learning? it depends heavily on the model and libraries used; it's constantly evolving; it's complicated we suggest looking into the various deep learning workstations https //www google com/search?q=deep+learning+workstation offered today for some examples, and see this in depth discussion https //news ycombinator com/item?id=14508928 on hackernews gpu workstations built for deep learning are similar to those built for rendering or other compute intensive tasks