Secure Cloud runs in T3/T4 data centers by our trusted partners. Our close partnership comes with high-reliability with redundancy, security, and fast response times to mitigate any downtimes. For any sensitive and enterprise workloads, we highly recommend Secure Cloud.
Community Cloud brings power in numbers and diversity spanning the whole world. Through our decentralized platform, we can offer peer-to-peer GPU computing that connects individual compute providers to compute consumers. Our Community Cloud hosts are invite-only and vetted by us, and still have to abide by our standards. Even though their associated infrastructure might not offer as much redundancy for power and networking, they still offer good servers that combine quality and affordability.
Both solutions offer far more competitive prices than large cloud providers such as AWS or GCP.
On-demand pods can run forever without interruptions with resources dedicated to your pod. They do incur higher costs than spot pods.
Spot pods use spare compute capacity, allowing you to bid for those compute resources. Resources are dedicated to your pod, but someone else can bid higher or start an on-demand pod that will stop your pod. When this happens, your pod is given a signal to stop 5 seconds prior with SIGTERM, and eventually, the kill signal SIGKILL after 5 seconds. You can use volumes to save any data to the disk in that 5s period or push data to the cloud periodically.
RunPod leverages technologies like Docker to containerize and isolate guest workloads on a host machine. We have built a decentralized platform where thousands of servers can be connected to offer a seamless experience for all users.
If you aren't sure if RunPod is for you, feel free to hang out in our Discord to ask questions or email [email protected] You can load as little as $10 into your account to try things out. We don't currently offer refunds or trial credits due to the overhead of processing these requests. Please plan accordingly!
A - On-demand instances are for non-interruptible workloads. You pay the on-demand price and cannot be displaced by other users if you have funds to keep your pod running.
A spot instance is an interruptible instance that can generally be rented much cheaper than an on-demand one. Spot instances are great for stateless workloads like an API or for workloads you can periodically save to a volume disk. Your volume disk is retained even if your spot instance is interrupted.
Savings plans are a way for you to pay up-front and get a discount for it. This is great for when you know you will need prolonged access to compute. You can learn more on the about Savings Plans here.
All billing, including per-hour compute and storage billing, is charged per minute.
Every pod has an hourly cost based on GPU type. Your RunPod credits are charged for the pod every minute as long as the pod is running. If you ever run out of credits, your pods will be automatically stopped, and you will get an email notification. Eventually, pods will be terminated if you don't refill your credit. We pre-emptively stop all of your pods if you get down to 10 minutes of remaining run time. This gives your account enough balance to keep your data volumes around in the case you need access to your data. Please plan accordingly.
We currently charge $0.10/GB/month for all storage on running pods and $0.20/GB/month for volume storage on stopped pods. Storage is tied to compute servers, and we want to ensure active users have enough space to run their workloads. Storage is charged per minute, and we never charge users if the host machine is down or unavailable from the public internet.
For storage requirements below 1TB, we charge a competitive rate of $0.07/GB/Month. If your storage requirements exceed 1TB, we provide a cost-effective pricing of $0.05/GB/Month. This ensures that you receive significant savings as your data storage scales.
When you choose to create a Network Volume, you gain access to our robust infrastructure, which includes state-of-the-art storage servers located in the same datacenters where you rent GPU servers from us. These servers are connected via a high-speed 25Gbps local network, up to 200Gbps in some locations, guaranteeing efficient data transfer and minimal latency. Everything is stored on high-speed NVME SSDs to ensure best performance.
Network volumes are billed on a per-hour basis.
Yes. Your data is run in a multi-tenant environment where other clients cannot access your pod. For sensitive workloads requiring the best security, please use Secure Cloud.
Data privacy is important to us at RunPod. Our terms of service prohibit hosts from trying to inspect your pod data or usage patterns in any way. If you want the highest level of security, use Secure Cloud.
You can run any Docker container available on any publicly reachable container registry. If you are not well versed in containers, we recommend sticking with the default run templates like our RunPod PyTorch template. However, if you know what you are doing, you can do a lot more!
You can't currently spin up your own instance of Docker, as we run Docker for you! Unfortunately, this means that you cannot currently build Docker containers on RunPod or use things like Docker Compose. Many use cases can be solved by creating a custom template with the Docker image that you want to run.
Usually, this happens for one of several reasons. If you can't figure it out, contact us, and we'll gladly help you.
- You are trying to run a pod to SSH into, but you did not give the pod an idle job to run like "sleep infinity."
- You have given your pod a command that it doesn't know how to run. Check the logs to make sure that you don't have any syntax errors, etc.
We don't currently support Windows. We want to do this in the future, but we do not have a solid timeframe for Windows support.
RunPod needs to provide you with reliable servers. All of our listed servers must meet minimum reliability, and most are running in a data center! However, if you want the highest level of reliability and security, use Secure Cloud. RunPod calculates server reliability by maintaining a heartbeat with each server in real-time.
If you want to avoid this, using network volumes is the best choice. Read about it here.
Most of our machines have between 4 and 8 GPUs per physical machine. When you start a pod, it is locked to a specific physical machine. If you keep it running (on-demand), then that GPU cannot be taken from you. However, if you stop your pod, it becomes available for a different user to rent. When you want to start your pod again, your specific machine may be wholly occupied! In this case, we give you the option to spin up your pod with zero GPUs so you can retain access to your data.
Remember that this does not mean there are no more GPUs of that type available, just none on the physical machine that specific pod is locked to. Note that transfer pods have limited computing capabilities, so transferring files using a UI may be difficult, and you may need to resort to terminal access or cloud sync options.
Network volumes allow you to share data between pods and generally be more mobile with your important data. This feature is only available in specific secure cloud data centers, but we are actively rolling it out to more and more of our secure cloud footprint. If you use network volumes, you should rarely run into situations where you cannot use your data with a GPU without a file transfer!
All your pods are stopped automatically when you don't have enough funds to keep your pods running for at least ten more minutes. When your pods are stopped, your container disk data will be lost, but your volume data will be preserved. You will have two days to add more funds. If you fail to do so, your pods will be terminated, and pod volumes will be removed.
After you add more funds to your account, you can start your pod if you wish (assuming enough GPUs are available on the host machine).
If the host machine loses power, it will attempt to start your pod again when it returns online. Your volume data will be preserved, and your container will run the same command as it ran the first time you started renting it. Your container disk and anything in memory will be lost!
The host machine will continue to run your pod to the best of its ability, even if it is not connected to the internet. If your job requires internet connectivity, then it will not function. You will not be charged if the host loses internet connectivity, even if it continues to run your job. You may, of course, request that your pod exit while the host is offline, and it will exit your pod when it regains network connectivity.
We implement a spending limit for newer accounts that will grow over time. This is because we have found that sometimes scammers try to interfere with the natural workings of the platform. We believe that this limit should not impact normal usage. We would be delighted to up your spending limit if you contact us and share your use case.
Sure, do! Take a look at our legal page.
Updated 26 days ago