Runpod offers custom pricing plans for large scale and enterprise workloads. If you’re interested in learning more, contact our sales team.
Runpod Serverless offers flexible, pay-per-second pricing with no upfront costs. This guide explains how pricing works and how to optimize your costs.

​
GPU pricing

Serverless offers two pricing tiers:

​
Flex workers

On-demand workers that scale to zero when not in use, so you only pay when processing requests. Flex workers are ideal for variable workloads, non-time-sensitive applications, and maximizing cost efficiency for sporadic usage.

​
Active workers

Always-on workers that run 24/7. Active workers receive a 20-30% discount compared to flex workers, but you are charged continuously regardless of usage. Use active workers for consistent workloads, latency-sensitive applications, and high-volume processing.

​
Pricing table (per second)

The price of flex/active workers depends on the GPU type and worker configuration:
GPU type(s)MemoryFlex cost per secondActive cost per secondDescription
A4000, A4500, RTX 400016 GB$0.00016$0.00011The most cost-effective for small models.
4090 PRO24 GB$0.00031$0.00021Extreme throughput for small-to-medium models.
L4, A5000, 309024 GB$0.00019$0.00013Great for small-to-medium sized inference workloads.
L40, L40S, 6000 Ada PRO48 GB$0.00053$0.00037Extreme inference throughput on LLMs like Llama 3 7B.
A6000, A4048 GB$0.00034$0.00024A cost-effective option for running big models.
H100 PRO80 GB$0.00116$0.00093Extreme throughput for big models.
A10080 GB$0.00076$0.00060High throughput GPU, yet still very cost-effective.
H200 PRO141 GB$0.00155$0.00124Extreme throughput for huge models.
B200180 GB$0.00240$0.00190Maximum throughput for huge models.
For the latest pricing information, visit the Runpod pricing page.

​
How billing works

Serverless billing operates on a precise pay-as-you-go model with specific timing mechanisms. Billing starts when the system signals a worker to wake up and ends when the worker is fully stopped. Runpod Serverless is charged by the second, with partial seconds rounded up to the next full second. For example, if your request takes 2.3 seconds to complete, you’ll be billed for 3 seconds.

​
Compute and storage costs

Your total Serverless costs include both compute time (GPU usage) and temporary storage:
  1. Compute costs: Charged per second based on the GPU type as shown in the pricing table above.
  2. Storage costs: The worker container volume incurs charges only while workers are running, calculated in 5-minute intervals. Even if your worker runs for less than 5 minutes, you’ll be charged for the full 5-minute period. The storage cost is $0.000011574 per GB per 5 minutes (equivalent to approximately $0.10 per GB per month).
If you have many workers continuously running with high storage costs, you can utilize network volumes to reduce expenses. Network volumes allow you to share data efficiently across multiple workers, reduce per-worker storage requirements by centralizing common files, and maintain persistent storage separate from worker lifecycles. Network volumes are billed hourly at a rate of $0.07 per GB per month for the first 1TB, and $0.05 per GB per month for additional storage beyond that.

​
Compute cost breakdown

Serverless workers incur charges during these periods:
  1. Cold start time: The time required to initialize a worker and load models into GPU memory.
  2. Execution time: The time spent actually processing the request.
  3. Idle time: The period in which the worker remains active after completing a request.

​
Cold start time

A cold start occurs when a worker is initialized from a scaled-down state. This typically involves starting the container, loading models into GPU memory, and initializing runtime environments. Cold start duration varies based on model size and complexity. Larger models take longer to load into GPU memory. To optimize cold start times, you can use FlashBoot (included at no extra charge) or configure your endpoint settings.

​
Execution time

This is the time your worker spends processing a request. Execution time depends on the complexity of your workload, the size of input data, and the performance of the GPUs you’ve selected. Set reasonable execution timeout limits to prevent runaway jobs from consuming excessive resources, and optimize your code to reduce processing time where possible.

​
Idle time

After completing a request, workers remain active for a specified period before scaling down. This reduces cold starts for subsequent requests but incurs additional charges. The default idle timeout is 5 seconds, but you can configure this in your endpoint settings.

​
Billing support

If you think you’ve been billed incorrectly, please contact support, and include this information in your request:
  1. The Serverless endpoint ID where you experienced billing issues.
  2. Request ID for the specific request (if applicable).
  3. The approximate time when the billing issue occurred.
Providing these details will help our support team resolve your issue more quickly.