Overview

To get started with RunPod:

• Create a RunPod account
• Add funds
• Use the RunPod SDK to build and connect with your Serverless Endpoints

The rest of this guide will help you set up a RunPod project.

​

Setting up your project

Just like with Banana, RunPod provides a Python SDK to run your projects.

To get started, install setup a virtual environment then install the SDK library.

python3 -m venv env
source env/bin/activate

python3 -m venv env
source env/bin/activate

python -m venv env
env\Scripts\activate

To install the SDK, run the following command from the terminal.

python -m pip install runpod

​

Project examples

RunPod provides a repository of templates for your project.

You can use the template to get started with your project.

gh repo clone runpod-workers/worker-template

Now that you’ve got a basic RunPod Worker template created:

• Continue reading to see how you’d migrate from Banana to RunPod
• See Generate SDXL Turbo for a general approach on deploying your first Serverless Endpoint with RunPod.

​

Project structure

When beginning to migrate your Banana monorepo to RunPod, you will need to understand the structure of your project.

.
├── Dockerfile               # Docker configuration
├── README.md                # Project documentation
├── banana_config.json       # Configuration settings
├── requirements.txt         # Dependencies
└── src
    ├── app.py               # Main application code
    └── download.py          # Download script

.
├── Dockerfile               # Docker configuration
├── README.md                # Project documentation
├── banana_config.json       # Configuration settings
├── requirements.txt         # Dependencies
└── src
    ├── app.py               # Main application code
    └── download.py          # Download script

.
├── Dockerfile               # Docker configuration
├── LICENSE                  # License information
├── README.md                # Project documentation
├── builder
│   ├── requirements.txt     # Dependencies
│   └── setup.sh             # Setup script
└── src
    └── handler.py           # Main handler code

Both project setups at a minimum contain:

• Dockerfile: Defines the container for running the application.
• Application code: The executable code within the container.

Optional files included in both setups:

• requirements.txt: Lists dependencies needed for the application.

​

Banana Configuration settings

Banana configuration settings are stored in a banana_config.json file.

Banana uses a banana_config.json file which contains things like Idle Timeout, Inference Timeout, and Max Replicas.

Idle Timeout

RunPod allows you to set an Idle Timeout when creating the endpoint. The default value is 5 seconds.

Inference Timeout

RunPod has a similar concept to Inference Timeout. For runs that are take less than 30 seconds to execute, you should use the run_sync handler. For runs that take longer than 30 seconds to execute, you should use the sync handler.

Max Replicas

When creating a Worker in RunPod, you can set the max Workers that will scale up depending on the amount of Worker sent to your endpoint. For more information, see Scale Type.