Examples
Build with all dependencies:Flags
--no-deps
Skip transitive dependencies during pip install. Only installs direct dependencies specified in
@Endpoint decorators. Useful when the base image already includes dependencies.Custom name for the output archive file.
Comma-separated list of packages to exclude from the build (e.g.,
torch,torchvision). Use this to skip packages already in the base image.What happens during build
- Function discovery: Finds all
@Endpointdecorated functions. - Grouping: Groups functions by their endpoint configuration.
- Manifest generation: Creates
.flash/flash_manifest.jsonwith endpoint definitions. - Dependency installation: Installs Python packages for Linux x86_64.
- Packaging: Bundles everything into
.flash/artifact.tar.gz.
Build artifacts
After runningflash build:
| File/Directory | Description |
|---|---|
.flash/artifact.tar.gz | Deployment package ready for Runpod |
.flash/flash_manifest.json | Service discovery configuration |
.flash/.build/ | Build directory (kept for inspection) |
Cross-platform builds
Flash automatically handles cross-platform builds:- Automatic platform targeting: Dependencies are installed for Linux x86_64, regardless of your build platform.
- Binary wheel enforcement: Only pre-built wheels are used, preventing compilation issues.
Python version in deployed workers
Your local Python version does not affect what runs in the cloud.flash build downloads wheels for the container’s Python version automatically.
| Worker type | Python version | Notes |
|---|---|---|
| GPU | 3.12 only | The GPU base image includes multiple interpreters (3.9–3.14) for interactive pod use, but torch and CUDA libraries are installed only for 3.12. |
| CPU | 3.10, 3.11, or 3.12 | Configurable via the PYTHON_VERSION build arg. |
py{version}-{tag} (for example, runpod/flash:py3.12-latest).
Managing deployment size
Runpod Serverless has a 500MB deployment limit. Flash automatically excludes packages that are pre-installed in the base image:torch,torchvision,torchaudionumpy,triton
Manual exclusions
Use--exclude to skip additional packages that are already in a custom base image or not needed:
Base image reference
| Resource type | Base image | Auto-excluded packages |
|---|---|---|
| GPU | PyTorch base | torch, torchvision, torchaudio, numpy, triton |
| CPU | Python slim | torch, torchvision, torchaudio, numpy, triton |
Troubleshooting
Build fails with “functions not found”
Ensure your project has@Endpoint decorated functions:
Archive is too large
Base image packages (torch, numpy, triton, etc.) are auto-excluded. If the archive is still too large, use --exclude to skip additional packages or --no-deps to skip transitive dependencies:
Dependency installation fails
If a package doesn’t have Linux x86_64 wheels:- Ensure standard pip is installed:
python -m ensurepip --upgrade - Check PyPI for Linux wheel availability.
- For Python 3.13+, some packages may require newer manylinux versions.
Need to examine generated files
The build directory is kept after building. Inspect it with:Related commands
flash deploy- Build and deploy in one step (includes--previewoption for local testing)flash run- Start development serverflash env- Manage environments
Most users should use
flash deploy instead, which runs build and deploy in one step. Use flash build when you need more control or want to inspect the artifact.