✔️ | Requirements

Minimal Eligibility Requirements

Software Specifications

  • Ubuntu Server 20.04 LTS
    • Basic Linuix proficiency
    • Ability to remotely connect via SSH

Minimal Hardware Specifications

  • Latest NVIDIA GPUs, at least 30xx or RTX A4000 or higher.
    • Option 1: At least 12 GPUs in total, each with a minimum of 12 GB VRAM.
    • Option 2: At least 8 GPUs in total, each with a minimum of 48 GB VRAM.
    • PCIE 3.0 x16/PCIE 4.0 x8 per GPU or faster.
    • Demand is highest for SXM 80GB, PCI 80GB, 4090 24GB and L40 48GB models. We also recommend 2 GPU per server at minimum for best rental rates. 8x configurations are really popular.
  • 4 Physical Core Per GPU + 2 for system operations.
  • Your RAM should at minimum equals your total vRAM of all GPUs + 4GB for system operations.
    • 1 TB+ of RAM recommended for 8x 80GB vRAM GPU configurations.
  • 1 TB per GPU of NVME storage, 2 TB would be even better.
    • At least 1,500 MB/s read speed is required.
  • 10 GB Bidirectional Internet Speeds.
  • Static Public IP support (20 ports per GPU).
    • Single IP can be shared between multiple servers.
    • Access and ability to port forwarding.
  • Abide by Tier III+ Datacenter Standards.
    • Robust Uninterruptible Power Supply and backup generator.
    • Internet Service Provider redundancy.
    • 24/7 on-site security and technical staff.
  • 200+ GPU Capacity.
  • 40GB/s Interconnect between servers.
  • Ability to deploy network storage cluster.
  • Most importantly: the ability to scale GPU supply over time.

PCIe Risers

If your system uses PCIe risers, they must have redriver functionality.