⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’

Excalidraw Data

Text Elements

host 宿主机

PPU KMD 内核(.ko) /dev/ppu*

RDMA 内核 /dev/infiniband/*

ppu docker images

ENTRYPOINT /opt/t-head/entrypoint.sh 核对版本

/usr/local/PPU_SDK

CUDA_SKD/NVCC CUDA_SKD/lib64 libpccl -tuner -device kernel -prefiler

sailSHMEM

ppu-smi

asys

框架层: PyTorch 2.10.0 (PPU 用自家 nvcc 从源码重编的 wheel)

加速库: flashinfer / deep_ep / deep_gemm /flash_mla / triton / tilelang / fla / TransformerEngine / acext / mooncake

RDMA: libibverbs-dev (仅 ABI, provider .so 靠宿主机)

基础: ubuntu 24.04 + Python 3.12.3 (源码编译, —enable-shared)

业务层,阿里云灵骏

sglang0512/vllm0201+PPU2.1.0

  1. 核心的 schedule,weight 的等模块会 rm 源码
  2. 装 eic-sdk
  3. 装 accl 网络插件