V2.7.1 分支提供依赖镜像

.ci/docker/README.md

@@ -0,0 +1,91 @@
+# torch-npu CI Docker Images
+
+本目录管理 torch-npu 项目的 CI Docker 镜像，包括**构建镜像 (builder)** 和**测试镜像 (test)** 两类，每类分别支持 x86_64 和 aarch64 架构。
+
+## 镜像类型
+
+| 类型 | 基座 | 用途 |
+|------|------|------|
+| **builder** | manylinux2_28-builder | 编译构建 torch-npu wheel 包，包含完整编译工具链 |
+| **test** | ubuntu:22.04 | CI 单元测试运行环境，包含 PyTorch CPU、CANN runtime、triton-ascend 和测试框架 |
+
+## 目录结构
+
+```
+.ci/docker/
+├── README.md
+├── requirements-builder.txt      # Builder 镜像 pip 依赖
+├── requirements-test.txt         # Test 镜像 pip 依赖
+├── docker_build.sh               # 构建入口脚本
+├── common/                       # 共享安装脚本
+│   ├── install_cann.sh           # 安装 CANN toolkit (支持 A1/A2/A3)
+│   ├── install_triton.sh         # 安装 triton-ascend (需传 Python 版本)
+│   ├── install_obs.sh            # 安装华为 OBS util
+├── builder/
+│   ├── Dockerfile.x86_64
+│   └── Dockerfile.aarch64
+└── test/
+    ├── Dockerfile.x86_64
+    └── Dockerfile.aarch64
+```
+
+## 快速构建
+
+```bash
+# Builder 镜像 (不含 CANN)
+./docker_build.sh torch-npu-builder-x86_64-torch2.7.1
+./docker_build.sh torch-npu-builder-aarch64-torch2.7.1
+
+# Test 镜像 (含 CANN)
+./docker_build.sh torch-npu-test-x86_64-cann-a1-py3.10-torch2.7.1
+./docker_build.sh torch-npu-test-aarch64-cann-a2-py3.10-torch2.7.1
+```
+
+## Tag 命名规范
+
+参考上游 PyTorch `pytorch-linux-jammy-cuda12.4-cudnn9-py3-gcc11` 模式，tag 即为最终镜像名：
+
+**Builder**（不含 CANN）：
+```
+torch-npu-builder-<ARCH>-torch<PYTORCH_VERSION>
+```
+```
+./docker_build.sh torch-npu-builder-x86_64-torch2.7.1
+#                   ^          ^       ^     ^
+#                   |          |       |     └── PyTorch 版本 (torch2.7.1)
+#                   |          |       └── 架构
+#                   |          └── 镜像类型
+#                   └── 固定前缀
+```
+
+**Test**（含 CANN runtime）：
+```
+torch-npu-test-<ARCH>-cann<CHIP>-py<PYTHON_VERSION>-torch<PYTORCH_VERSION>
+```
+```
+./docker_build.sh torch-npu-test-x86_64-cann-a1-py3.10-torch2.7.1
+#                   ^         ^       ^    ^  ^     ^     ^
+#                   |         |       |    |  |     |     └── PyTorch 版本
+#                   |         |       |    |  |     └── torch 前缀
+#                   |         |       |    |  └── Python 版本
+#                   |         |       |    └── py 前缀
+#                   |         |       └── CANN 芯片 (A1/A2/A3)
+#                   |         └── 架构
+#                   └── 镜像类型
+```
+
+| 字段 | 可选值 |
+|------|--------|
+| IMAGE_TYPE | builder, test |
+| ARCH | x86_64, aarch64 |
+| CHIP | A1 (Ascend 910), A2 (Ascend 910b), A3 (仅 test) |
+| PYTHON_VERSION | 3.10 (仅 test) |
+| PYTORCH_VERSION | 2.7.1 |
+
+## CANN 芯片映射
+
+| CANN_CHIP | 芯片 | CANN 版本 |
+|-----------|------|----------|
+| A1 | Ascend 910 | 9.1.0 |
+| A2 | Ascend 910b | 8.5.0 (x86_64) / 9.1.0 (aarch64) |
+| A3 | Ascend A3 | 9.0.0-beta.1 (x86_64) / 9.0.0-beta.2 (aarch64) |

.ci/docker/builder/Dockerfile.aarch64

@@ -0,0 +1,71 @@
+FROM pytorch/manylinux2_28_aarch64-builder:cpu-aarch64-2.7
+
+ARG PYTORCH_VERSION=2.7.1
+
+ENV PATH=/usr/local/bin:$PATH
+ENV AUDITWHEEL_PLAT=manylinux_2_28_aarch64
+ENV ETCD_UNSUPPORTED_ARCH=arm64
+ENV PYTORCH_VERSION=${PYTORCH_VERSION}
+
+COPY requirements-builder.txt /opt/buildtools/
+
+# Set pip & python symlinks
+RUN cd /usr/local/bin \
+    && ln -sf /opt/_internal/cpython-3.9.21/bin/pip3.9 pip3.9 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/pip3.10 pip3.10 \
+    && ln -sf /opt/_internal/cpython-3.11.11/bin/pip3.11 pip3.11 \
+    && ln -sf /opt/_internal/cpython-3.12.9/bin/pip3.12 pip3.12 \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/pip3.13 pip3.13 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/pip3.10 pip3 \
+    && ln -sf /opt/_internal/cpython-3.9.21/bin/python3.9 python3.9 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/python3.10 python3.10 \
+    && ln -sf /opt/_internal/cpython-3.11.11/bin/python3.11 python3.11 \
+    && ln -sf /opt/_internal/cpython-3.12.9/bin/python3.12 python3.12 \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/python3.13 python3.13 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/python3.10 python3
+
+# Install PyTorch from official source, then build requirements from PyPI for each python version
+RUN pip3.9 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION} \
+        && pip3.9 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.10 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION} \
+        && pip3.10 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.11 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION} \
+        && pip3.11 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.12 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION} \
+        && pip3.12 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.13 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION} \
+        && pip3.13 install --no-cache-dir auditwheel==5.4.0 \
+        && pip3.13 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/auditwheel /usr/local/bin/auditwheel
+
+# Install system build tools
+RUN echo "alias ll='ls -l --color=auto'" >> /root/.bashrc \
+    && yum install -y vim-common --disablerepo=ius \
+    && yum install -y ninja-build binutils lld mold dos2unix gcc gcc-c++ make cmake3 wget tar unzip elfutils java-1.8.0-openjdk-devel \
+    && cd /tmp \
+    && wget https://github.com/ccache/ccache/releases/download/v4.10/ccache-4.10.tar.gz \
+    && tar -xzf ccache-4.10.tar.gz \
+    && cd ccache-4.10 \
+    && mkdir build \
+    && cd build \
+    && cmake3 .. \
+    && make -j$(nproc) \
+    && make install \
+    && cd /tmp \
+    && rm -rf ccache-4.10* \
+    && ccache --version \
+    && wget https://github.com/etcd-io/etcd/releases/download/v3.4.3/etcd-v3.4.3-linux-arm64.tar.gz \
+    && tar -zxf etcd-v3.4.3-linux-arm64.tar.gz \
+    && mv etcd-v3.4.3-linux-arm64/etcd /usr/local/bin/ \
+    && pip3.10 install python-etcd \
+    && etcd --version \
+    && yum update -y \
+    && yum clean all
+
+# Set timezone
+RUN rm -f /etc/localtime \
+    && cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime \
+    && echo 'Asia/Shanghai' >/etc/timezone \
+    && echo "export TZ='Asia/Shanghai'" >>/etc/profile
+
+WORKDIR /home

.ci/docker/builder/Dockerfile.x86_64

@@ -0,0 +1,82 @@
+FROM pytorch/manylinux2_28-builder:cpu-2.7
+
+ARG PYTORCH_VERSION=2.7.1
+
+ENV PATH=/usr/local/bin:$PATH
+ENV AUDITWHEEL_PLAT=manylinux_2_28_x86_64
+ENV PYTORCH_VERSION=${PYTORCH_VERSION}
+
+COPY requirements-builder.txt /opt/buildtools/
+
+# Set pip & python symlinks
+RUN cd /usr/local/bin \
+    && ln -sf /opt/_internal/cpython-3.9.21/bin/pip3.9 pip3.9 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/pip3.10 pip3.10 \
+    && ln -sf /opt/_internal/cpython-3.11.11/bin/pip3.11 pip3.11 \
+    && ln -sf /opt/_internal/cpython-3.12.9/bin/pip3.12 pip3.12 \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/pip3.13 pip3.13 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/pip3.10 pip3 \
+    && ln -sf /opt/_internal/cpython-3.9.21/bin/python3.9 python3.9 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/python3.10 python3.10 \
+    && ln -sf /opt/_internal/cpython-3.11.11/bin/python3.11 python3.11 \
+    && ln -sf /opt/_internal/cpython-3.12.9/bin/python3.12 python3.12 \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/python3.13 python3.13 \
+    && ln -sf /opt/_internal/cpython-3.10.16/bin/python3.10 python3
+
+# Install PyTorch from official source, then build requirements from PyPI for each python version
+RUN pip3.9 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION}+cpu \
+        && pip3.9 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.10 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION}+cpu \
+        && pip3.10 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.11 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION}+cpu \
+        && pip3.11 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.12 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION}+cpu \
+        && pip3.12 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && pip3.13 install --no-cache-dir --index-url https://download.pytorch.org/whl/cpu torch==${PYTORCH_VERSION}+cpu \
+        && pip3.13 install --no-cache-dir auditwheel==5.4.0 \
+        && pip3.13 install --no-cache-dir -r /opt/buildtools/requirements-builder.txt \
+    && ln -sf /opt/_internal/cpython-3.13.2/bin/auditwheel /usr/local/bin/auditwheel
+
+# Install system build tools
+RUN yum remove -y ius-release epel-release 2>/dev/null || true \
+    && rm -rf /etc/yum.repos.d/ius*.repo /etc/yum.repos.d/epel*.repo \
+    && yum clean all && rm -rf /var/cache/dnf /var/cache/yum \
+    && echo "alias ll='ls -l --color=auto'" >> /root/.bashrc \
+    && yum install -y vim-common --disablerepo=ius \
+    && yum install -y binutils lld dos2unix gcc gcc-c++ make cmake3 wget tar unzip elfutils java-1.8.0-openjdk-devel \
+    && cd /tmp \
+    && wget -q https://github.com/ninja-build/ninja/releases/download/v1.12.1/ninja-linux.zip \
+    && unzip ninja-linux.zip \
+    && cp ninja /usr/local/bin/ && chmod +x /usr/local/bin/ninja \
+    && cd /tmp \
+    && wget -q https://github.com/rui314/mold/archive/refs/tags/v2.32.1.tar.gz \
+    && tar -xf v2.32.1.tar.gz \
+    && cd mold-2.32.1 \
+    && cmake -DCMAKE_BUILD_TYPE=Release -DMOLD_MOSTLY_STATIC=ON . \
+    && make -j$(nproc) && make install \
+    && cd /tmp \
+    && wget https://github.com/ccache/ccache/releases/download/v4.10/ccache-4.10.tar.gz \
+    && tar -xzf ccache-4.10.tar.gz \
+    && cd ccache-4.10 \
+    && mkdir build \
+    && cd build \
+    && cmake3 .. \
+    && make -j$(nproc) \
+    && make install \
+    && cd /tmp && rm -rf /tmp/* \
+    && ninja --version && mold --version && ccache --version \
+    && wget https://github.com/etcd-io/etcd/releases/download/v3.4.3/etcd-v3.4.3-linux-amd64.tar.gz \
+    && tar -zxf etcd-v3.4.3-linux-amd64.tar.gz \
+    && mv etcd-v3.4.3-linux-amd64/etcd /usr/local/bin/ \
+    && pip3.10 install python-etcd \
+    && etcd --version \
+    && yum clean all \
+    && yum update -y
+
+# Set timezone
+RUN rm -f /etc/localtime \
+    && cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime \
+    && echo 'Asia/Shanghai' >/etc/timezone \
+    && echo "export TZ='Asia/Shanghai'" >>/etc/profile
+
+WORKDIR /home

.ci/docker/common/install_cann.sh

@@ -0,0 +1,109 @@
+#!/usr/bin/bash
+# Install CANN toolkit for Ascend NPU.
+# Usage: CANN_CHIP=A1 ./install_cann.sh
+#   CANN_CHIP: A1 (Ascend 910), A2 (Ascend 910b), A3 (Ascend A3)
+# Automatically detects architecture (x86_64 / aarch64).
+
+set -e
+
+CANN_CHIP="${CANN_CHIP:-A1}"
+ARCH=$(uname -m)
+
+BASE_URL="https://pytorch-package.obs.cn-north-4.myhuaweicloud.com/pta/cann-package"
+CANN_BASE_URL="https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/CANN/CANN%209.1.T1"
+
+case "${ARCH}_${CANN_CHIP}" in
+  # x86_64
+  x86_64_A1)
+    TOOLKIT_URL="${BASE_URL}/20260513/Ascend-cann-toolkit_9.1.0_linux-x86_64.run"
+    OPS_URL="${BASE_URL}/20260513/Ascend-cann-910-ops_9.1.0_linux-x86_64.run"
+    NNAL_URL="${BASE_URL}/20260513/Ascend-cann-nnal_9.1.0_linux-x86_64.run"
+    OPS_GLOB="Ascend-cann-910*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  x86_64_A2)
+    TOOLKIT_URL="${CANN_BASE_URL}/Ascend-cann-toolkit_9.1.0-beta.1_linux-x86_64.run"
+    OPS_URL="${CANN_BASE_URL}/Ascend-cann-910b-ops_9.1.0-beta.1_linux-x86_64.run"
+    NNAL_URL="${CANN_BASE_URL}/Ascend-cann-nnal_9.1.0-beta.1_linux-x86_64.run"
+    OPS_GLOB="Ascend-cann-910b-ops*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  x86_64_A3)
+    TOOLKIT_URL="${CANN_BASE_URL}/Ascend-cann-toolkit_9.1.0-beta.1_linux-x86_64.run"
+    OPS_URL="${CANN_BASE_URL}/Ascend-cann-A3-ops_9.1.0-beta.1_linux-x86_64.run"
+    NNAL_URL="${CANN_BASE_URL}/Ascend-cann-nnal_9.1.0-beta.1_linux-x86_64.run"
+    OPS_GLOB="Ascend-cann-A3-ops*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  # aarch64
+  aarch64_A1)
+    TOOLKIT_URL="${BASE_URL}/20260302/Ascend-cann-toolkit_9.0.0-beta.1_linux-aarch64.run"
+    OPS_URL="${BASE_URL}/20260302/Ascend-cann-910b-ops_9.0.0-beta.1_linux-aarch64.run"
+    NNAL_URL="${BASE_URL}/20260302/Ascend-cann-nnal_9.0.0-beta.1_linux-aarch64.run"
+    OPS_GLOB="Ascend-cann-910b*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  aarch64_A2)
+    TOOLKIT_URL="${CANN_BASE_URL}/Ascend-cann-toolkit_9.1.0-beta.1_linux-aarch64.run"
+    OPS_URL="${CANN_BASE_URL}/Ascend-cann-910b-ops_9.1.0-beta.1_linux-aarch64.run"
+    NNAL_URL="${CANN_BASE_URL}/Ascend-cann-nnal_9.1.0-beta.1_linux-aarch64.run"
+    OPS_GLOB="Ascend-cann-910b-ops*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  aarch64_A3)
+    TOOLKIT_URL="${CANN_BASE_URL}/Ascend-cann-toolkit_9.1.0-beta.1_linux-aarch64.run"
+    OPS_URL="${CANN_BASE_URL}/Ascend-cann-A3-ops_9.1.0-beta.1_linux-aarch64.run"
+    NNAL_URL="${CANN_BASE_URL}/Ascend-cann-nnal_9.1.0-beta.1_linux-aarch64.run"
+    OPS_GLOB="Ascend-cann-A3-ops*"
+    SET_ENV_PATH="/usr/local/Ascend/cann/set_env.sh"
+    ;;
+  *)
+    echo "Unsupported combination: ${ARCH} + ${CANN_CHIP}"
+    exit 1
+    ;;
+esac
+
+echo "Installing CANN ${CANN_CHIP} for ${ARCH}..."
+
+echo "=== Creating HwHiAiUser user and group ==="
+groupadd -f HwHiAiUser
+id -u HwHiAiUser >/dev/null 2>&1 || useradd -g HwHiAiUser -d /home/HwHiAiUser -m HwHiAiUser -s /bin/bash
+
+rm -rf cann
+mkdir -p cann && cd cann
+
+echo "=== Downloading CANN packages ==="
+curl -O "${TOOLKIT_URL}"
+curl -O "${OPS_URL}"
+curl -O "${NNAL_URL}"
+echo "Download complete."
+
+chmod +x Ascend-cann*.run
+
+echo "=== Installing CANN toolkit ==="
+./Ascend-cann-toolkit*.run --full --quiet --install-path=/usr/local/Ascend
+source "${SET_ENV_PATH}"
+echo "toolkit install success"
+
+echo "=== Installing CANN ops ==="
+./${OPS_GLOB}.run --install --quiet --install-path=/usr/local/Ascend
+echo "ops install success"
+
+echo "=== Installing CANN nnal ==="
+./Ascend-cann-nnal*.run --install --quiet --install-path=/usr/local/Ascend
+source /usr/local/Ascend/nnal/atb/set_env.sh
+echo "nnal install success"
+
+# Some CANN versions install to versioned paths (e.g. cann-9.0.0-beta.2)
+# instead of /usr/local/Ascend/cann/. Fix broken symlinks so runtime
+# sourcing of set_env.sh works.
+if [ ! -f /usr/local/Ascend/cann/set_env.sh ]; then
+  CANN_REAL_DIR=$(ls -d /usr/local/Ascend/cann-* 2>/dev/null | head -1)
+  if [ -n "${CANN_REAL_DIR}" ]; then
+    ln -sf "${CANN_REAL_DIR}" /usr/local/Ascend/cann
+    echo "Fixed: linked ${CANN_REAL_DIR} -> /usr/local/Ascend/cann"
+  fi
+fi
+
+rm -rf *
+echo "CANN ${CANN_CHIP} installation complete."

.ci/docker/common/install_obs.sh

@@ -0,0 +1,21 @@
+#!/usr/bin/bash
+# Install Huawei OBS util for object storage access.
+
+set -e
+
+ARCH=$(uname -m)
+case "${ARCH}" in
+  x86_64)  OBS_ARCH="amd64" ;;
+  aarch64) OBS_ARCH="arm64" ;;
+  *)       echo "Unsupported architecture: ${ARCH}"; exit 1 ;;
+esac
+
+OBS_URL="https://obs-community.obs.cn-north-1.myhuaweicloud.com/obsutil/current/obsutil_linux_${OBS_ARCH}.tar.gz"
+
+wget -q "${OBS_URL}"
+mkdir -p /usr/local/obsutil
+tar -zxf "obsutil_linux_${OBS_ARCH}.tar.gz" -C /usr/local/obsutil/
+rm -f "obsutil_linux_${OBS_ARCH}.tar.gz"
+ln -sf /usr/local/obsutil/obsutil_linux_${OBS_ARCH}_*/obsutil /usr/local/bin/obsutil
+
+echo "OBS util installed."

.ci/docker/common/install_triton.sh

@@ -0,0 +1,19 @@
+#!/usr/bin/bash
+# Install triton-ascend for NPU.
+# Usage: ./install_triton.sh <PYTHON_VERSION>
+#   PYTHON_VERSION: e.g. 3.10, 3.11, 3.12, 3.13
+
+set -e
+
+TRITON_VERSION="${TRITON_VERSION:-3.2.1}"
+PYTHON_VERSION="${1:?Usage: $0 <PYTHON_VERSION> (e.g. 3.10)}"
+
+ARCH=$(uname -m)
+PY_SHORT=$(echo "${PYTHON_VERSION}" | tr -d '.')
+
+TRITON_WHL="triton_ascend-${TRITON_VERSION}-cp${PY_SHORT}-cp${PY_SHORT}-manylinux_2_27_${ARCH}.manylinux_2_28_${ARCH}.whl"
+TRITON_URL="https://gitcode.com/Ascend/triton-ascend/releases/download/v${TRITON_VERSION}/${TRITON_WHL}"
+
+echo "Installing triton-ascend ${TRITON_VERSION} for Python ${PYTHON_VERSION} (${ARCH})..."
+pip3 install --no-cache-dir "${TRITON_URL}"
+echo "triton-ascend installed."