Right-Hand Support — Feasibility Verification Plan for Ascend NPU Adaptation
Core Conclusion: Ascend NPU adaptation does not require starting from scratch. The CANN open-source community has released a complete Agent Skill system (ascend-agent-skills), supporting the entire process of model migration, optimization, and verification. The Qwen series models already have numerous deployment verification cases on Ascend NPU. Right-Hand Support has existing experience with edge-side model adaptation for Qualcomm Snapdragon and Moore Threads, making migration to Ascend NPU an engineering replication of a proven path.
Document Version: v1.0 | Update Date: 2026-06-22 | Belongs to: Right-Hand Support Project · Agent Hackathon 2026
1. Verification Approach: Not "Whether It's Possible," but "How to Verify"
Strategy: Utilize the existing toolchain and public cases from the Ascend community to quickly close the loop from "claim" to "proof."
已有验证(高通/摩尔线程)→ 昇腾社区工具链(开箱即用)→ 快速复现验证 → 形成可展示证据
二、可用的验证工具与资源
2.1 昇腾Model-Agent Skill(大赛指定工具)
大赛明确提供了昇腾NPU模型适配/调优Skill的使用方式:
# Register marketplace(克隆 git 仓库到本地)
/plugin marketplace add https://gitcode.com/gmq123/ascend-model-agent-plugin
# 安装 plugin
/plugin install ascend-model-agent-plugin@ascend-model-agent-plugin
该Skill的核心能力:
- Check Compatibility: Automatically detect model compatibility with Ascend NPU.
- Perform Optimization: Automated inference optimization (parallelization, KVCache, operator fusion, graph mode).
- Quick Deployment: One-click deployment of inference service.
- Stable Launch: Full verification and acceptance process.
2.2 CANN Open-Source Community Agent Skill System
The CANN open-source community has released an Agent Skill system for Ascend NPU inference optimization scenarios:
| Capability | Description | Validation Data |
|------|------|----------|
| Model Analysis & Baseline Establishment | Automatically analyzes model architecture and establishes performance baselines | Simple models optimized within 2 hours |
| Parallelization Adaptation | Automatically adapts to NPU parallel computing | Complex models complete closed-loop optimization in 6-8 hours |
| KVCache & FA Optimization | Memory optimization | Covers models like Qwen3.5-0.8B |
| Fused Operator Replacement | Operator-level optimization | Decode speedup 5.1x |
| Graph Mode Adaptation | Graph breakpoint fixes | End-to-end throughput improved 2.8x |
Measured Results (Qwen3.5-0.8B):
| Metric | Without Skill | With Skill | Improvement |
|------|------------|-----------|------|
| Decode Speedup | 1.1x | 5.1x | +360% |
| End-to-End Throughput | 11.16 tok/s | 31.59 tok/s | +183% |
| Fused Operator Coverage | 3 categories | Full coverage of 7 categories | +133% |
2.3 ascend-agent-skills Official Repository
The Ascend official Agent Skills repository already includes complete migration and validation Skills:
- Main Orchestration Skill: End-to-end workflow orchestration
- Model Migration Skill: Model format conversion and adaptation
- Data Migration Skill: Dataset adaptation
- Configuration Migration Skill: Configuration file conversion
- Validation & Acceptance Skill: Accuracy and performance validation
The repository currently contains 52 Skills, with 13 belonging to the migration and adaptation category.
III. Existing Validation Cases for Qwen Series Models on Ascend NPU
3.1 Directly Related Cases
| Model | Validation Environment | Validation Content | Source |
|---|---|---|---|
| Qwen3-VL-8B | UOS + Ascend 910B + CANN 8.0 | End-to-end deployment and usability validation | |
| Qwen3-8B | Huawei Ascend NPU + vLLM-Ascend | One-click chatbot deployment | |
| Qwen3.6-27B | Huawei Ascend 910B | Inference acceleration practice | |
| Qwen3.5-0.8B | Ascend NPU | End-to-end validation of CANN Skill | |
| Qwen3-Coder-Next | MindSpeed + vLLM Ascend | Model deployment guide | |
| Qwen3.5 Full Series | Atlas 800 A2/A3 | Day0 Training and Inference Deployment |
3.2 Key Conclusions
- The Qwen series models have numerous successful deployment cases on Ascend NPUs, covering various scales from 8B to 235B.
- vLLM-Ascend and SGLang natively support Ascend NPUs, enabling Qwen models to run directly.
- CANN 8.0 + PyTorch-Ascend already covers mainstream Transformer operators.
- The SGLang inference engine natively supports Ascend as a backend, allowing models like DeepSeek, Qwen, and GLM to run directly.
IV. Specific Verification Steps (Executable Directly)
4.1 Environment Preparation (1-2 hours)
| Step | Operation | Description |
|---|---|---|
| 1 | Obtain Ascend NPU Development Environment | Use the AtomCode environment provided by the competition or apply for a Huawei Cloud Ascend NPU instance |
| 2 | Install CANN Toolkit (≥7.0.RC1) | Ascend NPU foundational software stack |
| 3 | Install PyTorch-Ascend | Ascend-adapted version of PyTorch |
| 4 | Install vLLM-Ascend or SGLang | Inference Engine |
| 5 | Install Ascend Model-Agent Plugin | Competition-specified Tool |
4.2 Model Adaptation and Verification (2-8 hours)
| Step | Operation | Estimated Duration |
|------|------|----------|
| 1 | Perform model analysis using Ascend Model-Agent Skill | 30 minutes |
| 2 | Execute model migration (using ascend-agent-skills) | 1-2 hours |
| 3 | Perform inference optimization (using CANN Skill system) | 2-4 hours |
| 4 | Execute verification and acceptance (using verification-acceptance Skill) | 1-2 hours |
Expected Outcome:
- Simple model: Complete full optimization loop within 2 hours
- Complex model: Complete basic optimization loop within 6-8 hours
4.3 Verification and Acceptance Criteria
| Verification Item | Criterion | Verification Method |
|--------|------|----------|
| Model Loading | Model weights can be correctly loaded and parsed by the Ascend platform | Run inference test |
| Inference Accuracy | Error vs. GPU baseline
| Inference Performance | End-to-end throughput ≥ 80% of GPU baseline | Performance evaluation |
| Stability | 7x24 hours stable operation | Stress test |
5. How to use existing adaptation experience to enhance persuasiveness
5.1 Qualcomm Snapdragon adaptation experience → Analogy to Ascend NPU
| Dimension | Qualcomm Snapdragon (Completed) | Ascend NPU (Target) |
|---|---|---|
| Adaptation cycle | 3 months (2025 Qualcomm Competition) | Estimated 2-4 weeks (toolchain more mature) |
| Optimization result | 7x speed improvement, Top 20 | Target: Achieve 80%+ of GPU baseline performance |
| Technical approach | NPU model conversion, memory optimization, operator compatibility | Identical approach + Ascend-specific Skill |
5.2 Moore Threads adaptation experience → Analogy to Ascend NPU
| Dimension | Moore Threads (Completed) | Ascend NPU (Target) |
|---|---|---|
| Adaptation outcome | Full-featured GPU adaptation (MUSA architecture) | Target: Complete NPU adaptation verification |
| Technical approach | Domestic GPU heterogeneous computing adaptation | Similar approach + Ascend CANN ecosystem |
5.3 Core Talking Points
"Zuobang Youbi has completed adaptation verification for two edge-side chips, Qualcomm Snapdragon and Moore Threads — proving our technology stack is chip-agnostic. Adapting to the Ascend NPU is an engineering replication following the same path, and the Ascend community already provides a complete Agent Skill toolchain (ascend-agent-skills + CANN Skill system). The Qwen series models have numerous successful deployment cases. We estimate 2-4 weeks to complete the adaptation and verification for the Ascend NPU."
VI. Directly Citable Evidence List
| No. | Evidence | Source |
|---|---|---|
| 1 | Ascend Model-Agent Skill (competition-specified tool) supports full process: adaptation checking, tuning, deployment, and verification | |
| 2 | The official ascend-agent-skills repository contains 52 Skills, including verification and acceptance Skills | |
| 3 | CANN Skill system measured results: Qwen3.5-0.8B Decode speedup 5.1x, end-to-end throughput improvement 2.8x | |
| 4 | Qwen3-VL-8B completed end-to-end deployment verification on Unity UOS + Ascend 910B environment | |
| 5 | One-click deployment of Qwen3-8B chatbot on Ascend NPU environment | |
| 6 | Qwen3.6-27B achieves inference acceleration on Huawei Ascend 910B | |
| 7 | SGLang natively supports Ascend, Qwen models can run directly without code changes | |
| 8 | ZuoBangYouBi has prior Qualcomm Snapdragon adaptation experience (7x acceleration, Top 20) | In-house achievement |
| 9 | ZuoBangYouBi has prior Moore Threads adaptation experience (full-featured GPU with MUSA architecture) | In-house achievement |
VII. Summary
The Ascend NPU adaptation by ZuoBangYouBi is not "theoretically feasible" but rather "tools ready, path clear, and rapidly verifiable."
Three levels of assurance:
- Tooling layer: Ascend Model-Agent Skill + ascend-agent-skills + CANN Skill system, ready out-of-the-box
- Case layer: Numerous successful deployment cases of Qwen series models on Ascend NPU
- Experience layer: ZuoBangYouBi has completed edge-side model adaptation on Qualcomm Snapdragon and Moore Threads, path validated
Estimated validation time: 2-4 weeks to complete Ascend NPU adaptation and verification
Validation criteria: Model loads successfully + inference accuracy meets standard + inference performance meets standard + stability meets standard
BossAgents