1颗NPU分时复用:鸿蒙把轻AI塞进了MCU

一颗 NPU 既要跑人脸识别,又要跑目标跟踪,还要留算力控车------上海海思在乌镇给出的答案是「分时复用 + 五态状态机」。轻 AI 不是小号大模型,是一套把算力切成片来用的工程学。

🎯 一、乌镇传来的消息:从「哑终端」到「轻智能」

世界互联网大会乌镇峰会「互联网之光」博览会期间,上海海思正式发布了开源鸿蒙轻AI越影方案。官方的表述很有意思:让终端从「哑终端」走向「轻智能」。

所谓「哑终端」,就是传统 MCU 设备------传感器采数据,主控做判断,逻辑全靠 if-else 写死。而「轻智能」,是在不换算力平台的前提下,给这类设备塞进人脸识别、目标跟踪、异常检测这类轻量 AI 能力。

方案依托 HiSpark 社区构建交付阵地,覆盖从原型验证到商业量产的完整路径。现场最抓眼球的演示,是一台基于轻AI越影开发板的智能小车:ZeroClaw + AI人脸识别 + AI跟踪,一台板子同时完成视觉推理和底盘控制。

🧠 二、核心矛盾:一颗 NPU,三张嘴等着吃饭

轻智能设备的老大难问题,是算力永远不够用。以那台智能小车为例,同一颗 NPU 上压着三件任务:

  • 人脸识别:检测并识别目标人物
  • 人形跟踪:连续帧锁定目标位置
  • 决策控车:根据跟踪结果驱动底盘电机

三件事都要 NPU 出算力,但 NPU 同一时刻只能跑一个模型。传统的解法是「堆芯片」------视觉板加控制板,两颗芯片各干各的,中间总线通信。轻AI越影方案的解法更激进:单NPU分时复用,把算力像时间片一样切给不同任务。
#mermaid-svg-UtwEINt11wm9KP18{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-UtwEINt11wm9KP18 .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-UtwEINt11wm9KP18 .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-UtwEINt11wm9KP18 .error-icon{fill:#552222;}#mermaid-svg-UtwEINt11wm9KP18 .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-UtwEINt11wm9KP18 .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-UtwEINt11wm9KP18 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-UtwEINt11wm9KP18 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-UtwEINt11wm9KP18 .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-UtwEINt11wm9KP18 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-UtwEINt11wm9KP18 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-UtwEINt11wm9KP18 .marker{fill:#333333;stroke:#333333;}#mermaid-svg-UtwEINt11wm9KP18 .marker.cross{stroke:#333333;}#mermaid-svg-UtwEINt11wm9KP18 svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-UtwEINt11wm9KP18 p{margin:0;}#mermaid-svg-UtwEINt11wm9KP18 .label{font-family:"trebuchet ms",verdana,arial,sans-serif;color:#333;}#mermaid-svg-UtwEINt11wm9KP18 .cluster-label text{fill:#333;}#mermaid-svg-UtwEINt11wm9KP18 .cluster-label span{color:#333;}#mermaid-svg-UtwEINt11wm9KP18 .cluster-label span p{background-color:transparent;}#mermaid-svg-UtwEINt11wm9KP18 .label text,#mermaid-svg-UtwEINt11wm9KP18 span{fill:#333;color:#333;}#mermaid-svg-UtwEINt11wm9KP18 .node rect,#mermaid-svg-UtwEINt11wm9KP18 .node circle,#mermaid-svg-UtwEINt11wm9KP18 .node ellipse,#mermaid-svg-UtwEINt11wm9KP18 .node polygon,#mermaid-svg-UtwEINt11wm9KP18 .node path{fill:#ECECFF;stroke:#9370DB;stroke-width:1px;}#mermaid-svg-UtwEINt11wm9KP18 .rough-node .label text,#mermaid-svg-UtwEINt11wm9KP18 .node .label text,#mermaid-svg-UtwEINt11wm9KP18 .image-shape .label,#mermaid-svg-UtwEINt11wm9KP18 .icon-shape .label{text-anchor:middle;}#mermaid-svg-UtwEINt11wm9KP18 .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-svg-UtwEINt11wm9KP18 .rough-node .label,#mermaid-svg-UtwEINt11wm9KP18 .node .label,#mermaid-svg-UtwEINt11wm9KP18 .image-shape .label,#mermaid-svg-UtwEINt11wm9KP18 .icon-shape .label{text-align:center;}#mermaid-svg-UtwEINt11wm9KP18 .node.clickable{cursor:pointer;}#mermaid-svg-UtwEINt11wm9KP18 .root .anchor path{fill:#333333!important;stroke-width:0;stroke:#333333;}#mermaid-svg-UtwEINt11wm9KP18 .arrowheadPath{fill:#333333;}#mermaid-svg-UtwEINt11wm9KP18 .edgePath .path{stroke:#333333;stroke-width:2.0px;}#mermaid-svg-UtwEINt11wm9KP18 .flowchart-link{stroke:#333333;fill:none;}#mermaid-svg-UtwEINt11wm9KP18 .edgeLabel{background-color:rgba(232,232,232, 0.8);text-align:center;}#mermaid-svg-UtwEINt11wm9KP18 .edgeLabel p{background-color:rgba(232,232,232, 0.8);}#mermaid-svg-UtwEINt11wm9KP18 .edgeLabel rect{opacity:0.5;background-color:rgba(232,232,232, 0.8);fill:rgba(232,232,232, 0.8);}#mermaid-svg-UtwEINt11wm9KP18 .labelBkg{background-color:rgba(232, 232, 232, 0.5);}#mermaid-svg-UtwEINt11wm9KP18 .cluster rect{fill:#ffffde;stroke:#aaaa33;stroke-width:1px;}#mermaid-svg-UtwEINt11wm9KP18 .cluster text{fill:#333;}#mermaid-svg-UtwEINt11wm9KP18 .cluster span{color:#333;}#mermaid-svg-UtwEINt11wm9KP18 div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:12px;background:hsl(80, 100%, 96.2745098039%);border:1px solid #aaaa33;border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-UtwEINt11wm9KP18 .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#333;}#mermaid-svg-UtwEINt11wm9KP18 rect.text{fill:none;stroke-width:0;}#mermaid-svg-UtwEINt11wm9KP18 .icon-shape,#mermaid-svg-UtwEINt11wm9KP18 .image-shape{background-color:rgba(232,232,232, 0.8);text-align:center;}#mermaid-svg-UtwEINt11wm9KP18 .icon-shape p,#mermaid-svg-UtwEINt11wm9KP18 .image-shape p{background-color:rgba(232,232,232, 0.8);padding:2px;}#mermaid-svg-UtwEINt11wm9KP18 .icon-shape .label rect,#mermaid-svg-UtwEINt11wm9KP18 .image-shape .label rect{opacity:0.5;background-color:rgba(232,232,232, 0.8);fill:rgba(232,232,232, 0.8);}#mermaid-svg-UtwEINt11wm9KP18 .label-icon{display:inline-block;height:1em;overflow:visible;vertical-align:-0.125em;}#mermaid-svg-UtwEINt11wm9KP18 .node .label-icon path{fill:currentColor;stroke:revert;stroke-width:revert;}#mermaid-svg-UtwEINt11wm9KP18 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} 时间片 1
时间片 2
摄像头采集图像
图像预处理
NPU 分时调度器
人脸识别模型
人形跟踪模型
识别结果
目标坐标
决策大脑
控车命令
底盘 MCU 执行

这个架构里最关键的组件是「决策大脑」。它不是大模型,而是一个五态 FSM(有限状态机),用极小的 CPU 开销把 AI 输出转成控车动作。

⚙️ 三、五态 FSM:决策大脑的骨架

智能小车的决策大脑采用五态状态机设计。AI 推理是「周期性」的------每帧图像推理一次------但车是「连续」运动的,中间的空档就靠状态机撑住。
渲染错误: Mermaid 渲染失败: Parse error on line 2: ...gram-v2 \* --> "待机态" "待机态" --> ----------------------^ Expecting 'ID', 'EDGE_STATE', got 'STRING'

五个状态的职责划分很清晰:待机省电、搜索调模型、锁定做确认、跟踪管滤波、控车输出 PWM。状态机把「不确定的 AI 输出」和「确定的控制逻辑」隔离开------AI 说我看到了人,信不信、怎么动,由 FSM 按规则裁决,不会因为一帧误检就让车窜出去。

🔌 四、MicroPython 插件 + Skills:能力怎么编排

轻AI越影方案的另一大亮点,是MicroPython 插件与预置 Skills 动态编排。传统嵌入式改一个功能要重编译固件,而这套架构把能力做成插件,MicroPython 层负责编排调度。
渲染错误: Mermaid 渲染失败: Parse error on line 2: ...sDiagram class "决策大脑" { +五态F ----------------------^ Expecting 'ALPHA', 'NUM', 'MINUS', 'UNICODE_TEXT', 'BQUOTE_STR', got 'STR'

预置 Skills 的好处是「开箱即用」:开发者不需要自己训练模型、写前后处理,把现成的 Skill 挂到编排层就能跑。要加新能力,写一个 MicroPython 插件注册进事件总线即可,主固件不动。

⏱️ 五、算力账本:分时复用的账怎么算

单 NPU 分时复用听起来美好,但时间片怎么分是门学问。按演示场景的典型负载估算:
#mermaid-svg-yDXFFFffoGKYRxpQ{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-yDXFFFffoGKYRxpQ .error-icon{fill:#552222;}#mermaid-svg-yDXFFFffoGKYRxpQ .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-yDXFFFffoGKYRxpQ .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-yDXFFFffoGKYRxpQ .marker{fill:#333333;stroke:#333333;}#mermaid-svg-yDXFFFffoGKYRxpQ .marker.cross{stroke:#333333;}#mermaid-svg-yDXFFFffoGKYRxpQ svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-yDXFFFffoGKYRxpQ p{margin:0;}#mermaid-svg-yDXFFFffoGKYRxpQ .pieCircle{stroke:#000000;stroke-width:2px;opacity:0.7;}#mermaid-svg-yDXFFFffoGKYRxpQ .pieOuterCircle{stroke:#000000;stroke-width:1px;fill:none;}#mermaid-svg-yDXFFFffoGKYRxpQ .pieTitleText{text-anchor:middle;font-size:25px;fill:#000000;font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-yDXFFFffoGKYRxpQ .slice{font-family:"trebuchet ms",verdana,arial,sans-serif;fill:#000000;font-size:17px;}#mermaid-svg-yDXFFFffoGKYRxpQ .legend text{fill:#000000;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:17px;}#mermaid-svg-yDXFFFffoGKYRxpQ :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} 35%30%15%12%8%"单 NPU 时间片分配(典型跟踪场景)" 人脸识别推理 人形跟踪推理 图像预处理 决策与控车 空闲裕量

留 8% 裕量是关键设计:突发帧、模型切换、异常恢复都要吃裕量。分时复用的本质是排队论------每个任务有截止时间,调度器要保证最坏情况下也不超时,否则跟踪就会「卡顿」。
#mermaid-svg-H7g8WURvgIaI4AWt{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-H7g8WURvgIaI4AWt .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-H7g8WURvgIaI4AWt .error-icon{fill:#552222;}#mermaid-svg-H7g8WURvgIaI4AWt .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-H7g8WURvgIaI4AWt .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-H7g8WURvgIaI4AWt .marker{fill:#333333;stroke:#333333;}#mermaid-svg-H7g8WURvgIaI4AWt .marker.cross{stroke:#333333;}#mermaid-svg-H7g8WURvgIaI4AWt svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-H7g8WURvgIaI4AWt p{margin:0;}#mermaid-svg-H7g8WURvgIaI4AWt .mermaid-main-font{font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-H7g8WURvgIaI4AWt .exclude-range{fill:#eeeeee;}#mermaid-svg-H7g8WURvgIaI4AWt .section{stroke:none;opacity:0.2;}#mermaid-svg-H7g8WURvgIaI4AWt .section0{fill:rgba(102, 102, 255, 0.49);}#mermaid-svg-H7g8WURvgIaI4AWt .section2{fill:#fff400;}#mermaid-svg-H7g8WURvgIaI4AWt .section1,#mermaid-svg-H7g8WURvgIaI4AWt .section3{fill:white;opacity:0.2;}#mermaid-svg-H7g8WURvgIaI4AWt .sectionTitle0{fill:#333;}#mermaid-svg-H7g8WURvgIaI4AWt .sectionTitle1{fill:#333;}#mermaid-svg-H7g8WURvgIaI4AWt .sectionTitle2{fill:#333;}#mermaid-svg-H7g8WURvgIaI4AWt .sectionTitle3{fill:#333;}#mermaid-svg-H7g8WURvgIaI4AWt .sectionTitle{text-anchor:start;font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-H7g8WURvgIaI4AWt .grid .tick{stroke:lightgrey;opacity:0.8;shape-rendering:crispEdges;}#mermaid-svg-H7g8WURvgIaI4AWt .grid .tick text{font-family:"trebuchet ms",verdana,arial,sans-serif;fill:#333;}#mermaid-svg-H7g8WURvgIaI4AWt .grid path{stroke-width:0;}#mermaid-svg-H7g8WURvgIaI4AWt .today{fill:none;stroke:red;stroke-width:2px;}#mermaid-svg-H7g8WURvgIaI4AWt .task{stroke-width:2;}#mermaid-svg-H7g8WURvgIaI4AWt .taskText{text-anchor:middle;font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutsideRight{fill:black;text-anchor:start;font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutsideLeft{fill:black;text-anchor:end;}#mermaid-svg-H7g8WURvgIaI4AWt .task.clickable{cursor:pointer;}#mermaid-svg-H7g8WURvgIaI4AWt .taskText.clickable{cursor:pointer;fill:#003163!important;font-weight:bold;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutsideLeft.clickable{cursor:pointer;fill:#003163!important;font-weight:bold;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutsideRight.clickable{cursor:pointer;fill:#003163!important;font-weight:bold;}#mermaid-svg-H7g8WURvgIaI4AWt .taskText0,#mermaid-svg-H7g8WURvgIaI4AWt .taskText1,#mermaid-svg-H7g8WURvgIaI4AWt .taskText2,#mermaid-svg-H7g8WURvgIaI4AWt .taskText3{fill:white;}#mermaid-svg-H7g8WURvgIaI4AWt .task0,#mermaid-svg-H7g8WURvgIaI4AWt .task1,#mermaid-svg-H7g8WURvgIaI4AWt .task2,#mermaid-svg-H7g8WURvgIaI4AWt .task3{fill:#8a90dd;stroke:#534fbc;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutside0,#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutside2{fill:black;}#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutside1,#mermaid-svg-H7g8WURvgIaI4AWt .taskTextOutside3{fill:black;}#mermaid-svg-H7g8WURvgIaI4AWt .active0,#mermaid-svg-H7g8WURvgIaI4AWt .active1,#mermaid-svg-H7g8WURvgIaI4AWt .active2,#mermaid-svg-H7g8WURvgIaI4AWt .active3{fill:#bfc7ff;stroke:#534fbc;}#mermaid-svg-H7g8WURvgIaI4AWt .activeText0,#mermaid-svg-H7g8WURvgIaI4AWt .activeText1,#mermaid-svg-H7g8WURvgIaI4AWt .activeText2,#mermaid-svg-H7g8WURvgIaI4AWt .activeText3{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .done0,#mermaid-svg-H7g8WURvgIaI4AWt .done1,#mermaid-svg-H7g8WURvgIaI4AWt .done2,#mermaid-svg-H7g8WURvgIaI4AWt .done3{stroke:grey;fill:lightgrey;stroke-width:2;}#mermaid-svg-H7g8WURvgIaI4AWt .doneText0,#mermaid-svg-H7g8WURvgIaI4AWt .doneText1,#mermaid-svg-H7g8WURvgIaI4AWt .doneText2,#mermaid-svg-H7g8WURvgIaI4AWt .doneText3{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .doneText0.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneText0.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneText1.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneText1.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneText2.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneText2.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneText3.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneText3.taskTextOutsideRight{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .crit0,#mermaid-svg-H7g8WURvgIaI4AWt .crit1,#mermaid-svg-H7g8WURvgIaI4AWt .crit2,#mermaid-svg-H7g8WURvgIaI4AWt .crit3{stroke:#ff8888;fill:red;stroke-width:2;}#mermaid-svg-H7g8WURvgIaI4AWt .activeCrit0,#mermaid-svg-H7g8WURvgIaI4AWt .activeCrit1,#mermaid-svg-H7g8WURvgIaI4AWt .activeCrit2,#mermaid-svg-H7g8WURvgIaI4AWt .activeCrit3{stroke:#ff8888;fill:#bfc7ff;stroke-width:2;}#mermaid-svg-H7g8WURvgIaI4AWt .doneCrit0,#mermaid-svg-H7g8WURvgIaI4AWt .doneCrit1,#mermaid-svg-H7g8WURvgIaI4AWt .doneCrit2,#mermaid-svg-H7g8WURvgIaI4AWt .doneCrit3{stroke:#ff8888;fill:lightgrey;stroke-width:2;cursor:pointer;shape-rendering:crispEdges;}#mermaid-svg-H7g8WURvgIaI4AWt .milestone{transform:rotate(45deg) scale(0.8,0.8);}#mermaid-svg-H7g8WURvgIaI4AWt .milestoneText{font-style:italic;}#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText0,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText1,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText2,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText3{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText0.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText0.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText1.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText1.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText2.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText2.taskTextOutsideRight,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText3.taskTextOutsideLeft,#mermaid-svg-H7g8WURvgIaI4AWt .doneCritText3.taskTextOutsideRight{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .vert{stroke:navy;}#mermaid-svg-H7g8WURvgIaI4AWt .vertText{font-size:15px;text-anchor:middle;fill:navy!important;}#mermaid-svg-H7g8WURvgIaI4AWt .activeCritText0,#mermaid-svg-H7g8WURvgIaI4AWt .activeCritText1,#mermaid-svg-H7g8WURvgIaI4AWt .activeCritText2,#mermaid-svg-H7g8WURvgIaI4AWt .activeCritText3{fill:black!important;}#mermaid-svg-H7g8WURvgIaI4AWt .titleText{text-anchor:middle;font-size:18px;fill:#333;font-family:"trebuchet ms",verdana,arial,sans-serif;}#mermaid-svg-H7g8WURvgIaI4AWt :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} 0 15 30 45 60 75 90 图像预处理 人脸识别 人形跟踪 决策计算 控车命令下发 推理任务控制任务 "一帧周期内的 NPU 任务时序(示意)"

从甘特图能看出端侧 AI 的残酷之处:所有任务挤在一帧周期里,任何一段超时都会挤压后面的裕量。这也是为什么决策大脑用 FSM 而不是大模型------CPU 上的状态机够快、够确定,不跟 NPU 抢饭吃。

🧭 六、上板避坑清单:从编译到 WebRTC

现场的实操分享给了一整套「踩坑地图」。轻AI越影开发板从零跑通,要过八道关:
#mermaid-svg-93JcrKv1zAbkAgQH{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-93JcrKv1zAbkAgQH .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-93JcrKv1zAbkAgQH .error-icon{fill:#552222;}#mermaid-svg-93JcrKv1zAbkAgQH .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-93JcrKv1zAbkAgQH .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-93JcrKv1zAbkAgQH .marker{fill:#333333;stroke:#333333;}#mermaid-svg-93JcrKv1zAbkAgQH .marker.cross{stroke:#333333;}#mermaid-svg-93JcrKv1zAbkAgQH svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-93JcrKv1zAbkAgQH p{margin:0;}#mermaid-svg-93JcrKv1zAbkAgQH .label{font-family:"trebuchet ms",verdana,arial,sans-serif;color:#333;}#mermaid-svg-93JcrKv1zAbkAgQH .cluster-label text{fill:#333;}#mermaid-svg-93JcrKv1zAbkAgQH .cluster-label span{color:#333;}#mermaid-svg-93JcrKv1zAbkAgQH .cluster-label span p{background-color:transparent;}#mermaid-svg-93JcrKv1zAbkAgQH .label text,#mermaid-svg-93JcrKv1zAbkAgQH span{fill:#333;color:#333;}#mermaid-svg-93JcrKv1zAbkAgQH .node rect,#mermaid-svg-93JcrKv1zAbkAgQH .node circle,#mermaid-svg-93JcrKv1zAbkAgQH .node ellipse,#mermaid-svg-93JcrKv1zAbkAgQH .node polygon,#mermaid-svg-93JcrKv1zAbkAgQH .node path{fill:#ECECFF;stroke:#9370DB;stroke-width:1px;}#mermaid-svg-93JcrKv1zAbkAgQH .rough-node .label text,#mermaid-svg-93JcrKv1zAbkAgQH .node .label text,#mermaid-svg-93JcrKv1zAbkAgQH .image-shape .label,#mermaid-svg-93JcrKv1zAbkAgQH .icon-shape .label{text-anchor:middle;}#mermaid-svg-93JcrKv1zAbkAgQH .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-svg-93JcrKv1zAbkAgQH .rough-node .label,#mermaid-svg-93JcrKv1zAbkAgQH .node .label,#mermaid-svg-93JcrKv1zAbkAgQH .image-shape .label,#mermaid-svg-93JcrKv1zAbkAgQH .icon-shape .label{text-align:center;}#mermaid-svg-93JcrKv1zAbkAgQH .node.clickable{cursor:pointer;}#mermaid-svg-93JcrKv1zAbkAgQH .root .anchor path{fill:#333333!important;stroke-width:0;stroke:#333333;}#mermaid-svg-93JcrKv1zAbkAgQH .arrowheadPath{fill:#333333;}#mermaid-svg-93JcrKv1zAbkAgQH .edgePath .path{stroke:#333333;stroke-width:2.0px;}#mermaid-svg-93JcrKv1zAbkAgQH .flowchart-link{stroke:#333333;fill:none;}#mermaid-svg-93JcrKv1zAbkAgQH .edgeLabel{background-color:rgba(232,232,232, 0.8);text-align:center;}#mermaid-svg-93JcrKv1zAbkAgQH .edgeLabel p{background-color:rgba(232,232,232, 0.8);}#mermaid-svg-93JcrKv1zAbkAgQH .edgeLabel rect{opacity:0.5;background-color:rgba(232,232,232, 0.8);fill:rgba(232,232,232, 0.8);}#mermaid-svg-93JcrKv1zAbkAgQH .labelBkg{background-color:rgba(232, 232, 232, 0.5);}#mermaid-svg-93JcrKv1zAbkAgQH .cluster rect{fill:#ffffde;stroke:#aaaa33;stroke-width:1px;}#mermaid-svg-93JcrKv1zAbkAgQH .cluster text{fill:#333;}#mermaid-svg-93JcrKv1zAbkAgQH .cluster span{color:#333;}#mermaid-svg-93JcrKv1zAbkAgQH div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:12px;background:hsl(80, 100%, 96.2745098039%);border:1px solid #aaaa33;border-radius:2px;pointer-events:none;z-index:100;}#mermaid-svg-93JcrKv1zAbkAgQH .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#333;}#mermaid-svg-93JcrKv1zAbkAgQH rect.text{fill:none;stroke-width:0;}#mermaid-svg-93JcrKv1zAbkAgQH .icon-shape,#mermaid-svg-93JcrKv1zAbkAgQH .image-shape{background-color:rgba(232,232,232, 0.8);text-align:center;}#mermaid-svg-93JcrKv1zAbkAgQH .icon-shape p,#mermaid-svg-93JcrKv1zAbkAgQH .image-shape p{background-color:rgba(232,232,232, 0.8);padding:2px;}#mermaid-svg-93JcrKv1zAbkAgQH .icon-shape .label rect,#mermaid-svg-93JcrKv1zAbkAgQH .image-shape .label rect{opacity:0.5;background-color:rgba(232,232,232, 0.8);fill:rgba(232,232,232, 0.8);}#mermaid-svg-93JcrKv1zAbkAgQH .label-icon{display:inline-block;height:1em;overflow:visible;vertical-align:-0.125em;}#mermaid-svg-93JcrKv1zAbkAgQH .node .label-icon path{fill:currentColor;stroke:revert;stroke-width:revert;}#mermaid-svg-93JcrKv1zAbkAgQH :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} 环境搭建
编译固件
烧录上板
网络配置
人脸识别调通
人形跟踪调通
控车命令联调
WebRTC 预览

几个高频坑值得提前知道:

  1. 环境底线:工具链版本必须严格对齐文档,差一个小版本就可能编译不过;
  2. 烧录失败:多半是驱动占用串口,先杀掉所有占用进程再烧;
  3. 网络配置:板端 Wi-Fi 和 WebRTC 预览走同一条链路,带宽不够时优先保预览;
  4. 控车联调:先在 FSM 里加「软限幅」,验证 PWM 输出范围再接电机,防止第一次联调就撞墙。

另外一个容易被忽略的新工具:数字FAE。基于海思 RAG 知识库的智能问答(Beta 阶段),覆盖芯片资料、硬件资料、软件资料、解决方案与 FAQ。嵌入式工程师查手册的时间,可能要被它省掉一大块。

🏭 七、产业视角:轻智能的交付阵地之战

轻AI越影方案的真正野心不在一台小车,而在交付阵地。HiSpark 社区把「原型验证易、产品创新智、商业落地快」打包成一站式资源,配合极客工坊的 AI Coding 实战,走的是「开发者生态 → 行业方案」的老路,但这次 AI 站在了开发链路的每一环。
"量产产线" "轻AI越影开发板" "HiSpark 社区" "开发者" "量产产线" "轻AI越影开发板" "HiSpark 社区" "开发者" #mermaid-svg-JIBwNoB4eFByCRm7{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-animation-slow{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 50s linear infinite;stroke-linecap:round;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-animation-fast{stroke-dasharray:9,5!important;stroke-dashoffset:900;animation:dash 20s linear infinite;stroke-linecap:round;}#mermaid-svg-JIBwNoB4eFByCRm7 .error-icon{fill:#552222;}#mermaid-svg-JIBwNoB4eFByCRm7 .error-text{fill:#552222;stroke:#552222;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-thickness-normal{stroke-width:1px;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-thickness-invisible{stroke-width:0;fill:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-svg-JIBwNoB4eFByCRm7 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-svg-JIBwNoB4eFByCRm7 .marker{fill:#333333;stroke:#333333;}#mermaid-svg-JIBwNoB4eFByCRm7 .marker.cross{stroke:#333333;}#mermaid-svg-JIBwNoB4eFByCRm7 svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-svg-JIBwNoB4eFByCRm7 p{margin:0;}#mermaid-svg-JIBwNoB4eFByCRm7 .actor{stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);fill:#ECECFF;}#mermaid-svg-JIBwNoB4eFByCRm7 text.actor>tspan{fill:black;stroke:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .actor-line{stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);}#mermaid-svg-JIBwNoB4eFByCRm7 .innerArc{stroke-width:1.5;stroke-dasharray:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .messageLine0{stroke-width:1.5;stroke-dasharray:none;stroke:#333;}#mermaid-svg-JIBwNoB4eFByCRm7 .messageLine1{stroke-width:1.5;stroke-dasharray:2,2;stroke:#333;}#mermaid-svg-JIBwNoB4eFByCRm7 #arrowhead path{fill:#333;stroke:#333;}#mermaid-svg-JIBwNoB4eFByCRm7 .sequenceNumber{fill:white;}#mermaid-svg-JIBwNoB4eFByCRm7 #sequencenumber{fill:#333;}#mermaid-svg-JIBwNoB4eFByCRm7 #crosshead path{fill:#333;stroke:#333;}#mermaid-svg-JIBwNoB4eFByCRm7 .messageText{fill:#333;stroke:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .labelBox{stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);fill:#ECECFF;}#mermaid-svg-JIBwNoB4eFByCRm7 .labelText,#mermaid-svg-JIBwNoB4eFByCRm7 .labelText>tspan{fill:black;stroke:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .loopText,#mermaid-svg-JIBwNoB4eFByCRm7 .loopText>tspan{fill:black;stroke:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .loopLine{stroke-width:2px;stroke-dasharray:2,2;stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);fill:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);}#mermaid-svg-JIBwNoB4eFByCRm7 .note{stroke:#aaaa33;fill:#fff5ad;}#mermaid-svg-JIBwNoB4eFByCRm7 .noteText,#mermaid-svg-JIBwNoB4eFByCRm7 .noteText>tspan{fill:black;stroke:none;}#mermaid-svg-JIBwNoB4eFByCRm7 .activation0{fill:#f4f4f4;stroke:#666;}#mermaid-svg-JIBwNoB4eFByCRm7 .activation1{fill:#f4f4f4;stroke:#666;}#mermaid-svg-JIBwNoB4eFByCRm7 .activation2{fill:#f4f4f4;stroke:#666;}#mermaid-svg-JIBwNoB4eFByCRm7 .actorPopupMenu{position:absolute;}#mermaid-svg-JIBwNoB4eFByCRm7 .actorPopupMenuPanel{position:absolute;fill:#ECECFF;box-shadow:0px 8px 16px 0px rgba(0,0,0,0.2);filter:drop-shadow(3px 5px 2px rgb(0 0 0 / 0.4));}#mermaid-svg-JIBwNoB4eFByCRm7 .actor-man line{stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);fill:#ECECFF;}#mermaid-svg-JIBwNoB4eFByCRm7 .actor-man circle,#mermaid-svg-JIBwNoB4eFByCRm7 line{stroke:hsl(259.6261682243, 59.7765363128%, 87.9019607843%);fill:#ECECFF;stroke-width:2px;}#mermaid-svg-JIBwNoB4eFByCRm7 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;} "获取方案与 Skills""开发板 + 工具链 + 文档""极客工坊实操 / AI Coding 生成代码""原型验证通过""方案导入量产""商业落地"

对嵌入式工程师来说,这件事的信号很明确:端侧 AI 不再是大模型的专属战场。一颗 NPU、一个状态机、一套 Skills 编排,MCU 级设备也能拥有「看得见、认得出、动得了」的能力。轻 AI 的门槛不在算法,在工程------而这恰恰是嵌入式团队最擅长的部分。


参考与来源:上海海思轻AI越影方案发布会(乌镇「互联网之光」博览会)、HiSpark 社区公开资料、现场实操分享。

相关推荐
前端的阶梯1 小时前
AI Agent 之 工具(Tool)
人工智能
孟健1 小时前
用 HyperFrames 解决前端视频生成难题:国产 Flash 模型实测 3 条 1080p 视频
前端·人工智能·开源
两万五千个小时2 小时前
Agent 记忆不是聊天记录,而是为未来准备的上下文 ——Anthropic 的四层记忆架构与 Dream 思想
人工智能·程序员
汤姆宝库2 小时前
语料清洗流水线的实现:启发式过滤、MinHash去重与质量分级
人工智能
火山引擎开发者社区2 小时前
不会 FFmpeg 也能做视频后期?AI MediaKit Skill 帮你实现
人工智能
tellmewhoisi3 小时前
深度学习0:数学知识:(L1正则化和L2正则化)
人工智能·深度学习
AI_Gump3 小时前
AutoGLM 两年演进深度解读:一篇讲透智谱的手机 Agent 路线
人工智能·智能手机
玄枢AI3 小时前
AI把待办整理成JSON后,用Python检查漏字段、类型错误和未知值
人工智能
VIP_CQCRE3 小时前
GPT Image 2.6 选型别只看首张:用盲评与合格图耗时比较 Flare、Sunburst
软件测试·图像处理·人工智能