← 精选项目Selected work
PROJECT 01 / SMARTCAM

从深度感知到机器人控制Connecting depth perception to robot control

围绕 RGB-D 感知、边缘视觉与控制接口,探索可调试、可追溯的机器人感知链路。Exploring a debuggable, traceable sensing pipeline that connects RGB-D perception, edge vision and robot control.

RealSense RGB-DYOLOv8nROS 2Jetson / Raspberry PiPython
时间Period2025.08 — ongoing
领域Focus机器人感知与集成Robot perception & integration
状态Status持续开发In development
PERCEPTION → ACTIONSYS / SMARTCAM
RGB-DEDGE VISION
CONCEPTUAL SYSTEM DIAGRAM原创示意 / 非实物照片
01 / PROBLEM

要解决什么问题The engineering problem

机器人需要把相机输出转化为控制侧可使用的信息。工程重点不仅是目标检测,还包括深度流、时间关系、日志与系统联调。A robot needs camera outputs in a form its controller can use. The engineering work spans object detection, depth streams, timing, logging and integration.

02 / ARCHITECTURE

系统如何连接How the system connects

  1. 01RealSense:彩色与深度输入RealSense: color and depth input
  2. 02边缘视觉:YOLOv8n 与感知处理Edge vision: YOLOv8n and perception processing
  3. 03ROS 2 / 控制接口:消息与系统联调ROS 2 / control interfaces: messages and integration
  4. 04日志与测试:回看行为及诊断问题Logs and tests: inspect behavior and diagnose issues

以上为概念级结构梳理,不是实物接线图或验证报告。A conceptual architecture summary, not an as-built wiring diagram or validation report.

03 / CONTRIBUTIONS

我的工作与参与My work & contributions

  • 编写相机采集、感知流与机器人接口相关脚本。Develop camera acquisition, perception pipeline and robot interface scripts.
  • 围绕 RGB-D 输入与边缘设备开展集成和联调。Integrate RGB-D inputs with edge computing hardware.
  • 通过测试日志和训练记录支持问题定位与迭代。Use test logs and training records to support diagnosis and iteration.
04 / VALIDATION & LIMITS

有证据的结论,明确的边界Evidence, with clear boundaries

现有资料包含相机脚本、检测训练配置、结果与测试日志。端到端制动时延、带宽收益和实机安全性能尚不作为已验证结论展示。VLA 是后续研究扩展。Available materials include camera scripts, detection training configurations, results and test logs. End-to-end braking latency, bandwidth savings and operational safety are not presented as verified results. VLA remains a research extension.
05 / MEDIA

工程媒体与后续补充Engineering media

真实工程媒体 · 待审核补充Engineering media · pending review

本页展示原创系统示意图。实际机器人照片与演示视频将在完成来源及隐私审核后补充。This page uses an original conceptual system diagram. Robot photographs and demonstration videos can be added after provenance and privacy review.

NEXT PROJECT

STC32