ํ”ผ๋“œ๋กœ ๋Œ์•„๊ฐ€๊ธฐ
How I Built an AI-Powered Claw Machine Controlled via WebRTC and Lark/Feishu ๐Ÿค–๐Ÿช
Dev.toDev.to
Infrastructure

WebRTC์™€ AI Agent๋กœ ๊ตฌํ˜„ํ•œ ์ดˆ์ €์ง€์—ฐ ์›๊ฒฉ ์ œ์–ด ๋กœ๋ด‡

How I Built an AI-Powered Claw Machine Controlled via WebRTC and Lark/Feishu ๐Ÿค–๐Ÿช

OpenClaw_Creator2026๋…„ 4์›” 5์ผ2๋ถ„intermediate

Context

์›๊ฒฉ ๊ทผ๋ฌด ํ™˜๊ฒฝ์œผ๋กœ ์ธํ•œ ์˜คํ”„๋ผ์ธ ์†Œํ†ต ๋ถ€์žฌ ๋ฐœ์ƒ. ์ธํ„ฐ๋„ท์„ ํ†ตํ•œ ์‹ค์‹œ๊ฐ„ ์ธ๊ฐ„-๋กœ๋ด‡ ์ƒํ˜ธ์ž‘์šฉ(HRI) ๊ตฌํ˜„ ํ•„์š”. ๋ฌผ๋ฆฌ์  ์ œ์–ด ์žฅ์น˜์™€ ์›น ์ธํ„ฐํŽ˜์ด์Šค ๊ฐ„์˜ ์‹ค์‹œ๊ฐ„ ์—ฐ๊ฒฐ์„ฑ ํ™•๋ณด ๊ณผ์ œ.

Technical Solution

  • OpenClaw AI Agent ํ”„๋ ˆ์ž„์›Œํฌ ๊ธฐ๋ฐ˜์˜ ์˜๋„(Intent) ์ค‘์‹ฌ ์ œ์–ด ๊ตฌ์กฐ ์„ค๊ณ„
  • WebRTC(Pion)๋ฅผ ํ™œ์šฉํ•œ 1080p ๊ณ ํ•ด์ƒ๋„ ์ €์ง€์—ฐ ๋น„๋””์˜ค ์ŠคํŠธ๋ฆฌ๋ฐ ๊ตฌํ˜„
  • Lark/Feishu Bot API์™€ MQTT๋ฅผ ๊ฒฐํ•ฉํ•œ ์ฑ„ํŒ… ๊ธฐ๋ฐ˜ ๋กœ๋ด‡ ์ œ์–ด ์ธํ„ฐํŽ˜์ด์Šค ํ†ตํ•ฉ
  • Raspberry Pi 4B(์ œ์–ด ๋ฐ ํ†ต์‹  ๊ฒŒ์ดํŠธ์›จ์ด)์™€ Arduino Mega(PWM ์‹ ํ˜ธ ์ƒ์„ฑ)์˜ ์—ญํ•  ๋ถ„๋ฆฌ ์•„ํ‚คํ…์ฒ˜ ์ ์šฉ
  • ์„œ๋ณด ๋ชจํ„ฐ์˜ ๊ธ‰๊ฒฉํ•œ ์ „๋ฅ˜ ์ŠคํŒŒ์ดํฌ ๋ฐฉ์ง€๋ฅผ ์œ„ํ•œ ๊ณตํ†ต ์ ‘์ง€ ๋ฐ ์ „์› ๋ ˆ์ผ ๋ถ„๋ฆฌ ์„ค๊ณ„

Impact

  • ์ œ์–ด ์ง€์—ฐ ์‹œ๊ฐ„(Control Latency): ์•ฝ 45ms
  • ๋น„๋””์˜ค ํ”ผ๋“œ ์ง€์—ฐ ์‹œ๊ฐ„: 200ms ๋ฏธ๋งŒ (1080p @ 30 FPS)
  • ์กฐ์ž‘ ์„ฑ๊ณต๋ฅ : ์•ฝ 36.8%

Key Takeaway

๊ณ ๋ถ€ํ•˜ ํ•˜๋“œ์›จ์–ด ์ œ์–ด ์‹œ ์—ฐ์‚ฐ ๋กœ์ง(Thinking)๊ณผ ๋ฌผ๋ฆฌ ์‹ ํ˜ธ ์ƒ์„ฑ(Moving) ๊ณ„์ธต์„ ๋ถ„๋ฆฌํ•˜์—ฌ ์‹œ์Šคํ…œ ์•ˆ์ •์„ฑ์„ ํ™•๋ณดํ•˜๋Š” ์„ค๊ณ„ ์›์น™.


๊ณ ์ „๋ฅ˜ ์„œ๋ณด ๋ชจํ„ฐ ์‚ฌ์šฉ ์‹œ MCU ๋ณดํ˜ธ๋ฅผ ์œ„ํ•ด ์ „์› ๋ ˆ์ผ์„ ๋ถ„๋ฆฌํ•˜๊ณ  ๊ณตํ†ต ์ ‘์ง€๋ฅผ ์œ ์ง€ํ•  ๊ฒƒ

์›๋ฌธ ์ฝ๊ธฐ