ํ”ผ๋“œ๋กœ ๋Œ์•„๊ฐ€๊ธฐ
๐Ÿš€ I Built a Fully Local AI Agent for $0 (No Cloud, No API Costs)
Dev.toDev.to
AI/ML

๋น„์šฉ 0์›์œผ๋กœ ๊ตฌํ˜„ํ•œ VM ๊ธฐ๋ฐ˜ Local AI Agent ์‹œ์Šคํ…œ ์„ค๊ณ„

๐Ÿš€ I Built a Fully Local AI Agent for $0 (No Cloud, No API Costs)

Vivek Shetye2026๋…„ 4์›” 15์ผ7๋ถ„intermediate

AI ์š”์•ฝ

Context

๊ธฐ์กด AI Agent ๊ตฌ์ถ• ์‹œ ๋ฐœ์ƒํ•˜๋Š” ๋†’์€ API ๊ตฌ๋… ๋น„์šฉ๊ณผ ๊ณ ์‚ฌ์–‘ GPU ์ธํ”„๋ผ ์˜์กด์„ฑ ํ•ด๊ฒฐ ํ•„์š”. ํด๋ผ์šฐ๋“œ ๋น„์šฉ ๋ถ€๋‹ด ์—†์ด ๋กœ์ปฌ ํ™˜๊ฒฝ์—์„œ ๋™์ž‘ํ•˜๋Š” ์ž์œจ์  ํƒœ์Šคํฌ ์ˆ˜ํ–‰ ๊ตฌ์กฐ ์„ค๊ณ„ ์š”๊ตฌ.

Technical Solution

  • Ubuntu Server 24.04 LTS VM ํ™˜๊ฒฝ ๊ตฌ์ถ•์„ ํ†ตํ•œ ํ˜ธ์ŠคํŠธ OS์™€์˜ ๊ฒฉ๋ฆฌ ๋ฐ ๋ณด์•ˆ์„ฑ ํ™•๋ณด
  • OpenClaw ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ํ†ตํ•œ Tool Usage, Memory Management, Decision-making Flow์˜ ์ค‘์•™ ์ œ์–ด
  • Gemini 3.1 Flash Lite Free Tier ํ™œ์šฉ์œผ๋กœ ์ถ”๋ก  ๋ ˆ์ด์–ด์˜ ๋น„์šฉ ํšจ์œจ์„ฑ ๋ฐ ์‘๋‹ต ์†๋„ ์ตœ์ ํ™”
  • SearXNG Self-hosting์„ ํ†ตํ•œ API ํ‚ค ์—†๋Š” Private Web Search ๊ธฐ๋Šฅ ๊ตฌํ˜„ ๋ฐ JSON ํฌ๋งท ์ถœ๋ ฅ ์„ค์ •
  • Telegram Bot API ์—ฐ๋™์„ ํ†ตํ•œ ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค ๊ตฌ์ถ• ๋ฐ User ID ๊ธฐ๋ฐ˜์˜ Access Control ์ ์šฉ
  • soul.md ๋ฐ identity.md ์„ค์ •์„ ํ†ตํ•œ Agent์˜ Persona ๋ฐ ํ–‰๋™ ๊ทœ์น™์˜ ๊ตฌ์กฐ์  ์ •์˜

์‹ค์ฒœ ํฌ์ธํŠธ

1. API ๋น„์šฉ ์ตœ์ ํ™”๋ฅผ ์œ„ํ•œ LLM Free Tier์˜ Rate Limit ๋ฐ Token ์ œํ•œ ์‚ฌํ•ญ ๊ฒ€ํ† 

2. ์™ธ๋ถ€ ์„œ๋น„์Šค ์˜์กด์„ฑ ์ œ๊ฑฐ๋ฅผ ์œ„ํ•œ SearXNG์™€ ๊ฐ™์€ Self-hosted ๋„๊ตฌ ๋„์ž… ๊ณ ๋ ค

3. Agent์˜ ์ผ๊ด€๋œ ๋™์ž‘์„ ์œ„ํ•ด Persona๋ฅผ ๋ช…์‹œํ•œ ์ •์  ์„ค์ • ํŒŒ์ผ(md) ๊ด€๋ฆฌ ์ฒด๊ณ„ ๊ตฌ์ถ•

4. ์‹œ์Šคํ…œ ๊ฒฉ๋ฆฌ๋ฅผ ์œ„ํ•ด ์ตœ์†Œ 4 CPU Core, 6GB RAM ์‚ฌ์–‘์˜ VM ํ™˜๊ฒฝ ๊ตฌ์„ฑ

ํƒœ๊ทธ

#AI Agent#Self-Hosting#SearXNG#Gemini#OpenClaw
์›๋ฌธ ์ฝ๊ธฐ