ํ”ผ๋“œ๋กœ ๋Œ์•„๊ฐ€๊ธฐ
๐Ÿ—ณ๏ธ I Built a Civic AI Assistant on Google Cloud Run โ€” Hereโ€™s What Google Cloud NEXT โ€˜26 Made Me Rethink
Dev.toDev.to
Infrastructure

Google Cloud Run ๊ธฐ๋ฐ˜ Serverless AI ์•„ํ‚คํ…์ฒ˜๋ฅผ ํ†ตํ•œ ๋‹ค๊ตญ์–ด ์‹œ๋ฏผ ๊ต์œก ์‹œ์Šคํ…œ ๊ตฌํ˜„

๐Ÿ—ณ๏ธ I Built a Civic AI Assistant on Google Cloud Run โ€” Hereโ€™s What Google Cloud NEXT โ€˜26 Made Me Rethink

Babin Bid2026๋…„ 4์›” 24์ผ4๋ถ„intermediate

AI ์š”์•ฝ

Context

์ธ๋„ ๋‚ด 9์–ต ๋ช… ์ด์ƒ์˜ ์œ ๊ถŒ์ž๋ฅผ ๋Œ€์ƒ์œผ๋กœ ํ•˜๋Š” ๋ณต์žกํ•œ ์„ ๊ฑฐ ํ”„๋กœ์„ธ์Šค์˜ ์ •๋ณด ๊ฒฉ์ฐจ ํ•ด์†Œ ํ•„์š”์„ฑ ๋Œ€๋‘. ๋‹จ์ˆœ ์ฑ—๋ด‡์˜ ๋ฒ”์šฉ์  ๋‹ต๋ณ€ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ์ž ํ”„๋กœํ•„ ๊ธฐ๋ฐ˜์˜ Context-Aware Intelligence ๊ตฌํ˜„ ๋ฐ ๋‹ค๊ตญ์–ด ์ง€์› ์ฒด๊ณ„ ๊ตฌ์ถ• ์š”๊ตฌ๋จ.

Technical Solution

  • Google Cloud Run ์ฑ„ํƒ์„ ํ†ตํ•œ Serverless ๊ธฐ๋ฐ˜์˜ ์ธํ”„๋ผ ๊ด€๋ฆฌ ์˜ค๋ฒ„ํ—ค๋“œ ์ œ๊ฑฐ ๋ฐ ์ž๋™ ํ™•์žฅ์„ฑ ํ™•๋ณด
  • Llama 3.3 (70B) ๋ชจ๋ธ๊ณผ Groq API๋ฅผ ๊ฒฐํ•ฉํ•˜์—ฌ ์ €์ง€์—ฐ ๊ณ ์„ฑ๋Šฅ ์ถ”๋ก  ํŒŒ์ดํ”„๋ผ์ธ ๊ตฌ์„ฑ
  • ์‚ฌ์šฉ์ž ์—ฐ๋ น ๋ฐ ํˆฌํ‘œ ๊ฒฝํ—˜์— ๋”ฐ๋ฅธ 7๊ฐ€์ง€ ์ง€๋Šฅํ˜• ๋ชจ๋“œ(Mode-Based Architecture)๋ฅผ ์„ค๊ณ„ํ•˜์—ฌ ์‘๋‹ต ์ •๋ฐ€๋„ ํ–ฅ์ƒ
  • State-machine ๊ธฐ๋ฐ˜์˜ ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๋กœ์ง์„ ํ†ตํ•ด ๊ฐ€์ƒ ํˆฌํ‘œ ๊ฒฝํ—˜์˜ ์ ˆ์ฐจ์  ๋ฌด๊ฒฐ์„ฑ ๋ณด์žฅ
  • Google Translate API๋ฅผ ํ†ตํ•ฉํ•˜์—ฌ 13๊ฐœ ์ด์ƒ์˜ ์ธ๋„ ํ˜„์ง€ ์–ธ์–ด๋กœ ์‹ค์‹œ๊ฐ„ ์‘๋‹ต ๋ณ€ํ™˜ ์ฒด๊ณ„ ๊ตฌ์ถ•
  • Docker์™€ NGINX ๊ธฐ๋ฐ˜์˜ ์ปจํ…Œ์ด๋„ˆ ํŒจํ‚ค์ง•์„ ํ†ตํ•œ ์ผ๊ด€๋œ ๋ฐฐํฌ ํ™˜๊ฒฝ ๋ฐ ์„œ๋น„์Šค ๊ฐ€์šฉ์„ฑ ํ™•๋ณด

์‹ค์ฒœ ํฌ์ธํŠธ

- ๋Œ€๊ทœ๋ชจ ํŠธ๋ž˜ํ”ฝ ๋ณ€๋™์ด ์˜ˆ์ƒ๋˜๋Š” AI ์„œ๋น„์Šค์˜ ๊ฒฝ์šฐ Cloud Run๊ณผ ๊ฐ™์€ Serverless ํ™˜๊ฒฝ ๊ฒ€ํ†  - ๋‹จ์ˆœ LLM ํ˜ธ์ถœ ๋Œ€์‹  State-machine์„ ํ™œ์šฉํ•œ ์‹œ๋‚˜๋ฆฌ์˜ค ๊ธฐ๋ฐ˜ ์›Œํฌํ”Œ๋กœ์šฐ ์„ค๊ณ„ ์ ์šฉ - ๋‹ค๊ตญ์–ด ์„œ๋น„์Šค ์„ค๊ณ„ ์‹œ ๋‹จ์ˆœ ๋ฒˆ์—ญ API๋ฅผ ๋„˜์–ด์„  ๋ฌธํ™”์ /์ง€์—ญ์  Context-aware ํ•„ํ„ฐ๋ง ๋ ˆ์ด์–ด ์ถ”๊ฐ€

ํƒœ๊ทธ

#Context-aware#Serverless#State Machine#LLM#Cloud Run
์›๋ฌธ ์ฝ๊ธฐ