ํ”ผ๋“œ๋กœ ๋Œ์•„๊ฐ€๊ธฐ
The Oracle and the Wolf: I Made Gemini Lose Like a Kid ๐Ÿบ
Dev.toDev.to
AI/ML

LLM์˜ Hallucination ์ œ์–ด๋ฅผ ์œ„ํ•œ Deterministic Engine ๋ถ„๋ฆฌ ์„ค๊ณ„

The Oracle and the Wolf: I Made Gemini Lose Like a Kid ๐Ÿบ

Ashley Childress2026๋…„ 6์›” 20์ผ20๋ถ„intermediate

Context

LLM ๊ธฐ๋ฐ˜ ๊ฒŒ์ž„ ์„ค๊ณ„ ์‹œ ๋ชจ๋ธ์ด ์ •๋‹ต์„ ๋ฏธ๋ฆฌ ์•Œ๊ณ  ํ”Œ๋ ˆ์ด์–ด๋ฅผ ์••๋„ํ•˜๊ฑฐ๋‚˜ ์ž˜๋ชป๋œ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•˜๋Š” ์ œ์–ด ๋ถˆ๋Šฅ ์ƒํƒœ ๋ฐœ์ƒ. ํŠนํžˆ ์•„๋™์šฉ ์ถ”๋ฆฌ ๊ฒŒ์ž„์—์„œ AI์˜ ์Šน๋ฅ  ์กฐ์ ˆ๊ณผ ์ •๋‹ต ๋ณด์•ˆ ์œ ์ง€๋ผ๋Š” ์ƒ์ถฉํ•˜๋Š” ์š”๊ตฌ์‚ฌํ•ญ ํ•ด๊ฒฐ ํ•„์š”.

Technical Solution

  • State ๊ด€๋ฆฌ์™€ LLM์˜ ์—ญํ• ์„ ์—„๊ฒฉํžˆ ๋ถ„๋ฆฌํ•œ Hybrid Architecture ์„ค๊ณ„
  • ์ •๋‹ต ๋ฐ์ดํ„ฐ ๋ฐ ๊ฒŒ์ž„ ๋ฃฐ์„ LLM์ด ์ ‘๊ทผ ๋ถˆ๊ฐ€๋Šฅํ•œ Deterministic Engine ๋‚ด๋ถ€์— ๊ฒฉ๋ฆฌํ•˜์—ฌ ๋ณด์•ˆ ๊ฐ•ํ™”
  • Gemini๋ฅผ ์ •๋‹ต ํŒ๋‹จ ์ฃผ์ฒด๊ฐ€ ์•„๋‹Œ ์‚ฌ์šฉ์ž์˜ ์ž์—ฐ์–ด ์ž…๋ ฅ์„ ์—”์ง„์ด ์ฒ˜๋ฆฌ ๊ฐ€๋Šฅํ•œ ๊ตฌ์กฐ์  ๋ฐ์ดํ„ฐ๋กœ ๋ณ€ํ™˜ํ•˜๋Š” Oracle ์ธํ„ฐํŽ˜์ด์Šค๋กœ ํ•œ์ • ์‚ฌ์šฉ
  • AI ์ƒ๋Œ€(Skรถll)์˜ ์ถ”๋ก  ๊ณผ์ •์„ JSON ๊ธฐ๋ฐ˜์˜ ๊ตฌ์กฐํ™”๋œ ์ถœ๋ ฅ์œผ๋กœ ๊ฐ•์ œํ•˜์—ฌ ์—”์ง„์˜ ๋ฃฐ ์…‹์— ๋”ฐ๋ฅธ ์ผ๊ด€๋œ ๋™์ž‘ ๋ณด์žฅ
  • ์„œ๋ฒ„ ์‚ฌ์ด๋“œ์—์„œ ์ •๋‹ต์„ ์œ ์ง€ํ•˜๊ณ  ํด๋ผ์ด์–ธํŠธ๋กœ ์ „๋‹ฌํ•˜์ง€ ์•Š๋Š” ๋ฐฉ์‹์œผ๋กœ ์ •๋‹ต ์œ ์ถœ ๊ฐ€๋Šฅ์„ฑ ์›์ฒœ ์ฐจ๋‹จ
  • CI ํŒŒ์ดํ”„๋ผ์ธ ๋‚ด Lighthouse ์ง€ํ‘œ ๊ธฐ๋ฐ˜์˜ ์„ฑ๋Šฅ ๋ฐ Accessibility ๊ฐ•์ œ ๊ฒ€์ฆ ์ฒด๊ณ„ ๊ตฌ์ถ•

Impact

  • Lighthouse Performance 99%, Accessibility 100% ๋‹ฌ์„ฑ
  • ๋‹จ์ผ Branch ๋ˆ„๋ฝ ์‹œ์—๋„ ๋นŒ๋“œ๊ฐ€ ์‹คํŒจํ•˜๋Š” ์ˆ˜์ค€์˜ ๊ณ ๋ฐ€๋„ Test Coverage ํ™•๋ณด

- LLM์— ๋น„์ฆˆ๋‹ˆ์Šค ๋กœ์ง์ด๋‚˜ ํ•ต์‹ฌ ์ƒํƒœ(State)๋ฅผ ์œ„์ž„ํ•˜์ง€ ๋ง๊ณ , ๋ณ€ํ™˜๊ธฐ(Translator) ์—ญํ• ๋กœ ํ•œ์ •ํ•˜์—ฌ ์‹ ๋ขฐ์„ฑ ํ™•๋ณด - AI์˜ ๋‚œ์ด๋„ ์กฐ์ ˆ์ด ํ•„์š”ํ•  ๊ฒฝ์šฐ ๋ชจ๋ธ ํŠœ๋‹๋ณด๋‹ค ์ƒ์œ„ ๋ ˆ๋ฒจ์˜ ๊ฒฐ์ •๋ก ์  ์—”์ง„(Deterministic Engine)์„ ํ†ตํ•œ ์ œ์•ฝ ์กฐ๊ฑด ์„ค์ • ๊ถŒ์žฅ - UI/UX์˜ ์ ‘๊ทผ์„ฑ ๋ฐ ์„ฑ๋Šฅ ์ง€ํ‘œ๋ฅผ CI/CD ๋‹จ๊ณ„์—์„œ ์ž๋™ํ™”ํ•˜์—ฌ ํ’ˆ์งˆ ์ €ํ•˜ ๋ฐฉ์ง€

์›๋ฌธ ์ฝ๊ธฐ