KV 캐시 6배 압축, Google TurboQuant의 고효율 추론 전략
Google's TurboQuant saves memory, but won't save us from DRAM-pricing hell
Apple Silicon 최적화로 122B MoE 모델을 MacBook에서 구현한 SwiftLM
TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
Google's TurboQuant saves memory, but won't save us from DRAM-pricing hell
TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS