Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
From 300KB to 69KB per Token: How LLM Architectures Solve the KV Cache Problem (future-shock.ai)
157 points by future-shock-ai 5 months ago | past | 10 comments

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: