Technology Introduction:
Our team developed MMA, a high-efficiency accelerator optimized for Transformer architecture and LLM inference. Featuring low power consumption and high performance, it is currently the only solution capable of fully running LLMs on edge devices. Compared to Georgia Tech’s MicroScopiQ, Seoul National University’s Tender, and Korea University’s OPAL, our design is the first to fully realize the vision of LLM on Edge, making secure and real-time AI possible.
Industry Applicability:
LLMs like ChatGPT are widely used in daily life. Our chip design enables real-time LLM inference without relying on the cloud or GPUs, reducing energy use and protecting data privacy. Imagine a future where anyone can run an LLM directly on their smartphone, or interact with a compact personal chatbot anytime, anywhere, completely offline and without worrying about data leaks. The solution not only enhances convenience but also resolves concerns around privacy, bringing AI into everyday life.