Keyword:LLM Inference

Publications
NearSEE: Near-Storage Expert Execution for Edge Inference of Mixture-of-Experts LLMs Prapti Panigrahi, Wahid Uz Zaman, Mahmut Kandemir and Vijaykrishnan Narayanan EasyChair Preprint 16034