React LLM: Easily Run Models in the Browser with Headless Components
blog.matt-rickard.com
react-llm is a set of headless React components to run an LLM completely clientside in the browser with WebGPU, starting with useLLM. There’s a live demo running on chat.matt-rickard.com. I put together a quick retro UI that looks like an AOL AIM instant message with a “SmartestChild” to demonstrate how to use the library (it’s made to bring your own UI). It only works on the newest versions of Chrome (>113) on Desktop.
React LLM: Easily Run Models in the Browser with Headless Components
React LLM: Easily Run Models in the Browser…
React LLM: Easily Run Models in the Browser with Headless Components
react-llm is a set of headless React components to run an LLM completely clientside in the browser with WebGPU, starting with useLLM. There’s a live demo running on chat.matt-rickard.com. I put together a quick retro UI that looks like an AOL AIM instant message with a “SmartestChild” to demonstrate how to use the library (it’s made to bring your own UI). It only works on the newest versions of Chrome (>113) on Desktop.