WebLLM
LLM-based chatbot in your browser
WebLLM is a project that brings large-language models and LLM-based chatbots to web browsers. Everything runs inside the browser with no server support and is accelerated with WebGPU. This project aims to enable privacy while enjoying GPU acceleration and offers support for client personal AI models.
Category