webllm.mlc.ai
WebLLM
LLM-based chatbot in your browser
About WebLLM
WebLLM is a project that brings large-language models and LLM-based chatbots to web browsers. Everything runs inside the browser with no server support and is accelerated with WebGPU. This project aims to enable privacy while enjoying GPU acceleration and offers support for client personal AI models.
No comments yet. Have you tried it?