AnythingLLM

AnythingLLM is an application for chatting with documents and automating complex workflows with AI Agents.

Verified

Core facts

Read by a script from the official API, not rewritten by a model.

License
MIT
Languages
JavaScript
Maintainer
Mintplex-Labs
Verified

What it is

AnythingLLM is an application for chatting with documents and automating complex workflows with AI Agents. AnythingLLM by Mintplex Labs Inc contains a telemetry feature that collects anonymous usage information. The monorepo consists of six main sections. This project is MIT licensed.

Main features

  1. The built-in local LLM engine, powered by Lemonade and llama.cpp, runs local models on a CPU or GPU (NVIDIA via CUDA, AMD and Intel via Vulkan).

  2. Scheduled Tasks run recurring tasks or prompts on a cron schedule with full agent capabilities.

  3. Automatic & User Managed Memories let the LLM remember important information about the user or the workspace.

  4. MCP-compatibility is listed among the features.

  5. A no-code AI Agent builder is listed among the features.

Getting started

  1. AnythingLLM is available for desktop on Mac, Windows, and Linux.

  2. For development, a setup script run from the root of the repo fills in the required env files for each application section.

  3. A server development script run from the root of the repo boots the server locally.

  4. A frontend development script run from the root of the repo boots the frontend locally.

  5. A collector development script run from the root of the repo runs the document collector.

  6. AnythingLLM Mobile (Android) is open source.

Who it is for

Multi-user instance support and permissioning are Docker version only. The custom embeddable chat widget for a website is Docker version only. Agents inside the workspace can, for example, browse the web.

AnythingLLM supports multiple document types, such as PDF, TXT, and DOCX. AnythingLLM provides a chat UI with drag-and-drop uploads and source citations. Generic OpenAI-compatible embedding APIs are listed among the embedder models.

Among the embedder models, AnythingLLM Native Embedder is marked as default. Among the vector databases, LanceDB is marked as default. The collector section is a NodeJS express server that processes and parses documents from the UI.

The docker section holds Docker instructions, the build process, and information for building from source. The embed section is a submodule for generation and creation of the web embed widget. The browser-extension section is a submodule for the chrome browser extension.

Setting the telemetry-disable variable to true in the server or docker env settings opts out of telemetry. Telemetry can also be disabled in-app through the Privacy item in the sidebar. The project states that no IP or other identifying information is collected by telemetry.

The telemetry provider is PostHog, an open-source telemetry collection service. The project states that the anonymous data is never shared with third parties. AnythingLLM Browser Extension is a browser extension that allows using AnythingLLM in the browser.

AnythingLLM Embed is a widget that allows embedding AnythingLLM in a website.

Sources

This page is written from the official sources below. Open them to check the original text.

Verified ·

This page is written by AI from the official sources above and checked automatically. This site has not tested it. Found a mistake? Tell us.