# Is AnythingLLM private? Kortix, the open-source AI Operating System, layer by layer

> AnythingLLM runs locally by default: its vector database, documents and chat history stay on disk, and a local model keeps inference on the machine. What private means changes by layer. The open-source AI Operating System governs the layers AnythingLLM leaves open, which are who and which agent can reach company data.

URL: https://anythingllm-alternative.com/anythingllm-data-privacy

## What private looks like in the config

A local model on one side, a per-call tool rule on the other.

### AnythingLLM · local model

`LLM Preference`

```
Provider: Ollama · Ollama base URL: http://127.0.0.1:11434
```

### Kortix · tool rule

`kortix.yaml`

```yaml
connectors:
  - slug: billing-api
    provider: openapi
    policies:
      - match: "get_*"
        action: always_run
      - match: "*"
        action: require_approval
```

## What "private" means at each layer

AnythingLLM is an open-source, local-first AI application built by Mintplex Labs. It runs on a desktop or in Docker, and it connects a local or cloud model to your documents. Its default vector database is the built-in LanceDB, which runs on the instance; [the LanceDB docs](https://docs.anythingllm.com/setup/vector-database-configuration/local/lancedb) state that with the default option your document text and embeddings never leave the AnythingLLM application.

## Where AnythingLLM keeps its data

AnythingLLM Desktop keeps its state in one [storage folder](https://docs.anythingllm.com/installation-desktop/storage). Inside it, `lancedb` holds the vector database and its tables, `documents` holds the parsed content of uploaded files, `models` holds local model files, and `anythingllm.db` is the SQLite database. On Linux that folder is `~/.config/anythingllm-desktop/storage/`, and the Docker version keeps the same layout in its mounted storage volume.

## What can leave the machine

AnythingLLM collects anonymous usage telemetry through PostHog, and [its README](https://github.com/Mintplex-Labs/anything-llm) documents how to opt out. Set `DISABLE_TELEMETRY="true"` in the server or Docker `.env`, or turn telemetry off from the in-app Privacy section; the README states that no IP or other identifying information is collected. With telemetry off, an instance still connects out when you use an external model, embedding model or vector database, and it reaches `cdn.anythingllm.com` and GitHub to pull cached model files.

## The layer AnythingLLM does not answer

AnythingLLM's boundary is the machine, and its multi-user controls stop at the workspace. A company also has to answer who inside it may reach which data, and which agent may reach it. In multi-user mode AnythingLLM shares an embedded document with everyone who can open the workspace, and it has no finer-grained permission than the workspace.

Kortix is the open-source AI Operating System, and it governs those layers. It gives per-resource permissions for people and agents, with roles, groups, and an audit trail. Connector credentials are brokered server-side and never enter the machine, so a company keeps its keys outside the run. See the [Kortix docs on connectors](https://kortix.com/docs/connect/connectors).

For a secret that an agent's code should not read, Kortix can egress-enforce it: the sandbox holds a handle, and Kortix substitutes the real value outside the sandbox, only on approved HTTPS hosts. Environment is the default exposure, and egress-enforced is experimental. See the [Kortix secrets docs](https://kortix.com/docs/project/secrets).

Kortix also records what happened. Every action is recorded. Reading, exporting and streaming the audit log depend on the plan.

A company can keep the data inside its own boundary. Kortix runs on Kortix Cloud, in your VPC, or on your own on-prem network, and self-host is free. If you would rather run the document app too, [self-hosting AnythingLLM without Docker](/self-hosting-anythingllm-alternative) covers that, and [the open-source case for AnythingLLM](/open-source-anythingllm-alternative) compares the two self-hosted paths.

## AnythingLLM data privacy, answered

### Does AnythingLLM send my data anywhere?

By default the model, the vector database and the chats stay on your machine, so document text does not leave it. AnythingLLM sends anonymous usage telemetry that you can switch off with `DISABLE_TELEMETRY="true"`. If you choose an external model, embedding provider or vector database, those calls leave the instance.

### Where does AnythingLLM store documents and vectors?

In its storage folder: `lancedb` for vectors, `documents` for parsed file content, `models` for local model files, and `anythingllm.db` for the SQLite database. On Linux the desktop app uses `~/.config/anythingllm-desktop/storage/`.

### Does AnythingLLM stop one team reaching another team's documents?

AnythingLLM grants access at the workspace level. Its docs state that embedding a document makes it available to every person who has access to that workspace, so there is no per-document or per-agent permission finer than the workspace.

### Can a company keep Kortix inside its own network?

Yes. Kortix runs on Kortix Cloud, in your VPC, or on your own on-prem network, and self-host is free. Connector credentials are brokered server-side and never enter the machine, and a secret can be egress-enforced on approved HTTPS hosts.

## Keep the data inside your own boundary

Self-host for free, or run it in your VPC.

[Try Kortix](https://kortix.com) · [The open-source case](https://anythingllm-alternative.com/open-source-anythingllm-alternative)

Open source · Any model, your keys · Self-host, VPC, or on-prem