Your private knowledge agent. Upload documents, ask questions, get cited answers — all running locally on your machine.
Windows 10/11 · 64-bit · Free & open source (MIT)
Persistent chat threads with full message history. Auto-naming, thread switching, and seamless resume across sessions.
Upload PDF, DOCX, and TXT files. Documents are chunked, embedded, and indexed into a local FAISS vector store for instant retrieval.
Pulls context from your documents, Wikipedia, Arxiv, and the web. Toggle each source on or off from the settings panel.
Every piece of information is cited — documents, Wikipedia articles, Arxiv papers, web links, or the model's own knowledge.
Switch between Llama, Qwen, Gemma, Mistral, DeepSeek, Phi, and more. Models download automatically on demand via Ollama.
All LLM inference runs on your machine. No cloud. No telemetry. Your data never leaves your computer.
Retrieved documents are compressed and filtered to extract only the content relevant to your query, improving answer quality and reducing noise.
Follow-up questions with pronouns or references are automatically rewritten into standalone queries using conversation history for more accurate retrieval.
All enabled retrieval sources are queried simultaneously, reducing total retrieval time to the speed of the slowest source instead of the sum of all sources.
Embedding-based similarity deduplication removes near-duplicate results both within a single query and across conversation turns.
Run the installer — it sets up Ollama, Python, and all dependencies automatically. No command line needed.
Open from the Start Menu or Desktop shortcut. The app opens in your browser. On first launch, the default LLM model downloads automatically.
Start a conversation, upload your documents, and get answers with full source citations. Configure retrieval sources and API keys from the Settings panel.
Thoth runs entirely on your machine. Your documents, conversations, and API keys are stored locally and never sent to any cloud service. External calls are only made to the retrieval sources you explicitly enable.
Free, open source, and yours to keep.