Open-source AI Tools
Jan

An open-source, privacy-first desktop alternative to ChatGPT that runs fully offline on your computer.

Use tool
Use Case
Using a highly polished, offline desktop chat interface to replace commercial cloud-based AI subscription platforms.
Website Preview
Jan website preview

Jan is an open-source, cross-platform desktop application designed as a 100% offline, privacy-first alternative to ChatGPT. It enables users to download and run open-source models directly on consumer laptops and desktops, ensuring that all data, chats, and configurations remain safely stored on the user's local hard drive.

Jan is built with an elegant, modern user interface that emphasizes clean user experience and accessibility. It includes an integrated extension system, an advanced model downloader, and hardware-accelerated engines for maximum performance. Jan also features a built-in local server that exposes an OpenAI-compatible API, allowing developers to utilize local AI models seamlessly within their local workflows and external software integrations.

Relevant Sites

AnythingLLM

An all-in-one desktop and enterprise application for building private RAG systems with any LLM.
Replicate

Run and deploy open-source machine learning models with a simple cloud API.
Ollama

Get up and running with large language models locally on macOS, Linux, and Windows.
Hugging Face

The community-driven platform for open-source machine learning models.
ModelScope

The leading Chinese open-source Model-as-a-Service platform by Alibaba Group.
vLLM

A high-throughput, memory-efficient serving engine for LLMs using PagedAttention.