Open-source AI Tools
LM Studio

A desktop application that lets you discover, download, and run large language models completely offline.

Use tool
Use Case
Running and testing open-source LLMs locally on desktop hardware with full data privacy and zero internet connection.
Website Preview
LM Studio website preview

LM Studio is a powerful, user-friendly desktop application designed to let users discover, download, and run open-source Large Language Models (LLMs) completely offline on their local machines. Compatible with Mac, Windows, and Linux, it provides a clean, native interface for interacting with popular models such as Llama, Mistral, and Phi without any internet connection.

The software completely abstracts the technical difficulties of setting up Python environments or managing CUDA configurations. It features an integrated chat interface, a model library explorer connected directly to Hugging Face, and a built-in local HTTP server that mimics the OpenAI API structure, allowing developers to test local models inside their existing codebases easily and securely.

Relevant Sites

SurrealDB

An innovative multi-model database combining document, graph, relational, and vector search features into one platform.
Msty

A feature-rich local AI desktop client designed to streamline interactions with multiple models simultaneously.
Together AI

A lightning-fast cloud platform for building and running open-source AI models.
LocalAI

An open-source, drop-in replacement REST API for OpenAI, running models locally on your own infrastructure.
Hugging Face

The community-driven platform for open-source machine learning models.
vLLM

A high-throughput, memory-efficient serving engine for LLMs using PagedAttention.