Open-source AI Tools
LM Studio

A desktop application that lets you discover, download, and run large language models completely offline.

Use tool
Use Case
Running and testing open-source LLMs locally on desktop hardware with full data privacy and zero internet connection.
Website Preview
LM Studio website preview

LM Studio is a powerful, user-friendly desktop application designed to let users discover, download, and run open-source Large Language Models (LLMs) completely offline on their local machines. Compatible with Mac, Windows, and Linux, it provides a clean, native interface for interacting with popular models such as Llama, Mistral, and Phi without any internet connection.

The software completely abstracts the technical difficulties of setting up Python environments or managing CUDA configurations. It features an integrated chat interface, a model library explorer connected directly to Hugging Face, and a built-in local HTTP server that mimics the OpenAI API structure, allowing developers to test local models inside their existing codebases easily and securely.

Relevant Sites

Together AI

A lightning-fast cloud platform for building and running open-source AI models.
LanceDB

An open-source, serverless vector database designed for AI applications, utilizing the advanced Lance data format.
Weaviate

An open-source vector database that combines vector search with structured database capabilities for AI applications.
ModelScope

The leading Chinese open-source Model-as-a-Service platform by Alibaba Group.
DeepSeek

An advanced AI research company providing high-performance open-source coding and chat models.
GPT4All

An open-source ecosystem for running privacy-first large language models locally on consumer-grade hardware.