LM Studio
LM Studio is a desktop application for running large language models in local environments. It allows users to download, manage, and run open-source LLMs on personal computers without relying on cloud services. The application provides a graphical user interface to lower the barrier to local deployment and includes a built-in local server compatible with the OpenAI API format, facilitating integration of local models into various applications. It is suitable for individual users and developers who prioritize data privacy or wish to use AI capabilities offline.
Core Facts
The GGUF format was introduced by the llama.cpp project and is optimized for CPU inference scenarios.
GGUF has become the de facto standard format for mainstream local inference tools such as llama.cpp, Ollama, and LM Studio.
Ollama provides a Docker-like one-click model management experience, vLLM achieves high-throughput batch inference via PagedAttention, and LM Studio provides a graphical interface for desktop users.
Timeline (last 90 days)
relnotes is not tied to a specific model service but connects to any OpenAI-compatible endpoint, uses Ollama's qwen2.5:3b model by default, and can switch to LM Studio, llama.cpp or vLLM via a flag.
The GGUF format can be opened in runtimes such as llama.cpp, Ollama, LM Studio, and Jan, forming a single-file local ecosystem.
When a project binding has saved an incorrect token, LM Studio rejects the call with a 401 before the model ever sees the content, and CogniRunner's validator by default fails open and lets it through, causing the request to enter In review via HTTP 204 without being checked.
Local deployment does not equal data never leaving the premises: LM Studio server logs are kept on the Mac and fully store every answer from the model; CogniRunner execution logs store the first 300 characters of fields for each record and retain them for up to 30 days.
In a test on October 14, 2026, an HR request text containing information about a colleague's sick leave after back surgery was rejected by the local model all 8 times it was sent (HTTP 400), while all 8 sends not containing that information passed (HTTP 204), and no two of the 8 rejection reasons given were exactly the same.
In actual testing, the local model's single response took 0.6–0.8 seconds, output 20–37 tokens, at a speed of about 100–110 tok/s; the first rejection took 6.4 seconds due to cold start.
Across three broken-pin scenarios (project bound to Anthropic but with no key, bound to LM Studio but with no token, and with an incorrect token saved), all three requests in total passed without being checked.
CogniRunner's pin feature supports project-level AI provider binding, meaning that within a single Jira Cloud site, one project's AI calls can be directed to a specified provider (such as a local LM Studio), while other projects continue to use the site's default cloud provider.
Locally Uncensored's chat functionality runs local models through a built-in Metal-accelerated server, requiring no pre-installed standalone inference engine, but it can also call Ollama or LM Studio as a backend.
A local model (run via Ollama, LM Studio, etc.) keeps the weight files and inference computation on the local machine, and the note text is read from disk and then enters local memory and VRAM, theoretically without going over the network; a remote model is usually called via API, and the retrieved note fragments are sent to the provider's server as request content.
40 more timeline events
All Facts (20)
The GGUF format was introduced by the llama.cpp project and is optimized for CPU inference scenarios.
90%VerifiedGGUF has become the de facto standard format for mainstream local inference tools such as llama.cpp, Ollama, and LM Studio.
85%VerifiedOllama provides a Docker-like one-click model management experience, vLLM achieves high-throughput batch inference via PagedAttention, and LM Studio provides a graphical interface for desktop users.
80%VerifiedLM Studio is a local model tool with a built-in graphical interface that integrates model search, download, loading, chat, and parameter configuration into a graphical interface
75%VerifiedOllama and LM Studio are derivative tools spawned by the Llama.cpp project.
70%VerifiedLM Studio provides a graphical interface, suitable for users unfamiliar with the command line.
70%VerifiedLocal inference frameworks such as Ollama, LM Studio, vLLM, and LocalAI are all compatible with OpenAI's Chat Completions API interface.
70%VerifiedIn LM Studio, the model must be placed inside a subfolder; otherwise, the GGUF model file cannot be read correctly.
65%VerifiedThe Local Service feature built into LM Studio can enable a standard OpenAI-format API, with a default port of 1234, while also supporting access in Claude Code format.
65%VerifiedThe widespread adoption of local model deployment tools such as Ollama and LM Studio has lowered the barrier to building intelligent workflows.
65%VerifiedLM Studio is developed by Element Labs, supports downloading GGUF models from Hugging Face, and its Developer mode can expose local models as an OpenAI-compatible REST API service (default port 1234).
65%VerifiedOllama's RESTful API Server listens on localhost:11434 by default.
65%VerifiedOllama centers on a command-line tool and manages running local language models through the standardized model format GGUF and a REST API interface; LM Studio provides a graphical interface.
65%VerifiedOllama uses the GGUF format by default; other common quantization formats include GPTQ.
65%VerifiedGroq, Together AI, Mistral, and local deployment solutions such as Ollama and LM Studio all choose to be compatible with OpenAI's API format.
65%VerifiedTools such as Ollama and LM Studio have lowered the barrier to locally deploying open-source models.
65%UnverifiedAlex AI支持接入云端大模型API（如DeepSeek）和本地部署大模型两种方式
95%UnverifiedLM Studio默认API接口地址为http://localhost:1234/v1
90%UnverifiedLM Studio默认在本地的1234端口提供API服务
90%UnverifiedAnythingLLM通过集成Ollama、LM Studio等本地推理后端实现离线AI能力
90%