#LLM
68 related articles
Industry Insights·2 min
AI Product Development in Practice: Model Selection, Building Moats, and Paths to Commercialization
Practical strategies for AI product development: why not to train models from scratch, when to use APIs vs. fine-tuning, building product moats, and the full path from evaluation systems to commercialization.
Read more →
Product Reviews·3 min
One API: A Complete Guide to the Open-Source API Gateway for Unified Management of 30+ LLMs
One API is an open-source LLM API gateway with 32K+ GitHub Stars, supporting unified access to 30+ models including OpenAI, Claude, and DeepSeek. Complete guide covering Docker deployment, Key management, and load balancing.
Read more →
Product Reviews·3 min
One API: A Complete Guide to the Open-Source Gateway System for Unified Management of 30+ LLMs
One API is an open-source LLM API gateway with 32K GitHub stars, supporting unified management of 30+ models including OpenAI, Claude, and DeepSeek via OpenAI-compatible format.
Read more →
Product Reviews·1 min
One API: Deployment Tutorial & Deep Dive into the Open-Source API Gateway for Managing 30+ LLMs
One API is an open-source LLM API gateway with 32K+ GitHub Stars that unifies 30+ models (OpenAI, Claude, DeepSeek, Qwen) into OpenAI-compatible format. Learn its core features, Docker deployment, and key management.
Read more →
Product Reviews·1 min
iOrchestra: From Text to Production-Ready Hardware Design with AI Agents
iOrchestra is an AI hardware engineer platform that uses multi-disciplinary AI agents to compress PCB, mechanical, and thermal design from months to minutes, covering the full pipeline from natural language input to simulation, BOM generation, and manufacturing.
Read more →
Tech Frontiers·2 min
Datasette Agent: An Open-Source AI Assistant for Querying Databases with Natural Language
Simon Willison releases Datasette Agent, combining LLM with Datasette to enable natural language database queries, plugin extensions, and local model support for personal data analysis.
Read more →
Tutorials·2 min
Docker Model Runner Tutorial: Run AI Models Locally with a Single Command
Learn how to install, configure, and use Docker Model Runner to run AI models locally with Docker Compose integration, OpenAI API compatibility, and zero-config LLM deployment.
Read more →
Deep Dives·2 min
How Fast Is 10 Tokens Per Second from an LLM? An Open-Source Tool for Visualizing Token Generation Speed
An open-source tool lets you visualize LLM token generation speeds from 5-800 TPS, helping developers make rational choices about model selection and inference optimization.
Read more →
Product Reviews·2 min
MCP Trends Hub: A Deep Dive into the MCP Protocol-Based Trending Topics Aggregation Tool
Deep dive into the open-source MCP Trends Hub project: how it aggregates trending topics from Weibo, Zhihu, Douyin and more via MCP protocol, and the core value of MCP in AI real-time data access.
Read more →
Deep Dives·1 min
Beginner's Guide to AI Agents: Core Principles, Technical Architecture, and Application Scenarios Explained
A systematic guide to AI Agents covering core principles of perception, decision-making, and action, plus the technical stack of LLMs, tool calling, memory systems, and RAG, with real-world use cases.
Read more →
Expert Opinions·1 min
Six Months of Massive LLM Changes: The Rise of Coding Agents, OpenClaw Explosion, and Local Models Fighting Back
Simon Willison reviews six months of LLM changes at PyCon US 2026: coding agents crossing quality thresholds in Nov 2025, OpenClaw sparking personal AI assistants, and open-source models rivaling frontier models on laptops.
Read more →
Product Reviews·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources covering multimodal generation, AI Agents, MCP protocol, model training/inference, o1 models, and SLMs—a community-verified 8200+ Star LLM learning resource hub.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the awesome-LLM-resources project (8200+ GitHub Stars), covering multimodal AI, Agents, MCP protocol, model training, o1 reasoning, SLMs, and more for LLM practitioners.
Read more →
Deep Dives·2 min
LLM 0.32 Refactor: An Architecture Upgrade from Text Q&A to Multimodal Streaming Interaction
Simon Willison releases LLM 0.32a0 alpha with a major refactor introducing message sequence API, typed streaming output, and flexible serialization while maintaining backward compatibility.
Read more →
Research·3 min
AI Agents vs. Humans in First Wet-Lab Showdown: No Significant Difference in Protein Binder Design Hit Rates
First wet-lab comparison: 6 LLM Agents vs 9 human teams in TREM-2 Binder design show no significant Hit Rate difference (P=0.83). Analysis of tool convergence, in-silico bottlenecks, and designer transformation.
Read more →
Tutorials·3 min
AI Agent Prompt Engineering: A Practical Guide to the Three-Layer Architecture
A practical guide to AI Agent prompt engineering using a three-layer architecture: System Layer, Input Layer, and Action Layer — with n8n examples.
Read more →
Deep Dives·3 min
Two Root Causes of Agent Context Rot: Distraction vs. Poisoning Explained
AI Agent getting dumber over time? Context Rot has two root causes: Distraction (attention dilution) and Poisoning (causal chain contamination). Learn symptoms, mechanisms, and remediation strategies.
Read more →
Expert Opinions·2 min
AI Coding Agents End Programming Language Lock-In: Code Migration Enters the Reversible Era
AI coding agents are reshaping the economics of software rewrites. Real migration cases reveal how language lock-in is breaking down, turning tech choices into reversible decisions.
Read more →
Tutorials·2 min
Dify Java Client: Best Practices for Integrating AI into Java Projects
dify-java-client is an open-source Java client library for integrating Dify's generative AI capabilities. It supports chat, text generation, workflows, and knowledge base APIs with streaming responses and type-safe wrappers for enterprise scenarios.
Read more →
Research·3 min
MEMOIR: Solving AI Agent Memory Management with Git Version Control
MEMOIR is an open-source tool bringing Git version control to AI Agent memory management, with branching, rollback, semantic paths, and visualization to solve context pollution and memory drift.
Read more →