#LLM framework
2444 related articles
·2 min
LLM Agent Long-Term Memory Security: A Six-Stage Attack Surface and Defense Framework
Deep analysis of LLM agent long-term memory security threats, covering persistence, statefulness, and propagation of memory poisoning, with a six-stage lifecycle defense framework.
Read more →
The Guardian Angels Framework: How LLM…
·3 min
The Guardian Angels Framework: How LLM Personalization Can Achieve Both Efficiency and Data Security
The Guardian Angels framework shows how LLM personalization can achieve both productivity and data security through local deployment, differential privacy, and tiered permissions.
Read more →
·2 min
vLLM Inference Framework Deep Dive: A Practical Guide to High-Concurrency DeepSeek Deployment
A deep dive into vLLM's five core features — KV cache management, continuous batching, and distributed inference — plus a full setup guide for deploying DeepSeek on a cloud server.
Read more →
·3 min
Getting Started with LangChain: The Core Framework for LLM Application Development and Its Three Key Components
LangChain is the leading open-source framework for LLM application development, supporting GPT-4, GLM, and other mainstream models. This article dives into its three core concepts: Components, Chains, and Agents.
Read more →
·6 min
A Deep Dive into the vLLM Inference Framework: Core Principles of Throughput Optimization and Interview Guide
An in-depth analysis of the vLLM inference framework's core principles: from the meaning of throughput (tokens/s), to the bottlenecks of autoregressive generation, to KV Cache, PagedAttention, and continuous batching.
Read more →
·2 min
Spring AI Alibaba: The Core Framework for Integrating LLMs into Java Applications
Spring AI Alibaba is an enterprise-grade Java AI framework that bridges microservices and LLMs — like JDBC for databases — enabling seamless AI integration with minimal migration cost.
Read more →
·7 min
Getting Started with LangChain: The Core Framework Connecting LLMs and AI Applications
A deep dive into LangChain's positioning and value—why do LLMs need a middle layer? How does LangChain serve as the 'glue' unifying multi-model interfaces and supporting Agent development? Learn its core modules and learning path.
Read more →
·3 min
OpenLLMVTuber: A Deep Dive into the Open-Source AI Virtual Character Framework
Deep dive into OpenLLMVTuber, a 10K-star open-source AI virtual character framework integrating ASR, LLM, TTS, and Live2D with voice interruption, visual perception, and modular architecture.
Read more →
·2 min
LlamaFactory: A Comprehensive Guide to the Open-Source Framework for Unified Fine-Tuning of 100+ LLMs
Deep dive into LlamaFactory, an open-source unified fine-tuning framework supporting 100+ LLMs and VLMs with LoRA, QLoRA, RLHF methods, Web UI, 71K+ GitHub Stars, accepted at ACL 2024.
Read more →
Tutorials·3 min
Getting Started with Spring AI Alibaba: The Go-To Framework for Java Developers Integrating LLMs
A deep dive into Spring AI Alibaba's core positioning and advantages, helping Java developers quickly understand how to integrate LLMs through this framework.
Read more →
·4 min
Project Rai-chan Technical Breakdown: A Complete Guide to Building a Fully Local AI Companion
Deep dive into Project Rai-chan's tech stack: Ollama+Gemma local LLM, Unity rendering, VOICEVOX speech synthesis, and more — exploring the technical path for local AI companions.
Read more →
·2 min
Agenta: A Detailed Look at the Open-Source Self-Hosted Claude Cowork Alternative
Agenta is an open-source AI Agent collaboration platform supporting self-hosted models and any Agent framework, positioned as an open-source Claude Cowork alternative.
Read more →
·4 min
A Guide to Full-Stack Machine Learning Project Repository Structure: From Chaos to Convention
A detailed guide to organizing full-stack ML project repositories, covering directory structure design, data-code separation, and externalized configuration to help ML developers move from experimental code to production-grade engineering standards.
Read more →
·4 min
Full-Stack Machine Learning Project Repository Structure Guide: From Chaos to Convention
A detailed guide to organizing full-stack ML project repositories, covering directory structure design, data-code separation, and configuration externalization to help ML developers move from experimental code to production-grade engineering.
Read more →
·3 min
Truth Has No Direction: How the Tarski Paradox Challenges LLM Truth Probe Techniques
How a Tarski-style attack challenges LLM truth probes from the foundations of logic. Is the linear representation hypothesis valid, or is the "truth direction" in AI activations just a statistical illusion?
Read more →
·2 min
Claude Mythos Cryptographic Algorithm Cracking Incident: The Reality and Boundaries of AI Cryptanalysis
Anthropic's Claude Mythos Preview model reportedly discovered improved cryptographic attack methods. This article analyzes the realistic boundaries of AI cryptanalysis capabilities and implications.
Read more →
·2 min
Claude Mythos Codebreaking Incident Explained: The Reality and Limits of AI Cryptanalysis
Anthropic's Claude Mythos Preview model reportedly discovered improved cryptographic attack methods. This article analyzes the real capability boundaries of AI cryptanalysis and its implications.
Read more →
·3 min
Gemini Managed Agents API Update: Environment Hooks and Free Tier Fully Explained
Google Gemini Managed Agents API introduces environment hooks, model selection, free tier support, and default model upgrades—empowering AI Agent developers with stronger execution control and lower barriers to entry.
Read more →
·3 min
New Gemini Jailbreak Method: Deep Analysis of the Observer and Accomplice Technique
Deep analysis of a Gemini jailbreak technique—the Observer and Accomplice method—examining how it exploits contextual manipulation and reasoning chain inconsistencies to bypass AI safety alignment.
Read more →
·2 min
OpenAI Open-Sources Codex Security Components: Setting a New Standard for AI Coding Safety
OpenAI open-sources Codex Security components, bringing automated security detection to AI code generation. Analysis of its strategic value, developer impact, and the industry shift from capability to security.
Read more →