#LLM inference performance
1618 related articles
Tech Frontiers·3 min
Mistral AI at NVIDIA GTC 2025: New Models, Enterprise AI, and Major Announcements Ahead
Mistral AI confirms GTC 2025 attendance to demo new frontier models, share enterprise AI vision, and unveil major news. Analysis of key highlights and NVIDIA strategic alignment.
Read more →
Tech Frontiers·3 min
Gemma 4 + DGX Spark: How Open-Source LLMs and Desktop-Level Compute Are Changing AI Development
NVIDIA and Google DeepMind jointly showcase Gemma 4's vision translation, long-context Q&A, and real-time code generation on DGX Spark, signaling the convergence of open-source AI and edge compute.
Read more →
Tutorials·3 min
NVIDIA Nemotron Labs Open Source Contribution Guide: A Complete Playbook for Developers Joining AI Open Source Projects
A comprehensive guide to contributing to NVIDIA Nemotron Labs open source projects, covering NeMo framework contributions, community participation, and career benefits for AI developers.
Read more →
Tutorials·3 min
Deploying Gemma 4 on DGX Spark: A Complete Guide to Local AI Supercomputing + Open-Source LLMs
Deep dive into deploying Google Gemma 4 on NVIDIA DGX Spark. Covers hardware architecture, Gemma 4 highlights, local AI deployment benefits, and developer best practices for desktop-class AI supercomputing.
Read more →
Tutorials·3 min
Commercial AI Agent Development Guide: 7 Key Steps to Build from Scratch
A complete guide to building commercial AI Agents in 7 steps: requirements analysis, model selection, prompt engineering, Dify/Coze platform comparison, data storage, testing, and deployment.
Read more →
Tutorials·4 min
AI-Powered Research in Practice: From LLM Selection to Building Automated Workflows with N8N
A deep dive into AI-driven research methodology: LLM selection, Python automation, Zotero reference management, Overleaf writing, local LLM deployment, and N8N workflow automation.
Read more →
Expert Opinions·3 min
Sam Altman in Conversation with Garry Tan: How OpenAI and YC Are Co-Shaping the AI Startup Ecosystem
Sam Altman and YC President Garry Tan discuss the convergence of OpenAI's foundation models and YC's startup ecosystem, revealing key signals about the next phase of AI entrepreneurship.
Read more →
Tech Frontiers·2 min
Amazon Alexa Plus Comes to Amazon.com: How an AI Shopping Assistant Is Reshaping E-Commerce
Amazon integrates LLM-powered Alexa Plus into Amazon.com with Alexa for Shopping. Deep analysis of its strategic significance, technical evolution, and impact on e-commerce.
Read more →
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →
Deep Dives·3 min
The Evolution of LLM Reasoning: A Complete Guide from Chain-of-Thought to DeepSeek-R1
A systematic overview of LLM reasoning evolution, covering Chain-of-Thought, Tree-of-Thought, OpenAI o1, and DeepSeek-R1, with insights from the Awesome-LLM-Reasoning project.
Read more →
Deep Dives·3 min
Deep Dive into Tencent's Open-Source WeKnora: An All-in-One Knowledge Platform with RAG + Agent + Wiki
Deep dive into Tencent's open-source LLM knowledge platform WeKnora, covering RAG, autonomous reasoning Agent, and self-maintaining Wiki capabilities, plus its Go-based architecture and enterprise use cases.
Read more →
Tutorials·4 min
Dify AI Agent Tutorial: Tool Integration & ESA Search Configuration in Practice
Complete guide to building AI Agents on Dify with zero code, covering tool integration, ESA search configuration, time awareness solutions, and Agent design best practices.
Read more →
Tutorials·3 min
4-bit QLoRA Fine-tuning LLaMA 3 in Practice: A Guide to Training 8 Billion Parameter LLMs on Consumer GPUs
Learn how to fine-tune LLaMA 3 8B on consumer GPUs using QLoRA and Unsloth. Covers 4-bit quantization, LoRA adaptation, Alpaca data format, training pipeline setup, and model deployment—runs on RTX 3090.
Read more →
Deep Dives·4 min
AI Guardrails Index: A Comprehensive Guide to the Most Complete LLM Safety Evaluation Framework
Deep dive into the AI Guardrails Index: the most comprehensive LLM safety evaluation framework covering PII protection, jailbreak defense, harmful content filtering, and its open-source design.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Comprehensive Analysis of the 8,200-Star LLM Learning Resource Repository on GitHub
In-depth analysis of the 8,200-star GitHub project awesome-LLM-resources, covering multimodal generation, Agents, model training, MCP protocol, and more — a one-stop LLM learning guide.
Read more →
Tutorials·2 min
Cursor 3.3 Context Usage Analysis: A Complete Guide to Understanding and Optimization
Cursor 3.3 adds Agent context usage analysis, helping developers visualize Rules, MCP, Skills context consumption. Learn how to optimize AI programming efficiency.
Read more →
Tech Frontiers·2 min
Cursor Launches Claude Opus 4 Fast Mode: 2.5x Faster, 6x More Expensive — Is It Worth It?
Cursor launches Claude Opus 4 Fast Mode with 2.5x speed but 6x cost. We analyze use cases, cost tradeoffs, and practical tips to help you decide if it's worth it.
Read more →
Product Reviews·3 min
ChuanhuChatGPT: A Comprehensive Analysis of the 15K-Star Open-Source Multi-Model Chat Interface
Deep dive into ChuanhuChatGPT, a 15K-star open-source project with multi-model access, Agent support, RAG file Q&A, GPT fine-tuning, and web search.
Read more →
Research·3 min
Multi-Agent AI Detects Zero-Day CVE Exploitation: Technical Deep Dive Behind 85% Accuracy
Deep dive into the multi-agent architecture of ai-detects-if-cve-was-zero-day: how GPT-4o, DeepSeek v3, and Llama 3.3 collaborate to detect zero-day CVE exploitation with 85%+ accuracy on 50 validated samples.
Read more →
Tech Frontiers·2 min
DeadEnd-CLI: Open-Source AI Penetration Testing Tool Achieves 81% Pass Rate on Black-Box Benchmark
DeadEnd-CLI is an open-source AI agentic penetration testing tool achieving 81% full black-box pass rate on the XBOW benchmark using KIMI K2.5, with multi-model support and self-hosted deployment.
Read more →