#Transformer implementation
893 related articles
Tech Frontiers·2 min
DeepSeek-V3.2-Exp Discovers RoPE Implementation Bug: Interleaved Format Mismatch Causes Inference Performance Degradation
A RoPE interleaved format mismatch bug was found in DeepSeek-V3.2-Exp's inference demo, causing silent performance degradation. Learn the root cause, technical details, and fix.
Read more →
Tech Frontiers·3 min
Karpathy Open-Sources autoresearch: A Deep Dive into the AI-Powered Automated Research Tool with 80K Stars
Andrej Karpathy open-sources autoresearch, an AI Agent tool that automates nanochat training experiments on a single GPU. With 80K+ GitHub Stars, we break down its architecture and impact.
Read more →
Tutorials·3 min
awesome-llm-apps: A 100K-Star GitHub Project with 100+ AI Agent & RAG Applications
awesome-llm-apps is a 100K+ Star GitHub project featuring 100+ ready-to-run AI Agent and RAG apps. Built in Python with clone-and-run simplicity, it's an essential resource for LLM developers.
Read more →
Product Reviews·3 min
MaxKB Open-Source Agent Platform: A Deep Dive into the 20K-Star Enterprise Knowledge Base RAG Solution
Deep dive into MaxKB, an open-source enterprise agent platform with 20K+ GitHub Stars. Explore its RAG capabilities, multi-model integration, visual orchestration, and comparison with Dify and FastGPT.
Read more →
Expert Opinions·3 min
Reinventing the Wheel: Why Building From Scratch Is the Shortcut to the Technical Frontier
Developer Andrew Quinn compressed a 3GB SQLite database into a 7MB FST file, sharing a profound insight: reinventing four or five wheels by hand beats passive study at pushing you to the technical frontier.
Read more →
Product Reviews·3 min
Deep Dive into AGGO Framework: A New Go-Based Choice for Enterprise AI Agents
Deep dive into AGGO—an enterprise AI Agent framework built with Go and CloudWeGo Eino, covering conversational AI, RAG, memory systems, and tool calling, with Go's performance advantages.
Read more →
Product Reviews·2 min
Lingque AI Agent Framework: A Self-Controlled Solution for Private Deployment
Lingque is a Python-based open-source AI Agent framework supporting fully private deployment with data sovereignty. This article analyzes its technical features, use cases, and advantages over LangChain.
Read more →
Tutorials·4 min
A Practical Guide to Context Engineering: The Path from Prompt Engineering to Production-Grade AI Systems
A deep dive into Context Engineering: core concepts and key techniques including RAG, long-context management, and AI Agent context orchestration for building production-grade AI systems.
Read more →
Tutorials·3 min
Pixelle-Video Open Source Tutorial: Deep Dive into the AI Fully Automated Short Video Engine with 14K Stars
Deep dive into Pixelle-Video, a trending open-source AI short video engine with 14K+ GitHub Stars. Explore its end-to-end automation, architecture, use cases, and how to get started.
Read more →
Deep Dives·3 min
Why WebRTC Is a Poor Fit for AI Voice: The Fatal Flaw of Latency-First Design
Analysis of WebRTC's design flaws for AI voice: its packet-dropping strategy corrupts user prompts and degrades LLM responses. Exploring how MoQ better balances data integrity with low latency.
Read more →
Deep Dives·2 min
Open-Source Video-to-Text Tool: Dual-Mode Approach with Subtitle Extraction + Gemini AI Transcription
Open-source project claude-skill-video-transcribe supports YouTube, Bilibili, and local video-to-text conversion using a dual strategy: subtitle extraction first, Gemini 2.5 Flash AI transcription as fallback.
Read more →
Tech Frontiers·2 min
Gemini 2.5 Flash AI Image Generation Open-Source Project: A Next.js Solution with 800 Stars
Deep dive into gemini-nanobanana-pro, a trending GitHub project using Gemini 2.5 Flash to build AI image generation and editing with Next.js + TypeScript.
Read more →
Tech Frontiers·3 min
Kimi-K2.5 Goes Open Source: Moonshot AI's Most Powerful Model Arrives, GitHub Stars Soaring
Moonshot AI open-sources its flagship model Kimi-K2.5, with GitHub stars surpassing 1,900. Learn about its strategic significance, MoE architecture, competition with DeepSeek and Qwen, and how developers can get started.
Read more →
Tutorials·2 min
Unsloth Tutorial: Fine-Tune LLMs Locally with 5x Speed and Massive VRAM Savings
Learn how Unsloth uses LoRA optimization and Web UI to efficiently fine-tune Gemma 4, Qwen3, DeepSeek and more on consumer GPUs, with 2-5x speed gains and 50-70% VRAM reduction.
Read more →
Tutorials·3 min
Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings
Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →
Research·3 min
UK AISI Assessment Report: GPT-5.5 Cybersecurity Capabilities on Par with Claude Mythos
UK AISI releases GPT-5.5 cybersecurity assessment showing vulnerability discovery capabilities on par with Claude Mythos, but with GPT-5.5 already publicly available, raising new AI safety governance concerns.
Read more →
Tech Frontiers·3 min
Osaurus: A Native macOS Offline AI Agent Framework — 5,000+ Star Open Source Project Deep Dive
Deep dive into Osaurus — a native macOS AI agent framework supporting fully offline operation, persistent memory, cryptographic identity, and arbitrary model integration. Built with Swift and C for Apple Silicon. 5,100+ GitHub stars.
Read more →
Tutorials·2 min
Save to Spotify: The Complete Guide to Publishing AI-Generated Podcasts on Spotify with One Click
Save to Spotify is a CLI tool for AI agents like OpenClaw, Claude Code, and OpenAI Codex to publish AI-generated audio directly to Spotify. Full guide on setup, use cases, and podcast ecosystem impact.
Read more →