#tokenization
159 related articles
Tech Frontiers·4 min
ChatGPT Connects to Bank Accounts: OpenAI Partners with Plaid to Access Financial Data — How Big Are the Privacy Risks?
OpenAI announces ChatGPT can connect to bank accounts via Plaid to read balances and transactions. Deep analysis of AI financial assistant use cases, data privacy risks, and industry implications.
Read more →
Deep Dives·3 min
20 Years of Google Translate's Technical Evolution: From Trillion Tokens to TPUs to Gemini
Jeff Dean reflects on Google Translate's 20 years and three tech leaps: 2006's trillion-token language model validating Scaling Law, 2016's Seq2Seq+TPU neural translation, and now Gemini integration.
Read more →
Tutorials·3 min
Building an AI Workstation: A Layered Tool Strategy and Physical Isolation Guide
A practical guide to building an AI workstation: physical isolation with vertical screens, pyramid tool layering (Doubao/Trae/Claude/GPT-4), and real Token cost breakdowns to maximize AI workflow efficiency on a budget.
Read more →
Research·3 min
MEMOIR: Solving AI Agent Memory Management with Git Version Control
MEMOIR is an open-source tool bringing Git version control to AI Agent memory management, with branching, rollback, semantic paths, and visualization to solve context pollution and memory drift.
Read more →
Product Reviews·3 min
How to Choose an AI Agent Framework in 2026? Pros and Cons of Four Leading Solutions
Compare four leading AI Agent frameworks in 2026: Coze, AutoGen, CrewAI, LangChain, and AutoGen Studio — covering coding requirements, private deployment, and commercialization.
Read more →
Deep Dives·4 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into Hugging Face Transformers: the 160K-Star open-source framework covering Pipeline API, Auto Classes, multi-modal models, and the full HF ecosystem for AI inference and training.
Read more →
Product Reviews·2 min
DeepSeek-Reasonix: A Terminal AI Coding Agent Optimized with Prefix Cache Stability
DeepSeek-Reasonix is an open-source terminal AI coding agent natively designed for DeepSeek models, achieving lower latency and API costs through prefix cache stability optimization.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →
Deep Dives·1 min
AI Fundamentals Open-Source Treasure Trove: Comprehensive Coverage from GPU Architecture to AI Agents
Discover AI-fundermentals, an open-source project covering GPU architecture, CUDA programming, LLM fundamentals, and AI Agents in one systematic knowledge base.
Read more →
Deep Dives·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source AI framework powering text, vision, audio, and multimodal models with elegant APIs and massive community support.
Read more →
Product Reviews·3 min
Chinese Pre-trained Model Repository: An Open-Source Project with 5500+ Stars Covering LLMs and Multimodal Models
awesome-pretrained-chinese-nlp-models is a 5500+ Star GitHub project indexing Chinese pre-trained models including BERT, ChatGLM, Qwen, and multimodal models, categorized by task, scale, and domain for efficient model selection.
Read more →
Tutorials·4 min
Hugging Face Transformers: Deep Dive & Practical Guide to the 160K-Star AI Model Framework
Deep dive into Hugging Face Transformers: core features, multi-framework support, 500K+ pretrained models, full-modality task coverage, and hands-on code examples to build AI apps efficiently.
Read more →
Tutorials·3 min
Hugging Face Transformers: The Secret Behind 160K Stars & A Practical Guide
Deep dive into Hugging Face Transformers: the open-source framework with 160K GitHub Stars. Covers full-modality model support, pipeline API, Hub ecosystem, and community mechanisms driving AI democratization.
Read more →
Tutorials·4 min
A Beginner's Guide to Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into the Hugging Face Transformers framework: core features, multimodal support, Pipeline & Trainer APIs, ecosystem integration, and how this 160K-Star library powers modern AI development.
Read more →
Product Reviews·4 min
Hugging Face Transformers: The Technical Architecture and Ecosystem Behind 160K Stars
Deep dive into Hugging Face Transformers: technical architecture, four modality support, Pipeline API usage, and Hub ecosystem integration. Learn how this 160K-Star project became essential for AI developers.
Read more →
Deep Dives·4 min
Hugging Face Transformers Deep Dive: Why This 160K-Star AI Open-Source Framework Has Become the Industry Standard
Deep dive into Hugging Face Transformers: core architecture, full-modality support, inference/training capabilities, and community ecosystem. Learn how this 160K-star project became the industry's AI infrastructure.
Read more →
Tutorials·5 min
The Complete Guide to Ollama: Run DeepSeek and Other LLMs Locally with a Single Command
Ollama is an open-source tool with 170K GitHub Stars that lets you run DeepSeek, Qwen, Kimi-K2.5 and other LLMs locally with one command. Learn about its model ecosystem, advantages, and use cases.
Read more →
Product Reviews·3 min
AgentChat Open Source Project: An AI Agent Platform Integrating MCP, RAG, and LangChain
Deep analysis of AgentChat, an open-source AI agent platform integrating MCP protocol, RAG retrieval-augmented generation, LangChain framework, and Function Call for multi-Agent collaboration and custom workflows.
Read more →
