#Transformer
1445 related articles
·2 min
Transformer²: Achieving Co-Design of Robot Morphology and Control with a Unified Architecture
Deep dive into how Transformer² uses a unified Transformer architecture to integrate robot morphology design and motion control into one model, enabling task-driven end-to-end co-design for embodied AI.
Read more →
·3 min
AI Research Automation: More Like Data Cleaning Than Inventing the Transformer
Why AI research automation looks more like data cleaning than inventing the Transformer. Exploring the value of automating 60%-80% of repetitive research work and how human-AI collaboration reshapes the research paradigm.
Read more →
·3 min
AI Research Automation: More Like Data Cleaning Than Inventing the Transformer
AI research automation will look more like data cleaning than inventing the Transformer. Explore how automating 60%-80% of repetitive research work reshapes the AI research paradigm.
Read more →
·2 min
Deterministic Attention Transformer: H100 Benchmark Achieves Just 0.63 Joules Per Token
Researchers propose the Deterministic Attention-Transformer, measuring just 0.63 J/token on NVIDIA H100 GPUs. Explore the tech behind it and its green AI implications.
Read more →
·4 min
Understanding Transformer From the Ground Up: How Language Models Predict the Next Word
From Tokenization and Embedding to the Attention mechanism, this article systematically breaks down how Transformer works — and how ChatGPT turns input text into next-token probabilities.
Read more →
·3 min
Building a Transformer from Scratch: A PyTorch Hands-On Guide for Self-Taught Developers
A self-taught developer with 2 years of Python experience implements Transformer from scratch using plain PyTorch, following the original 'Attention Is All You Need' paper with a two-phase approach: inference first, then full training.
Read more →
·3 min
Why Do Transformer Learning Paths Always Start Too Late? Order Matters More Than Materials
Most Transformer learning paths jump straight into Attention Is All You Need, skipping the pain points of sequence models—leaving learners reciting terms without real intuition. Here's a better four-stage order.
Read more →
·3 min
Why Transformer Dominates AI Foundation Models: A Deep Dive into Its Three Core Advantages
Why do ChatGPT and Gemini both use Transformer? This deep dive explains how self-attention solves RNN's serial inefficiency and CNN's local limitations across three key dimensions.
Read more →
·5 min
From CNN to Transformer: How AI Evolved to Understand Human Language
From CNN and RNN to Transformer, a complete breakdown of the core evolution of AI natural language processing. Understand attention, BERT vs. GPT, and the architecture behind large models.
Read more →
·2 min
Training Just One Transformer Layer Can Match Full-Parameter RL Training?
A controversial study shows training just one Transformer layer can match full-parameter RL training. We analyze the technical principles, engineering value, and limitations of this approach.
Read more →
·3 min
AI Large Language Models Explained: Transformer Architecture & Practical Testing Guide
Deep dive into AI large model principles, from Transformer architecture to probabilistic inference, with practical guidance on LLM applications in testing and AI testing strategies.
Read more →
Deep Dives·1 min
Demystifying Transformer: A Word-Continuation Function, Deconstructed
Understand Transformer through the lens of word continuation. Breaking down language generation into Embedding, Transformer Block, and Probability output modules for intuitive understanding.
Read more →
Deep Dives·4 min
Core Principles of the Transformer Architecture: A Deep Dive into Self-Attention Mechanisms and Engineering Optimizations
Deep dive into Transformer architecture covering self-attention QKV mechanics, Encoder-Decoder structure, Flash Attention memory optimization, RoPE positional encoding, and GQA inference acceleration.
Read more →
Tech Frontiers·2 min
Amazon AI Phone Rumors: Panos Panay Gives Ambiguous Response as Project Transformer Surfaces
Amazon's Panos Panay gives ambiguous response on phone rumors as Project Transformer, an Alexa AI phone, emerges. A look at Amazon's path from Fire Phone failure to potential AI smartphone comeback.
Read more →
Tutorials·1 min
HuggingFace Transformers Beginner's Guide: Model Download, Pipeline Inference, Training & Saving
Learn HuggingFace Transformers core usage: pretrained model download, Pipeline API for sentiment analysis, Tokenizer principles, model inference with Softmax, and saving workflows with Python examples.
Read more →
Deep Dives·1 min
Hugging Face Transformers Deep Dive: What Makes This 160K-Star AI Framework So Powerful
A deep dive into Hugging Face Transformers: the 160K-star open-source AI framework supporting text, vision, audio, and multimodal models for inference and training.
Read more →
·2 min
Claude Opus 5 Released: Performance Leap at Half the Price, the New Foundation for AI Agents
Anthropic releases Claude Opus 5 flagship model, delivering near-top-tier intelligence at half the price, focused on long-running Agents, coding, and professional work scenarios.
Read more →
·2 min
RecipeBook: A New Paradigm for Buying AI Video Training Data by the Hour
RecipeBook is a video data marketplace with 25M+ clips, offering semantic search and preference learning, letting developers buy AI training data at $3/hour in a self-service, pay-as-you-go model.
Read more →
·2 min
RecipeBook: A New Paradigm for Buying AI Video Training Data by the Hour
RecipeBook is a video data marketplace with 25M+ clips, featuring semantic search and preference learning, letting developers buy AI training data at $3/hour in a self-service, pay-as-you-go experience.
Read more →
·3 min
Gemini's Identity Crisis: Understanding AI Self-Recognition Hallucinations and Identity Confusion
Google Gemini exhibits identity confusion, claiming to be other AI models. Deep dive into why LLMs get their identity wrong, how training data contamination causes AI hallucinations, and what this means for AI product trustworthiness.
Read more →