#LLM from scratch
1189 related articles
·3 min
Training a 1.3B Parameter LLM from Scratch: Complete Workflow and Core Challenges
A deep dive into the complete workflow of training a 1.3B parameter LLM from scratch, covering Transformer architecture design, data preparation, and distributed training optimization.
Read more →
·3 min
Training a 100M-Parameter Model for Under $50: A Complete Record of Building SmoLLM from Scratch
An ML engineer trained SmoLLM, a 109M-parameter LLaMA-style model from scratch for under $50. Full breakdown of architecture, training pitfalls, instruction tuning, and real-world performance.
Read more →
Tutorials·3 min
Getting Started with LLM Application Development from Scratch: A Complete Guide to Learning Paths and Career Directions
A complete beginner's guide to LLM application development: learn the three key directions (API calling, RAG, Agent), master frameworks like LangChain, and follow a step-by-step learning path to become an AI application developer.
Read more →
Tutorials·3 min
Learning LLM Application Development from Scratch: A Complete Roadmap from RAG to Agent
How to start LLM application development from scratch? A complete roadmap covering Python basics, RAG knowledge bases, and Agent development with LangChain.
Read more →
Tutorials·3 min
MiniMind-V: A Complete Tutorial to Train a 65M Parameter Vision Multimodal LLM from Scratch in 2 Hours
MiniMind-V is a lightweight open-source VLM project that trains a 65M parameter vision multimodal model from scratch in just 2 hours. Learn its architecture, training pipeline, and educational value.
Read more →
·4 min
Tau Open-Source Coding Framework Explained: A Python Port of Pi
Deep dive into the Tau open-source coding framework: tree-based session management, JSONL persistence, skills system, and custom prompts. Learn how this Python port of Pi delivers a new AI coding agent experience.
Read more →
·4 min
Needle2: How a 14MB On-Device Agentic LLM Could Transform Edge AI
Needle2 is a 14MB on-device agentic LLM designed for phones, wearables, smart homes, and robots. This article analyzes its compression techniques, architecture, and the cloud-to-edge AI paradigm shift.
Read more →
·2 min
quick-sandbox: A Lightweight Code Sandbox for Safe Execution in the AI Programming Era
quick-sandbox is a lightweight code sandbox tool for AI programming scenarios, offering sub-second startup and isolated execution for AI Agents and untrusted code.
Read more →
·3 min
Full-Stack LangChain Application Development: Architecture Selection and Practical Guide
A detailed guide on full-stack LangChain architecture design, covering FastAPI backend setup, streaming responses, React frontend integration, and practical tool selection with LangServe and LangGraph.
Read more →
·3 min
Zuckerberg's 'Personal Superintelligence' Vision: Early User Experiences and the Trust Dilemma
Zuckerberg proposes 24/7 personal superintelligence for billions. Reddit early adopters share real experiences building personalized AI systems, revealing both transformative potential and persistent challenges around hallucination, usability, and trust.
Read more →
·1 min
Brandfetch MCP: Giving AI Accurate Access to Brand Logos, Colors, and Assets
Brandfetch MCP provides AI Agents with 50M+ brands' logos, colors, and fonts via MCP protocol, solving the problem of AI fabricating brand assets in design work.
Read more →
·1 min
Implant: Letting AI Coding Assistants Directly Call VS Code APIs
Implant is an open-source VS Code extension that exposes editor LSP APIs to AI coding agents, enabling precise symbol navigation, safe renames, and diagnostics reading.
Read more →
·3 min
Ticketdesk AI: Reinventing Customer Support Ticket Handling with AI Agents
Deep analysis of how Ticketdesk AI uses AI agents and automated email responses to enable 24/7 customer support ticket handling, with insights on its features, competitive landscape, and use cases.
Read more →
·2 min
Mailüfterl: The Birth and Legend of Europe's First Transistor Computer
Mailüfterl was one of the earliest transistor computers on the European continent, built at Vienna University of Technology. This article details its technical features, development history, and Heinz Zemanek's contributions.
Read more →
·3 min
The Hacker Renaissance: How AI Is Reshaping Individual Developer Creativity
AI coding tools are sparking a Hacker Renaissance, unleashing individual developer creativity like never before. Explore the rise of one-person companies, skill reshuffling, and new challenges.
Read more →
·3 min
A Data Analyst's Existential Crisis After Deep AI Integration: Am I Downgrading Myself?
A senior data analyst faces skill atrophy, shrinking career space, and automation anxiety after deep AI integration. Analysis of how AI's shift from Copilot to Agent impacts data roles.
Read more →
·3 min
AI Faking Creativity: When Every Office's Ideas Start Looking the Same
Does AI truly have creativity? As enterprises adopt AI office tools, marketing copy collisions and proposal similarities are increasing. This article analyzes the limits of LLM creativity and how to avoid the homogenization trap.
Read more →
·3 min
ScrapeOps Proxy Tester: Choose the Right Proxy for Your Scraper with Real-World Data
ScrapeOps Proxy Tester benchmarks 20+ proxy configurations against your specific target URL, measuring success rate, latency, and cost to help scrapers and AI Agents choose the optimal proxy.
Read more →
·2 min
VoiceOS App Store: An AI App Store That Builds Voice-Native Apps from a Single Sentence
VoiceOS App Store is a voice-native app store living in your Mac's notch. Generate custom apps with one sentence and share via links. Deep dive into its intent-driven building and frictionless distribution.
Read more →
·3 min
GitHub Daily · August 10: Agent Tools Explode Across the Board, Web Autonomy Redefined
GitHub Trending Aug 10: Firecrawl surges +815 stars as Agent tools dominate. The Agent-era supply chain takes shape — from data acquisition to orchestration to deployment.
Read more →