#Python crawler framework
23 related articles
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep analysis of MediaCrawler, a popular GitHub open-source project using Playwright browser automation for multi-platform crawling across Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep dive into the popular GitHub project MediaCrawler — a Playwright-based multi-platform crawler framework supporting data collection from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
GitHub Daily · July 27: AI Agent Skill Ecosystem Explodes, Claude's Capability Boundaries Keep Expanding
GitHub Trending July 27: AI Agent Skills explode as claude-video, impeccable, and last30days-skill extend model capabilities without modifying models themselves.
Read more →
·3 min
AirOps in Practice: Building Enterprise-Grade AI Agents with the Claude Agent SDK
How AirOps replaced traditional workflow builders with the Claude Agent SDK to build an AI agent platform for content marketers — covering three architectural iterations, harness engineering, and sub-agent context management.
Read more →
·3 min
Harness Architecture in Practice: A Deep Dive into Enterprise-Level Agent Projects
A deep dive into Harness architecture in enterprise Agent projects, covering MCP protocol, sandbox isolation, multi-model scheduling, and ASGI deployment — key topics for LLM job interviews.
Read more →
·3 min
Getting Started with LangChain: The Core Framework for LLM Application Development and Its Three Key Components
LangChain is the leading open-source framework for LLM application development, supporting GPT-4, GLM, and other mainstream models. This article dives into its three core concepts: Components, Chains, and Agents.
Read more →
·7 min
Building AI Agents in Rust: The GAIA Benchmark Reveals the Capability Ceiling of Large Models
A Rust-based AI Agent evaluation framework uses the GAIA benchmark to compare GPT, Claude, DeepSeek and other models with no tools. Results show pure LLMs cap at ~25% accuracy, revealing why tool use is decisive for Agents.
Read more →
·5 min
28 Enterprise-Grade AI Agent Projects: A Complete Guide That Even Beginners Can Deploy
A collection of 28 fully reproducible enterprise-grade AI Agent projects covering code debugging, financial analysis, customer service, and multi-agent collaboration—deployable even for beginners.
Read more →
·7 min
Learning Python Web Scraping from Scratch: How It Works, the Full Workflow, and Legal Boundaries
A must-read intro to Python web scraping: from HTTP requests and HTML parsing to data storage, systematically explaining how crawlers work and their full workflow, while clarifying legal boundaries like the robots protocol and privacy protection.
Read more →
·7 min
Learning Python from Scratch: A Complete Guide to the Three-Stage Learning Path
Want to learn Python from scratch but don't know where to begin? This article breaks down three stages—basic syntax, advanced mastery, and hands-on practice—with real projects in crawling, automation, and data analysis to help you build programming thinking.
Read more →
·3 min
Harness Engineering in Practice: A Guide to Enterprise-Grade Multi-Agent System Architecture
A deep dive into Harness Engineering architecture: building an AI procurement assistant on ERP systems, covering multi-agent orchestration, MCP protocol, ASGI deployment, and sandbox isolation.
Read more →
·3 min
A Complete Guide to Learning Python from Scratch: From Basics to Web Scraping Projects
A systematic Python learning path for beginners covering syntax, OOP, web scraping, office automation, and data analysis, with methodology tips and resources.
Read more →
·3 min
Python Beginner's Guide from Scratch: Why Python Is Your Best Choice
A complete Python beginner's guide covering language features, six ideal learner profiles, and seven application areas. Discover why Python is the best choice for coding beginners and AI learners.
Read more →
·3 min
Hermes Agent Practical Tutorial: Architecture Analysis and Three Automation Project Builds
Complete guide to Hermes Agent from basics to practice, covering architecture analysis, Rules.md configuration, MCP service integration, and three hands-on projects: AI news bot, auto blog development, and scheduled code review.
Read more →
·3 min
AI Coding Showdown: Four Major Models Show Shocking Performance Gaps on a Dynamic Web Scraping Task
Real-world test of ChatGPT 5.4, Gemini 3.1, DeepSeek V4 Pro, and Kimi 5.1 on a Baidu dynamic web scraping task reveals surprising gaps in AI coding ability.
Read more →
·5 min
CherryStudio + MCP: Tutorial for Building Automated AI Agents and Local Knowledge Bases
Complete guide to building automated AI agents with Cherry Studio and MCP protocol, covering environment setup, MCP Server configuration, web scraping, Shell execution, and Ollama local knowledge base deployment.
Read more →
·4 min
Full-Stack Development in a Todo App: 35 Core Technologies Every Programmer Should Know
Using a todo app's full development lifecycle as a guide, this article covers 35 core full-stack technologies from frontend to backend, databases, DevOps, cloud deployment, and scaling architecture.
Read more →
Tutorials·3 min
Zero2Agent: An Open-Source Job Interview Prep Tutorial for Agent Engineer Positions at Top Tech Companies
Zero2Agent is an open-source interview prep tutorial covering Agent fundamentals, LangGraph/Claude Code analysis, interview question banks, and coding practice tools for landing Agent engineer roles at top tech companies.
Read more →
Tutorials·3 min
Claude Code Installation & Agent Hands-On Tutorial: Easy Enough for Non-Developers
Step-by-step Claude Code installation guide with Volcengine GLM5.1 Chinese LLM. Hands-on Agent demos for Bilibili data scraping and ComfyUI setup. No coding required.
Read more →
Tutorials·3 min
Hermes Agent + Playwright: A Practical Guide to AI-Driven Browser Automation
A complete guide to AI-driven browser automation with Hermes Agent and Playwright, covering setup, three AI modes (snapshot decisions, multi-turn dialogue, autonomous exploration), retry mechanisms, and optimization tips.
Read more →