#web scraping with Python
93 related articles
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep analysis of MediaCrawler, a popular GitHub open-source project using Playwright browser automation for multi-platform crawling across Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep dive into the popular GitHub project MediaCrawler — a Playwright-based multi-platform crawler framework supporting data collection from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
GitHub Daily · July 27: AI Agent Skill Ecosystem Explodes, Claude's Capability Boundaries Keep Expanding
GitHub Trending July 27: AI Agent Skills explode as claude-video, impeccable, and last30days-skill extend model capabilities without modifying models themselves.
Read more →
·4 min
Building an AI-Automated Topic Selection System: A Practical Guide to the Three-Dimension Method
Learn how Bilibili creator JK built an AI-automated topic selection system using Codex and Feishu — covering the three-dimension method: practice, trending topics, and benchmarking.
Read more →
·3 min
The Complete Beginner's Guide to Vibe Coding: Core Logic and Practical Learning Path
Vibe Coding is the new AI-era programming paradigm. Describe what you want in plain language; let AI generate the code. Learn the 3-stage path: mindset, quality, and real projects.
Read more →
·2 min
Python Learning Path for Beginners: A Complete Breakdown of Three Core Modules
A complete Python learning path for beginners covering three modules: Fundamentals, Intermediate, and Hands-On Practice — including web scraping, office automation, and data analysis.
Read more →
·3 min
AI-Accelerated Reverse Engineering: Cracking SM2/SM4 Encrypted Freelance Jobs in 30 Minutes
Real freelance case study: how to use DeepSeek and LLMs to reverse-engineer SM2/SM4 encrypted API parameters in 30 minutes, covering anti-debug bypass, call stack backtrace, and AI-assisted deobfuscation.
Read more →
·3 min
AI-Powered Python Reverse Engineering: A Full Retrospective on Using LLMs to Accelerate the Workflow
A real-world retrospective on AI-assisted Python reverse engineering: from JS obfuscation tracing and SM2/SM4 key extraction to generating decryption code with DeepSeek. An honest assessment of LLM value and legal risks.
Read more →
·4 min
AI Agents Automating JS Reverse Engineering: A Deep Dive into the New Paradigm for Web Scraping
AI agents are revolutionizing JS reverse engineering. This deep dive covers built-in tool chains, automation modes, prompt engineering for e-commerce, and full pipeline automation from parameter extraction to database storage.
Read more →
·3 min
Cherry Studio + MCP: A Practical Guide to Building AI Agents with Local Deployment
Learn how to build an automated AI agent using Cherry Studio, MCP protocol, and locally deployed models — covering DeepSeek integration, web scraping, and private knowledge base setup.
Read more →
·2 min
TradingAgents-astock: A Practical Guide to the Multi-Agent Research Framework for A-Share Markets
TradingAgents-astock is a multi-agent A-share research framework with free domestic data sources, seven debating analyst agents, and support for DeepSeek, Qwen, and more.
Read more →
·3 min
Cherry Studio + MCP + Ollama: The Complete Guide to Building a Local AI Agent and Private Knowledge Base
A hands-on guide to building a local AI agent and private knowledge base using Cherry Studio, MCP, and Ollama — with web scraping, report generation, and terminal control.
Read more →
Clawk: Creating Disposable Linux Sandb…
·2 min
Clawk: Creating Disposable Linux Sandbox Environments for AI Coding Assistants
Clawk offers a core solution to AI coding assistant security risks: disposable Linux VMs that isolate SSH keys, API tokens, and sensitive data from agents like Claude Code and Cursor.
Read more →
·3 min
Harness Architecture in Practice: A Deep Dive into Enterprise-Level Agent Projects
A deep dive into Harness architecture in enterprise Agent projects, covering MCP protocol, sandbox isolation, multi-model scheduling, and ASGI deployment — key topics for LLM job interviews.
Read more →
sqlite-utils 4.1.1: Fix for Silent Dat…
·2 min
sqlite-utils 4.1.1: Fix for Silent Data Loss Risk in Foreign Key Transactions
sqlite-utils 4.1.1 fixes a silent data loss risk in table.transform() caused by foreign key cascade actions inside transactions, introducing a TransactionError fail-fast mechanism.
Read more →
·3 min
Empowering AI Agents with Skills to Automate WeChat Official Account Analytics
Learn how Skill-powered AI Agents can automatically log in to WeChat Official Account backends, scrape data, sort it, and generate Excel reports — eliminating manual analytics work.
Read more →
·4 min
Making Money with AI Coding Gigs: Platform Selection, Pitfall Avoidance, and a Rational Guide to Getting Started
AI coding tools have dramatically lowered the barrier to freelance gigs, but what risks lurk behind claims of "earning over 10,000 a month"? This article breaks down platform tiering on Zhubajie, Upwork, and more, plus three key pitfalls for beginners.
Read more →
·6 min
GPT-5.6 Hands-On Deep Dive: ChatGPT and Codex Merge, Full Analysis of the Sol Model
GPT-5.6 is officially released, merging ChatGPT and Codex into one app and launching the three-tier Sol, Terra, and Luna models. A detailed breakdown of 16 hands-on tests plus Worker mode and Codex dev upgrades.
Read more →
·7 min
Getting Started with Dify: A Complete Guide from Local Deployment to Building Enterprise-Grade AI Applications
A detailed guide to Dify, the open-source LLM app development platform, covering its core features and full local deployment via VMware + Ubuntu + aaPanel + Docker. Supports 100+ models like DeepSeek and ChatGPT to build enterprise AI apps fast.
Read more →
·3 min
Python for Absolute Beginners: A Complete Breakdown of a 10-Hour Systematic Course
Breaking down a 10-hour Python course for absolute beginners — covering syntax, OOP, functional programming, web scraping, and automation, with mind maps and exercises.
Read more →