#web scraping workflow
149 related articles
·7 min
Learning Python Web Scraping from Scratch: How It Works, the Full Workflow, and Legal Boundaries
A must-read intro to Python web scraping: from HTTP requests and HTML parsing to data storage, systematically explaining how crawlers work and their full workflow, while clarifying legal boundaries like the robots protocol and privacy protection.
Read more →
·8 min
Python Web Scraping for Beginners: How It Works, Core Workflow, and Legal Red Lines Explained
A plain-language guide to how Python web scrapers work: from HTTP requests and responses, HTML tag parsing, to the complete three-step data scraping workflow, with a focus on the three legal red lines and compliance advice.
Read more →
Tutorials·1 min
AI-Assisted Web Scraping Reverse Engineering: Automated Environment Patching Workflow & Monetization Analysis
Learn how AI automates browser environment patching in web scraping reverse engineering, cutting hours of manual work to minutes, plus market demand and monetization analysis.
Read more →
·3 min
Building a Custom Switch Management Interface with Gemini: AI-Powered Network Operations in Practice
A Homelab user leveraged Gemini AI to build a custom web management interface for an HP switch via REST API, enabling port control, PoE management, and connection visualization.
Read more →
·3 min
Peek: An Open-Source Android Tool for Viewing Instagram and Other Social Media Links Without Logging In
Peek is an open-source Android app that lets users view Instagram Reels, posts, and other social media links without logging in, bypassing login walls and pop-up interruptions.
Read more →
·3 min
GitHub Daily · July 27: AI Agent Skill Ecosystem Explodes, Claude's Capability Boundaries Keep Expanding
GitHub Trending July 27: AI Agent Skills explode as claude-video, impeccable, and last30days-skill extend model capabilities without modifying models themselves.
Read more →
·3 min
Open-Source Automated News Briefing Generator: A Zero-Technical-Barrier AI Deployment Analysis
An open-source automated news briefing system. No coding needed—just let an AI read the project docs to complete the entire deployment. Six-stage pipeline, four-channel search covering 16+ platforms, smart classification and dedup, daily auto-push to Feishu, completely free.
Read more →
·2 min
Ego Lite Review: AI Browser Automation That Won't Steal Your Mouse Focus
Ego Lite is a browser built for AI collaboration. Based on Chromium, it uses login state reuse and isolated Spaces so AI Agents can autonomously handle web operations, form filling, and data scraping—solving the human-machine focus conflict. macOS only.
Read more →
·2 min
Ego Lite Review: AI Browser Automation That Won't Steal Your Mouse Focus
Ego Lite is a Chromium-based browser designed for AI collaboration. Through login state reuse and isolated Spaces, AI Agents autonomously handle web tasks, form filling, and data collection—ending the human-machine focus fight. Currently on macOS.
Read more →
·1 min
The Complete Guide to Claude Code: How Does an AI Coding Assistant Differ from a Regular Conversational AI?
In-depth analysis of Claude Code's core features and advantages: auto-reading project context, direct code execution, memory of coding preferences, and connecting external services via MCP. Compared with Cursor and ChatGPT to help developers choose the right AI coding tool.
Read more →
·1 min
Getting Started with Claude Code: How an AI Coding Assistant Executes Code Autonomously
Claude Code (CC) is more than a chat AI—it reads project files, creates and modifies code, and runs commands, ending copy-paste. This article compares CC with ordinary AI across 5 dimensions and explains CC vs Cursor.
Read more →
·4 min
Building an AI-Automated Topic Selection System: A Practical Guide to the Three-Dimension Method
Learn how Bilibili creator JK built an AI-automated topic selection system using Codex and Feishu — covering the three-dimension method: practice, trending topics, and benchmarking.
Read more →
Ego-lite: An Open-Source Browser Desig…
·3 min
Ego-lite: An Open-Source Browser Designed for Humans and AI Agents to Work in Parallel
ego-lite is an open-source AI-native browser by citrolabs that lets humans and AI Agents work in parallel in the same environment. Explore its design and value.
Read more →
·7 min
Getting Started with Claude Code: Five Dimensions to Understand Why It Outperforms Regular AI
Claude Code isn't just a chat AI—it can directly read projects, modify code, and run commands. This article compares Claude Code with regular AI across five dimensions to help you decide if it's worth trying.
Read more →
·3 min
The Complete Beginner's Guide to Vibe Coding: Core Logic and Practical Learning Path
Vibe Coding is the new AI-era programming paradigm. Describe what you want in plain language; let AI generate the code. Learn the 3-stage path: mindset, quality, and real projects.
Read more →
·3 min
AI-Assisted GeeTest Four-Image CAPTCHA Reverse Engineering: A Complete Efficiency Guide
A complete walkthrough of AI-assisted GeeTest four-image CAPTCHA reverse engineering: from capturing the w parameter to AI analyzing obfuscated code and generating runnable scripts in minutes.
Read more →
·2 min
Hermes Agent: A Complete Beginner's Guide to the Self-Evolving Open-Source AI Agent
Hermes Agent is an open-source autonomous AI Agent with long-term memory and self-evolution. Learn its core innovations, how it compares to Open Cloud, and why it hit 121K GitHub stars.
Read more →
·2 min
Codex vs Claude Code: Which Should Beginners Choose?
One month using both Codex and Claude Code: a real-world comparison across model capability, Chinese UI, usage limits, and ecosystem interoperability for beginners.
Read more →
·2 min
New Lighthouse Audit: Getting Your Website Ready for AI Agents
Starting with Chrome 150, Google's Lighthouse introduces an Agentic Browsing audit checking Accessibility Tree structure, WebMCP schema validity, and CLS to help developers assess AI agent readiness.
Read more →
·2 min
Python Learning Path for Beginners: A Complete Breakdown of Three Core Modules
A complete Python learning path for beginners covering three modules: Fundamentals, Intermediate, and Hands-On Practice — including web scraping, office automation, and data analysis.
Read more →