#web scraping encryption
28 related articles
·6 min
Separate Domains vs. Subdomains for Self-Hosted Services? A Deep Dive into Security Isolation Strategies
Deep dive into domain security architecture for self-hosted services: Should services with different exposure levels use separate domains or subdomains? Analysis of subdomain enumeration risks, defense in depth, and practical isolation strategies.
Read more →
·3 min
Complete Guide to Self-Hosted Search Engines: SearXNG and Alternative Deployment Options
A detailed guide to self-hosted search engine solutions including SearXNG metasearch engine deployment, plus alternatives like Whoogle, LibreY, and 4get for privacy-preserving search.
Read more →
·4 min
FlowTask 2.0: Building a Unified Enterprise Memory Layer for AI Agents
FlowTask 2.0 proposes a "Company Brain" that unifies data from Email, Slack, WhatsApp and more to provide real-time enterprise context for AI Agents, reducing repetitive context-feeding costs.
Read more →
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep analysis of MediaCrawler, a popular GitHub open-source project using Playwright browser automation for multi-platform crawling across Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
MediaCrawler: Deep Dive into an Open-Source Crawler Framework Covering Seven Major Platforms
Deep dive into the popular GitHub project MediaCrawler — a Playwright-based multi-platform crawler framework supporting data collection from Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu.
Read more →
·3 min
AI-Assisted GeeTest Four-Image CAPTCHA Reverse Engineering: A Complete Efficiency Guide
A complete walkthrough of AI-assisted GeeTest four-image CAPTCHA reverse engineering: from capturing the w parameter to AI analyzing obfuscated code and generating runnable scripts in minutes.
Read more →
·3 min
AI-Accelerated Reverse Engineering: Cracking SM2/SM4 Encrypted Freelance Jobs in 30 Minutes
Real freelance case study: how to use DeepSeek and LLMs to reverse-engineer SM2/SM4 encrypted API parameters in 30 minutes, covering anti-debug bypass, call stack backtrace, and AI-assisted deobfuscation.
Read more →
·3 min
AI-Powered Python Reverse Engineering: A Full Retrospective on Using LLMs to Accelerate the Workflow
A real-world retrospective on AI-assisted Python reverse engineering: from JS obfuscation tracing and SM2/SM4 key extraction to generating decryption code with DeepSeek. An honest assessment of LLM value and legal risks.
Read more →
·4 min
AI Agents Automating JS Reverse Engineering: A Deep Dive into the New Paradigm for Web Scraping
AI agents are revolutionizing JS reverse engineering. This deep dive covers built-in tool chains, automation modes, prompt engineering for e-commerce, and full pipeline automation from parameter extraction to database storage.
Read more →
·3 min
MCP + Skills AI Reverse Engineering Toolchain: Technical Capabilities and Compliance Boundaries
A technical deep-dive into AI-assisted reverse engineering: how MCP, Skills libraries, and Frida toolchains work together, their real capability limits, and the legal boundaries of iOS/Android/Web reverse analysis.
Read more →
·4 min
AI-Powered Automatic Environment Patching: JS Reverse Engineering with Sandbox + Prompt
Learn how to automate JavaScript reverse engineering environment patching with AI + sandbox. Three-step flow diagnoses missing BOM/DOM objects, generates patches, and self-validates. Get encrypted data in seconds.
Read more →
·7 min
Learning Python Web Scraping from Scratch: How It Works, the Full Workflow, and Legal Boundaries
A must-read intro to Python web scraping: from HTTP requests and HTML parsing to data storage, systematically explaining how crawlers work and their full workflow, while clarifying legal boundaries like the robots protocol and privacy protection.
Read more →
·8 min
Python Web Scraping for Beginners: How It Works, Core Workflow, and Legal Red Lines Explained
A plain-language guide to how Python web scrapers work: from HTTP requests and responses, HTML tag parsing, to the complete three-step data scraping workflow, with a focus on the three legal red lines and compliance advice.
Read more →
·3 min
AI-Assisted Reverse Engineering of Taobao's Sign Signature: A Complete MD5 Encryption Cracking Walkthrough
A full walkthrough of AI-assisted reverse engineering of Taobao's mtop Sign signature: packet capture, parameter classification, MD5 identification, and scraper code generation.
Read more →
·8 min
Free Top-Tier AI Models on Aggregator Platforms? A Sober Analysis and Pitfall Avoidance Guide
In-depth analysis of AI aggregator platforms claiming free access to GPT, DeepSeek, and Gemini. Reveals hidden data risks, business logic, and recommends legitimate alternatives like OpenRouter and Poe.
Read more →
·1 min
Practical Guide: Auto-Generating JD.com H5ST Encryption Parameters with AI + Skills + MCP
Learn how to use AI with Skills prompts and MCP tools to auto-generate JD.com H5ST encryption parameters, replacing tedious manual environment patching.
Read more →
·4 min
MCP Hands-On Tutorial: Using AI to Automate Reverse Engineering of JS Encryption Algorithms
A detailed guide on MCP protocol setup and hands-on workflow showing how AI can automatically locate encrypted APIs, analyze obfuscated JS, set breakpoints, and restore sign algorithms to generate Python scraper code.
Read more →
·3 min
AI Large Language Models for Reverse Engineering: A Workflow That Boosts Freelance Efficiency by 10x
Learn how AI LLMs revolutionize JS reverse engineering—automating encryption cracking, signature reconstruction, and parameter analysis to boost freelance scraping efficiency by 10x.
Read more →
·2 min
Doubao + Cursor in Practice: AI-Powered Web Scraper Development in One Minute — Full Workflow
Full workflow for using Doubao to generate prompts and Cursor to auto-generate web scraper code. Covers AI chain collaboration, full-stack code generation, and auto-documentation.
Read more →
Tutorials·3 min
DeepSeek V4 Pro in Action: AI-Assisted Reverse Engineering of Youdao Translate's Encryption Parameters
Hands-on demo using DeepSeek V4 Pro to reverse-engineer Youdao Translate's sign parameter, from locating MD5 encryption logic to generating complete Python code, compressing hours of work into minutes.
Read more →