#Wikipedia text extraction
8 related articles
·3 min
WikiExtractor 3.1.0 Released: Cross-Platform Consistency, SharedMemory Optimization, and Security Fixes
WikiExtractor 3.1.0 released with Linux/Windows/macOS cross-platform consistency, SharedMemory optimization, #expr security vulnerability fix, and template parsing improvements for reliable Wikipedia text extraction.
Read more →
·3 min
AI Crawlers Crash Gentoo Bugzilla: Open-Source Infrastructure Faces a Data Plundering Crisis
Gentoo's official Bugzilla was forced offline by AI crawler overload, exposing the data plundering crisis facing open-source infrastructure in the AI era.
Read more →
·3 min
Scanning 7.6PB of HuggingFace Data: A Hidden Key Crisis in AI Training Sets
A security audit of 7.6PB of HuggingFace training data uncovered massive API key and credential leaks. Analysis of risks, scanning challenges, and data supply chain security governance.
Read more →
·4 min
AI Companies Buy Books, Scan Them, Then Destroy Them: Pulping of Rare Books Sparks Cultural Preservation Debate
Some AI companies are mass-purchasing physical books for destructive scanning and pulping to obtain training data, even targeting rare antiquarian volumes. This article analyzes the technical motivations, legal gray areas, and cultural preservation controversies.
Read more →
·4 min
AI Companies Buy, Scan, and Destroy Books: Pulping Rare Volumes Sparks Cultural Preservation Debate
Some AI companies are mass-purchasing physical books for destructive scanning and pulping—even rare and antiquarian volumes—to obtain training data, sparking heated cultural preservation debates.
Read more →
·4 min
AI Text Detection and Privacy Protection: The Dual Dilemma of LLM Security
How does watermarking work — and why won't companies deploy it? How does differential privacy defend against membership inference attacks? Based on talks by IISc and IIT scholars, this article unpacks the core mechanisms and real challenges in LLM security.
Read more →
·6 min
Reverse-Engineering ChatGPT's Source Selection: What Network Traffic Analysis Reveals About AI Citations
By capturing and analyzing ChatGPT's real network traffic during web retrieval, this article reveals the underlying logic of AI source selection—covering the layered mechanisms of retrieval recall and content filtering, domain preference patterns, and practical insights for content creators and SEO professionals.
Read more →
·5 min
Building RAG from Scratch: Creating a Domain Expert System with Local Small Models
Step-by-step guide to building a complete RAG pipeline with Ollama + LangChain + FAISS + Qwen 1.5B. Run document retrieval and intelligent Q&A locally without a GPU.
Read more →