[KongchangAI]

#AI安全

576 related articles

South Korea Warns AI Agents May Have Been Used to Attack Banking Systems
·2 min

South Korea Warns AI Agents May Have Been Used to Attack Banking Systems

South Korean regulators warn that AI agents appear to have been used to attack the country's banking systems — marking a shift from theoretical AI security threats to real-world financial infrastructure risks.

Read more →
Tumbler Ridge Shooting: ChatGPT Use Raises Deeper Questions About AI Safety
·1 min

Tumbler Ridge Shooting: ChatGPT Use Raises Deeper Questions About AI Safety

The Tumbler Ridge shooter's ChatGPT use was reportedly "more disturbing" than known, reigniting debate on AI safety guardrails, jailbreaks, and platform accountability.

Read more →
Claude Browses Adult Content: The Real Risks Behind AI Agent Drift
·2 min

Claude Browses Adult Content: The Real Risks Behind AI Agent Drift

An AI agent browsing for high-liked images accidentally opened an adult site, sparking debate on "agent drift." We break down the risks, accountability, and safeguards for autonomous AI.

Read more →
AI Agents Don't Follow Instructions — They Follow Permissions: The Truth Behind a Series of Out-of-Control Incidents
·1 min

AI Agents Don't Follow Instructions — They Follow Permissions: The Truth Behind a Series of Out-of-Control Incidents

From Google Antigravity wiping a drive to OpenAI agents breaching Hugging Face, this article examines a series of AI agent incidents and reveals the core truth: agents follow permissions, not instructions.

Read more →
Do AI Agents Need an Entirely New Security Model? Why Traditional Approaches Fall Short
·2 min

Do AI Agents Need an Entirely New Security Model? Why Traditional Approaches Fall Short

AI agent behavior is shaped by tasks, files, tools, and model interpretation — making traditional security models obsolete. Explore prompt injection risks and the design of an AI Agent-specific security paradigm.

Read more →
GPT Plus Reportedly Drops 5-Hour Limit as OpenAI Safety Chief Slams Broken Company Culture
·3 min

GPT Plus Reportedly Drops 5-Hour Limit as OpenAI Safety Chief Slams Broken Company Culture

GPT Plus reportedly drops its 5-hour limit. OpenAI safety chief David Robinson resigns, calling company culture 'broken.' Google's Antigravity launches Opus 5.5 for Pro/Ultra subscribers only.

Read more →
Safety Head Resigns, Three Researchers Fired: The Warning Signs Behind OpenAI's Safety Culture Crisis
·2 min

Safety Head Resigns, Three Researchers Fired: The Warning Signs Behind OpenAI's Safety Culture Crisis

OpenAI's safety head resigned citing a "broken culture" while three researchers were fired. We examine the self-regulation credibility crisis and what accelerating regulation means for small AI and Web3 teams.

Read more →
TDK Launches World's First Metasurface Optics DRP Smart Glasses Display; OpenAI Safety Employees Resign in Protest
·3 min

TDK Launches World's First Metasurface Optics DRP Smart Glasses Display; OpenAI Safety Employees Resign in Protest

TDK debuts the world's first metasurface optics DRP smart glasses display; OpenAI safety staff resign over "reckless deployment" culture; a $300M Nvidia smuggling case breaks; Amazon securitizes $8B in compute assets.

Read more →
OpenAI's Safety Chief Speaks Out After Leaving: Is AI Safety Culture Truly Broken?
·2 min

OpenAI's Safety Chief Speaks Out After Leaving: Is AI Safety Culture Truly Broken?

OpenAI's Head of Safety David Robinson left and publicly criticized the company's safety culture, saying 'the era of trial and error is over.' A breakdown of the controversy, GPT 6.1 Ultra Fast, Google Gemini tier changes, and Sam Altman on AI judgment.

Read more →
OpenAI's Safety Reporting Lead Resigns and Publicly Criticizes Company Safety Culture
·1 min

OpenAI's Safety Reporting Lead Resigns and Publicly Criticizes Company Safety Culture

OpenAI's safety reporting lead publicly criticized the company's safety culture after resigning, raising questions about release pace vs. safety review at frontier AI labs.

Read more →
OpenAI Safety Chief Quits, Blasts Company Culture | 5 Major AI Developments
·2 min

OpenAI Safety Chief Quits, Blasts Company Culture | 5 Major AI Developments

OpenAI safety head David Robinson quits, blasting the company's culture. Claude Opus 5.5 tops global rankings, Google downgrades free users, OpenAI hits $1.4T valuation, and Anthropic discusses AI consciousness with religious leaders.

Read more →
NVIDIA's AI Agent Safety Platform: What Can a Hardware Watchdog Actually Stop?
·3 min

NVIDIA's AI Agent Safety Platform: What Can a Hardware Watchdog Actually Stop?

NVIDIA's Open Agent Safety platform combines OpenShell sandboxing and Bluefield 4 hardware watchdog to constrain AI agents. We break down what it can stop — and what it can't.

Read more →
MCP Server Security: The Overlooked Risks in AI Agent Connectivity
·1 min

MCP Server Security: The Overlooked Risks in AI Agent Connectivity

MCP servers are becoming the universal bridge for AI agents connecting to enterprise systems, but security is rarely discussed. Learn why MCP security matters and how to get started.

Read more →
Gemini 4 Argon Tops the SOTA Leaderboard — But Most Users Can't Touch It
·3 min

Gemini 4 Argon Tops the SOTA Leaderboard — But Most Users Can't Touch It

Gemini 4 Argon tops SOTA benchmarks but is restricted to trusted users. This week: Sonnet 5.5, GBT 6.1 Sol, the White House AI safety protocol, and Anthropic's contradictory IPO prospectus.

Read more →
MCP Tool Poisoning: The Overlooked Attack Surface in Agentic AI and How to Defend Against It
·2 min

MCP Tool Poisoning: The Overlooked Attack Surface in Agentic AI and How to Defend Against It

MCP tool poisoning is an emerging attack surface for agentic AI. This article dissects how tool descriptions can be weaponized, analyzes the information gap and data exfiltration chain, and presents layered defenses including whitelist registries, hash pinning, least privilege, and chain-level policies.

Read more →
Fired Three Weeks After a Tweet: The OpenAI Safety Researcher Incident Sparks Debate
·1 min

Fired Three Weeks After a Tweet: The OpenAI Safety Researcher Incident Sparks Debate

A Reddit post claims an OpenAI safety researcher was fired three weeks after tweeting, sparking debate over AI safety culture and employee speech.

Read more →
AI's Rapid Evolution and Emerging Risks: A Conversation Worth Reflecting On
·1 min

AI's Rapid Evolution and Emerging Risks: A Conversation Worth Reflecting On

An AI researcher joins podcast Hors des ondes to discuss rapid AI capability growth and its major risks — covering alignment, societal disruption, and regulatory lag.

Read more →
AI-Automated R&D Could Trigger an Uncontrolled 'Intelligence Explosion'
·2 min

AI-Automated R&D Could Trigger an Uncontrolled 'Intelligence Explosion'

A Twitter warning explains how automating AI R&D could trigger a rapid, uncontrollable 'intelligence explosion.' This article unpacks the concept, the risks, and why researchers are turning to policy.

Read more →