Unverified50% confidenceFactExact time
RNN存在两大缺陷：无法并行计算导致速度慢，以及长距离依赖信息衰减的健忘问题
1
Sources
50%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
From CNN to Transformer: How AI Evolved to Understand Human Language
bilibiliAI-Agent搭建7/9/2026
Related Claims
UnverifiedThe core defect of RNNs (Recurrent Neural Networks) lies in their sequential computation nature, which requires processing sequences one time step at a time, causing long-range dependencies to decay exponentially with sequence length.81% similarUnverifiedRNN 引入隐状态机制，理论上能记忆任意长度上下文，但受梯度消失问题困扰78% similarUnverified传统 RNN 架构因顺序处理的局限在面对远距离依赖时会出现梯度消失问题76% similarUnverifiedRNN及其变体LSTM和GRU按时间步依次处理序列，存在梯度指数级衰减导致长距离依赖捕捉困难，以及无法并行化训练的缺陷75% similarUnverifiedRNNs suffer from vanishing/exploding gradient problems, where gradients propagating across a large number of time steps decay or grow exponentially, making it difficult to learn long-range dependencies.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/490819API
curl https://kongchang.com/api/v1/knowledge/claims/490819MCP
get_claim(id=490819)