[KongchangAI]
Concept

RL

Reinforcement Learning (RL), a method that optimizes model behavior through reward signals, commonly used for large-model alignment and training on complex tasks.

Timeline (last 90 days)

Nov 17

In multi-step tool-calling tasks, SFT provides the initial policy and reasoning format, while RL is responsible for fine-tuning the decision boundary under reward guidance.

Unverified50%
Nov 13

DiVR is complementary to post-training methods such as supervised fine-tuning (SFT) and reinforcement learning (RL).

Unverified50%
Nov 10

In controlled comparisons, rollout configurations that would destabilize RL methods remain stable under OPD.

Unverified50%
Nov 5

Chapter 4 introduces serving and RL, bringing MoE models into inference serving and reinforcement learning pipelines.

Unverified50%
Nov 4

Hydrogen-1.0's training method combines supervised fine-tuning (SFT) with reinforcement learning (RL), with data sources including domain data, scientist feedback, in-house laboratory records and discovery trajectories.

Unverified50%
Oct 28

There are plenty of hosted services to choose from for SFT, whereas RL currently lacks a genuinely excellent hosted solution.

Unverified50%
Oct 16

In internal documents, Anthropic defined the core path to AGI as: build large generative models with long-term memory capabilities and fine-tune them through reinforcement learning that combines automated rewards with human feedback.

Unverified50%
Oct 15

The design of CIPR is not tied to a specific training paradigm and can be applied to both supervised fine-tuning (SFT) and reinforcement learning (RL) post-training stages.

Unverified50%
Oct 12

Training pressure may only push the policy's actions to just below the blocking threshold, but the model may have uncertainty about when it will be intercepted; RL will push it to conservatively avoid being intercepted and accumulate knowledge of evading the monitor along the way.

Unverified50%
Oct 12

The current NTP+RL paradigm has three mechanistic gaps: the absence of goal generation, the absence of embodiment and interaction, and the absence of continual learning.

Unverified50%

11 more timeline events

All Facts (20)

Unverified

In multi-step tool-calling tasks, SFT provides the initial policy and reasoning format, while RL is responsible for fine-tuning the decision boundary under reward guidance.

50%
Unverified

DiVR is complementary to post-training methods such as supervised fine-tuning (SFT) and reinforcement learning (RL).

50%
Unverified

In controlled comparisons, rollout configurations that would destabilize RL methods remain stable under OPD.

50%
Unverified

Chapter 4 introduces serving and RL, bringing MoE models into inference serving and reinforcement learning pipelines.

50%
Unverified

Hydrogen-1.0's training method combines supervised fine-tuning (SFT) with reinforcement learning (RL), with data sources including domain data, scientist feedback, in-house laboratory records and discovery trajectories.

50%
Unverified

There are plenty of hosted services to choose from for SFT, whereas RL currently lacks a genuinely excellent hosted solution.

50%
Unverified

In internal documents, Anthropic defined the core path to AGI as: build large generative models with long-term memory capabilities and fine-tune them through reinforcement learning that combines automated rewards with human feedback.

50%
Unverified

The design of CIPR is not tied to a specific training paradigm and can be applied to both supervised fine-tuning (SFT) and reinforcement learning (RL) post-training stages.

50%
Unverified

Training pressure may only push the policy's actions to just below the blocking threshold, but the model may have uncertainty about when it will be intercepted; RL will push it to conservatively avoid being intercepted and accumulate knowledge of evading the monitor along the way.

50%
Unverified

The current NTP+RL paradigm has three mechanistic gaps: the absence of goal generation, the absence of embodiment and interaction, and the absence of continual learning.

50%
Unverified

AlphaZero proved that in domains with clear rules and definable rewards, RL can learn strategies surpassing humans from scratch.

50%
Unverified

The mechanism of RL itself does not provide a source for goal generation; AlphaZero's game space is closed and its reward function is fixed.

50%
Unverified

NTP provides the compression foundation for general representations, and RL provides the ability to perform goal-directed search over those representations; in principle, the combination of the two can approach general intelligence.

50%
Unverified

Older models' RL training scored on a per-message basis, causing the model to default to treating each new message as an independent new instruction.

50%
Unverified

Barron believes that a large number of so-called RL successes actually come from extremely high-quality mid-training data (doing pre-training-like work on synthetic reasoning data).

50%
Unverified

Everything that can be learned through RL is essentially a small number of bits that can be easily distilled and replicated, which is the primary force countering the centralization of model providers.

50%
Unverified

After pre-training scaling laws encountered diminishing returns, RL took over and extended the new performance curve.

50%
Unverified

Starting from Nemotron 3 Ultra, the team trained two expert checkpoints specifically targeting math olympiad problems through supervised fine-tuning (SFT) and reinforcement learning (RL).

50%
Unverified

In the standard SFT process, the model continuously expends gradients on sequences that are already well-fitted, causing the output distribution to narrow and entropy to decrease, thereby compressing the exploration space for subsequent RL.

50%
Unverified

If pass@16 is much higher than pass@1, it indicates that the model's probability distribution contains the correct answer but does not place it at the highest probability position, which is precisely the space where RL can exert its effect through reward signals.

50%

Source Articles