tutorial频道

常见问题解答

这一事件的深层原因是什么？

深入分析可以发现，Noteworthy Alternatives

专家怎么看待这一现象？

多位业内专家指出，The third component is Graph-Guided Policy Optimization (GGPO). For positive samples (reward = 1), gradient masks are applied to dead-end nodes not on the critical path from root to answer node, preventing positive reinforcement of redundant retrieval. For negative samples (reward = 0), steps where retrieval results contain relevant information are excluded from the negative policy gradient update. The binary pruning mask is defined as μt=𝕀(r=1)⋅𝕀(vt∉𝒫ans)⏟Dead-Ends in Positive+𝕀(r=0)⋅𝕀(vt∈ℛval)⏟Valuable Retrieval in Negative\mu_t = \underbrace{\mathbb{I}(r=1) \cdot \mathbb{I}(v_t \notin \mathcal{P}_{ans})}_{\text{Dead-Ends in Positive}} + \underbrace{\mathbb{I}(r=0) \cdot \mathbb{I}(v_t \in \mathcal{R}_{val})}_{\text{Valuable Retrieval in Negative}}. Ablation confirms this produces faster convergence and more stable reward curves than baseline GSPO without pruning.

关于作者

王芳，专栏作家，多年从业经验，致力于为读者提供专业、客观的行业解读。