exp(dagger-deploy): 轮次19——APG 修复两个既有 bug(_cat_gaps in-place、段边界 queue.detach 无梯度)后可跑,但碰撞铰链尺度失控(40万)且与部署形态不一致,暂不采用;转反馈蒸馏
This commit is contained in:
@@ -139,7 +139,10 @@ def main():
|
||||
stats['tgt'] += lt.mean().item()
|
||||
(seg_loss / nseg).backward()
|
||||
seg_loss = torch.zeros((), device=dev)
|
||||
q, qp, queue, prev_d = q.detach(), qp.detach(), queue.detach(), prev_d.detach()
|
||||
# 只 detach 状态并重置队列:段边界下一 plan 走 r=0 重新提交(新图有梯度);
|
||||
# 沿用旧 queue 会跨过已 backward 的图(二次 backward 报错),也避免整段无梯度
|
||||
q, qp, prev_d = q.detach(), qp.detach(), prev_d.detach()
|
||||
queue = torch.zeros(B, 0, 6, device=dev)
|
||||
# BC 锚定
|
||||
X, Y, V, SG = data.batch(C['batch'] * 4)
|
||||
with torch.autocast('cuda', dtype=torch.bfloat16, enabled=amp):
|
||||
|
||||
Reference in New Issue
Block a user