Skip to content

Commit 02f3767

Browse files
committed
fix hparams for rcp
1 parent 3407aca commit 02f3767

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

mlperf_logging/rcp_checker/training_5.1.0/rcps_flux1.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212
"opt_adamw_epsilon": 1e-8,
1313
"opt_adamw_weight_decay": 0.1,
1414
"opt_base_learning_rate": 2.0e-4,
15-
"opt_learning_rate_warmup_steps": 0,
15+
"opt_learning_rate_warmup_steps": 1600,
1616
"opt_gradient_clip_norm": 1.0
1717
},
1818
"samples to converge": [

0 commit comments

Comments
 (0)