Skip to content

Commit adb593a

Browse files
authored
fix: document offload gradient_checkpointing option (axolotl-ai-cloud#2475)
1 parent a0117c9 commit adb593a

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

docs/config.qmd

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -510,7 +510,8 @@ train_on_inputs: false
510510
# Note that training loss may have an oscillating pattern with this enabled.
511511
group_by_length: false
512512

513-
# Whether to use gradient checkpointing https://huggingface.co/docs/transformers/v4.18.0/en/performance#gradient-checkpointing
513+
# Whether to use gradient checkpointing. Available options are: true, false, "offload".
514+
# https://huggingface.co/docs/transformers/v4.18.0/en/performance#gradient-checkpointing
514515
gradient_checkpointing: false
515516
# additional kwargs to pass to the trainer for gradient checkpointing
516517
# gradient_checkpointing_kwargs:

0 commit comments

Comments
 (0)