Skip to content

Commit b01308a

Browse files
authored
[TorchComms] Enable CP in CI test (#1928)
1 parent de335b3 commit b01308a

File tree

1 file changed

+12
-13
lines changed

1 file changed

+12
-13
lines changed

torchtitan/experiments/torchcomms/integration_tests.py

Lines changed: 12 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -36,19 +36,18 @@ def build_torchcomms_test_list() -> list[OverrideDefinitions]:
3636
"3d_dp+tp+pp",
3737
ngpu=8,
3838
),
39-
# TODO: Enable CP and async TP tests once fixes are available in
40-
# torchcomms nightly builds.
41-
# OverrideDefinitions(
42-
# [
43-
# [
44-
# "--parallelism.context_parallel_degree 2",
45-
# "--parallelism.pipeline_parallel_degree 2",
46-
# ],
47-
# ],
48-
# "DP+CP+PP",
49-
# "3d_dp+cp+pp",
50-
# ngpu=8,
51-
# ),
39+
OverrideDefinitions(
40+
[
41+
[
42+
"--parallelism.context_parallel_degree 2",
43+
"--parallelism.pipeline_parallel_degree 2",
44+
],
45+
],
46+
"DP+CP+PP",
47+
"3d_dp+cp+pp",
48+
ngpu=8,
49+
),
50+
# TODO: Enable async TP test once fixes are available for running on CI nodes.
5251
# OverrideDefinitions(
5352
# [
5453
# [

0 commit comments

Comments
 (0)