Mark input tokens to routed experts as dynamic to avoid a recompile#2007

xmfan wants to merge 1 commit intomainpytorch/torchtitan:mainfrom

xmfan/stack/3pytorch/torchtitan:xmfan/stack/3Copy head branch name to clipboard