Use packaging-legacy

[oliverchang]

Context: #1270 (comment)

If we use this, we can remove the <22.0 pin for our "packaging" package.

[github-actions]

This issue has not had any activity for 60 days and will be automatically closed in two weeks