Skip to content

Add Lion baseline #879

@tfaod

Description

@tfaod
  • Implementation: Google AutoML's Lion
  • Tunable hyperparameters: learning_rate, weight_decay, one_minus_beta1, beta2
  • Fixed hyperparameters: warmup_factor

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions