Add patience to reduce LR as CTM argument #141
Description
- Contextualized Topic Models version: 2.5.0
- Python version: 3.9.16
- Operating System: Ubuntu 20.04.6 LTS
Description
Currently, ReduceLROnPlateau function for CTM has a high hard-coded value for patience. So, whenever you want the LR to decrease during training we need to set the EarlyStopping patience to some value higher than 10, otherwise the train stops before the LR is actually decreased.
This is impractical because, waiting 10 epochs for the LR to decrease is a lot.
Propose to fix it
class CTM:
# ...
def __init__(
self,
# ...
reduce_on_plateau=False,
lr_patience: int = 3
# ...
# init lr scheduler
if self.reduce_on_plateau:
self.scheduler = ReduceLROnPlateau(self.optimizer, patience=sefl.lr_patience)