Cooldown masking rate#2351

Draft

yperugachidiaz wants to merge 5 commits into

ecmwf:develop-sslfrom

yperugachidiaz:ypd/dev/2328-develop-ssl-cooldown-masking-rate

Commits on May 12, 2026

Added cool_down_steps to linearly decrease the masking rate during training
Yura Perugachi Diaz
committed

Commits on May 15, 2026

Merge remote-tracking branch 'upstream/develop-ssl' into ypd/dev/2328-develop-ssl-cooldown-masking-rate
Yura Perugachi Diaz
committed

Commits on May 18, 2026

Removed train_step for batch, not used
Yura Perugachi Diaz
committed

Commits on May 19, 2026

Fix tokenizer masker initialization for cooldown masking
yperugachidiaz
committed

Commits on Jun 8, 2026

Fixed masking cooldown; now linearly increasing to 1
yperugachidiaz
committed