Skip to content

Improvements to multinode papers100m default hyperparams and adding eval on all ranks#8823

Merged
rusty1s merged 61 commits intomasterfrom improve-multinode-exampleMar 12, 2024

Commits

Commits on Jan 25, 2024

Commits on Jan 26, 2024

Commits on Jan 29, 2024

Commits on Jan 30, 2024

Commits on Jan 31, 2024

Commits on Feb 5, 2024

Commits on Feb 6, 2024

Commits on Feb 7, 2024

Commits on Feb 8, 2024

Commits on Feb 15, 2024

Commits on Feb 16, 2024

Commits on Feb 20, 2024

Commits on Feb 23, 2024

Commits on Feb 26, 2024

Commits on Feb 27, 2024

Commits on Feb 28, 2024

Commits on Feb 29, 2024

Commits on Mar 4, 2024

Commits on Mar 5, 2024

Commits on Mar 7, 2024

Commits on Mar 8, 2024

Commits on Mar 11, 2024

Commits on Mar 12, 2024