a↗agentbay.All projects & My collection ↗
AgentBay / Directory

mcore-run-on-slurm

Skill

About mcore-run-on-slurm

How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.

Community

0 use this · 0 favorites

← Back to the directory