3 parallel-and-distributed-computing-phd "the" positions at Oak Ridge National Laboratory
Sort by
Refine Your Search
-
Listed
-
Category
-
Field
-
. Demonstrated experience developing and running computational tools for high-performance computing environment, including distributed parallelism for GPUs. Demonstrated experience in common scientific programming
-
for Science @ Scale: Pretraining, instruction tuning, continued pretraining, Mixture-of-Experts; distributed training/inference (FSDP, DeepSpeed, Megatron-LM, tensor/sequence parallelism); scalable evaluation
-
distributed systems techniques. Proficiency in programming languages such as Python, C++, or similar, as well as experience with HPC environments and parallel computing. Demonstrated hands-on experience and
Enter an email to receive alerts for parallel-and-distributed-computing-phd "the" positions