Senior Software Engineer developing AI software resiliency for powerful AI supercomputers. Leading efforts to improve reliability and robustness for large-scale AI workloads at NVIDIA.
Responsibilities
Develop AI Software Resiliency Features: Implement and optimize software features that improve AI system reliability at a massive scale, such as fast checkpoint-recovery, error detection, error isolation, and straggler/hang detection.
Hands-On Coding & Optimization: Contribute to large-scale distributed systems with high-quality, production-level C++ and Python code.
Fault Tolerance & Debugging: Work on AI system error handling, implementing techniques to detect silent data corruption (SDC) and other failure scenarios.
Collaborate Across Teams: Work closely with senior engineers, AI researchers, and hardware/software teams to integrate resiliency features into AI frameworks like PyTorch and JAX/XLA.
Testing & Automation: Develop and implement tests to ensure robustness, scalability, and efficiency of resiliency mechanisms.
Support Production Deployments: Assist in debugging and performance tuning large-scale AI workloads in cloud and HPC environments, ensuring seamless operation of AI training and inference workloads.
Requirements
Bachelor’s, Master’s or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
Proficiency in C++ and Python , with experience in writing efficient, high-performance code.
6+ years of relevant experience
Strong understanding of distributed systems concepts , parallel programming, and fault tolerance in large-scale computing environments.
Familiarity with AI frameworks such as PyTorch, JAX/XLA, TensorFlow, or similar.
Experience with debugging and profiling tools (e.g., gdb, perf, valgrind, NVIDIA Nsight).
Excellent problem-solving skills and ability to work in a fast-paced, highly collaborative environment.
Senior Software Engineer building and maintaining OTT streaming applications for Dolby. Focusing on reliable, scalable Web features and collaborating with cross - functional teams.
Senior Software Engineer at Dolby developing client - side applications for consumer - facing products. Leading technical design decisions and mentoring engineers in a collaborative environment.
System Administrator managing and maintaining Windows/Linux servers at SourcingTrust. Seeking someone with 5+ years of experience and strong troubleshooting skills.
Software Engineer developing data systems to improve core product experience at Whatnot's live commerce platform. Leading development of scalable solutions with a high - impact focus.
Lead software engineering projects as a technical expert within Truist's financial services, focusing on complex solutions. Collaborate with multiple stakeholders to design and implement innovative systems.
Senior Software Developer focused on XR applications at Light & Wonder. Developing production - ready Unity applications for Meta Quest and optimizing XR experiences.
Software Engineer in PNC's Technology organization focusing on API testing and Selenium automation. Involves designing software solutions and collaborating with cross - functional teams.
Software Developer Internship at HP, applying classroom learnings to real - world challenges. Join a diverse team focused on technology innovation and development.
Software Engineer developing tools to enhance developer productivity at Nordstrom. Collaborating with teams to design and implement DevOps solutions in a hybrid environment.
Principal Engineer optimizing standard cell libraries for Intel's foundry customers. Collaborating with teams to enhance performance, power and area on leading edge process nodes.