At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

As a Distributed Training Engineer, you will own the scaling and optimization of training workloads across multi-GPU and multi-node environments. You will provide the necessary systems fluency to handle massive datasets and models, ensuring peak performance through mixed-precision and distributed coordination.

What You'll Do

- Implement and optimize distributed training strategies using PyTorch DDP, FSDP, and DeepSpeed.
- Profile training performance and GPU utilization using Nvidia ecosystem tools like Nsight.
- Design mixed-precision and memory-optimization workflows to maximize training throughput and reduce memory footprint.
- Solve complex coordination and synchronization issues across multi-node clusters using CUDA and Triton.
- Scale massive models through parameter sharding, pipeline parallelism,



and efficient data sharding techniques.
- Partner with machine learning research teams to align infrastructure capabilities with evolving model scaling requirements.

What We Are Looking For

- 4+ years of experience in Machine Learning Engineering or Distributed Systems.
- Proven expertise in distributed training frameworks like PyTorch DDP, FSDP, or DeepSpeed.
- Hands-on experience with Nvidia GPU profiling tools such as Nsight.
- Strong proficiency in CUDA programming and performance optimization for multi-node clusters.
- Experience with inference optimization tools like Triton or TensorRT.
- Advanced proficiency in English.

How we do make your work (and your life) easier:
- 100% remote work (from anywhere).
- Excellent compensation in USD or your local currency if preferred
- Hardware and software setup for you to work from home.
- Flexible hours: create your own schedule.
- Paid parental leaves, vacations, and national holidays.
- Innovative and multicultural work environment: collaborate and learn from the general Top 1% of talent.
- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact! Apply now!

📌 Distributed Training Engineer - Remote Work (Perú)
🏢 Bairesdev
📍 Perú