Staff ML Engineer – AWS Trainium & SageMaker
Posted 1 day ago
The Role
We're looking for an engineer who can operate and train models on Amazon SageMaker running on AWS Trainium, AWS's custom silicon built specifically for large-scale model training. This isn't a role where you call an API and wait. You'll be walking up the stack: understanding what a training request actually looks like at the Trainium hardware and compiler level, then carrying that understanding all the way up through PyTorch training code and into a production SageMaker pipeline.
PyTorch is the backbone of this work. If you know the framework deeply and you're comfortable reasoning about how your code actually behaves on custom accelerator hardware rather than treating it as a black box, this role is built around that skill set specifically.
- Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute
- Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs)
- Diagnose training run issues that show up specifically because of the hardware, not just the model, distinguishing a data or code problem from a compiler or device-level one
- Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end
- Tune distributed training runs for throughput and cost on SageMaker's training infrastructure
- Work directly with client and internal engineering teams to scope and deliver real production training workloads, not experiments that stay in a notebook
- Strong, hands-on PyTorch experience, ideally including distributed or multi-device training
- Production experience with Amazon SageMaker for training and/or inference
- Comfort working close to the hardware layer: you understand device-specific compilation and can debug issues that are actually about the accelerator, not just the model
- AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you don't have it yet but have deep PyTorch and a track record of picking up new hardware targets fast, we want to talk to you
- Solid Python fundamentals and comfort operating in a client-facing, production engineering environment
Similar Engineer jobs(8)
Robots & Pencils is an Applied AI Engineering Partner that builds AI systems designed for enterprise velocity and measurable business impact. The company has earned recognition as an AWS Advanced Tier Services Partner, an AWS Pattern Partner, and an AWS Business Value Realization partner. Founded in 2009 on the belief that the best solutions emerge when technology meets human-centered design, the company's approach blends the sciences and humanities—the robots and pencils—combining elite, mature engineering talent with world-class UX design. Robots & Pencils delivers production-ready AI implementations in weeks versus the industry standard of months. Operating through small, senior teams rather than massive consulting organizations, the company serves enterprises across Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, Manufacturing and more. With delivery centers in Canada, the United States, Eastern Europe, and Latin America, Robots & Pencils has gained a reputation as the nimble alternative to traditional global systems integrators, combining the agility of a specialized partner with enterprise-grade delivery discipline and the craft that comes from people who care deeply about the work they do.
Key team members
Jobr aggregates jobs directly from company career portals — no middlemen. Our team applies on your behalf with AI-tailored resumes, reviewed by a human before submission.