Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering

As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with strategic customers to build, optimize, and run custom generative AI models in production alongside Basic qualifications: - Experience in professional, non-internship software development - Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design - 3+ years of non-internship professional software development experience - 2+ years of experience working in an Agile, startup, or rapidly scaling environment - Hands-on experience with generative AI technology, such as LLMs, vision-language models, or speech models - Experience with AI tools: eval frameworks, agent tooling, RAG pipelines, and prompt engineering - Experience communicating technical concepts to both technical and non-technical audiences Preferred: - Bachelor's degree in computer science or equivalent - Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations - Experience with large-scale distributed training of LLMs on multi-node accelerator clusters, using frameworks such as PyTorch FSDP2, TorchTitan, Megatron-LM/Megatron Core, NeMo, DeepSpeed, or NeuronX Distributed - Experience with LLM post-training, including SFT, DPO, RLHF, and RL with verifiable rewards or multi-turn agentic RL, using frameworks such as Miles, slime, verl, NeMo-RL, OpenRLHF, SkyRL, or TRL - Experience optimizing model training or inference for latency, throughput, or cost, using serving engines such as SGLang, vLLM, or TensorRT-LLM, on AWS Trainium or Inferentia (Neuron SDK), on AWS services such as SageMaker AI, SageMaker HyperPod, or EKS, or by writing custom kernels (CUDA, Triton, NKI) - Experience deploying and operating ML models in customer production environments, working with teams that build and scale end-to-end production systems Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( https://www.amazon.jobs/en/privacy_page ) to know more about how we collect, use and transfer the personal data of our candidates. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.