AWS Data Platform Engineer

Accountabilities: Design, build, and manage cloud data platforms on AWS using services such as AWS Glue, EMR, Lake Formation, EC2, and CloudWatch. Develop, maintain, and optimize data pipelines using Python, PySpark, and advanced SQL. Implement open table formats, including Apache Hudi or Apache Iceberg, to support modern data platform architectures. Automate infrastructure provisioning and deployment processes using Terraform and infrastructure-as-code best practices. Implement data validation, cleansing, security, governance, and monitoring mechanisms to maintain data quality and reliability. Monitor and optimize data platform performance, scalability, and resource utilization. Collaborate with engineering teams and stakeholders to deliver dependable, secure, and scalable data products. Contribute to modern data architecture initiatives and continuous improvements in cloud data engineering practices. Requirements Demonstrated hands-on experience designing and developing data platforms using AWS services, particularly AWS Glue, EMR, and Lake Formation. Strong programming skills in Python and practical experience developing production-grade data engineering solutions. Advanced SQL skills and experience building and optimizing complex data pipelines. Experience using Apache Spark and PySpark for distributed data processing. Hands-on experience implementing Apache Hudi or Apache Iceberg in data platforms. Practical knowledge of Terraform and infrastructure-as-code principles for cloud infrastructure automation. Understanding of data security, governance, quality assurance, monitoring, and performance optimization. Advanced English proficiency at C1 level, with excellent written and verbal communication skills. Ability to collaborate effectively with distributed engineering teams in a fully remote environment. Experience in financial services or investment banking, real-time data processing with Apache Flink or Kafka Streams, and event-driven architectures is considered an advantage. Benefits Competitive compensation: For Brazil, the advertised gross monthly salary is up to R$27,000 BRL , subject to the applicable compensation terms. Fully remote work: Work remotely from Brazil. International collaboration: Opportunity to work with engineering teams in a distributed environment. Technical impact: Contribute to scalable AWS data platforms and modern cloud data engineering initiatives.