Software Engineer III- Data Engineer(Python, Databricks and AWS)

Job Description: As a Data Engineer III at JPMorganChase within the Corporate Sector you serve as a seasoned member of an agile team to design and deliver trusted data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and architectures that support the entire data engineering lifecycle. You will work closely with cross-functional teams to deliver scalable solutions that drive business insights and enable advanced analytics, including AI initiatives. Key Responsibilities: Design, develop, and optimize end-to-end data pipelines using Databricks, Apache Spark, and AWS cloud services. Implement and manage workflow orchestration with Airflow. Integrate and process streaming data using Kafka. Uses enterprise-authorized AI capabilities within the work environment to accelerate data pipeline/design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements. Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions. Ensure data quality, integrity, and security across all stages of the data lifecycle. Develop and maintain ETL processes, data models, and data warehouses. Write efficient, maintainable code in Python and SQL for data processing and analysis. Applies reuse-first, AI-assisted practices to strengthen SDLC-quality routines for data pipelines (e.g., test generation and control validation), ensuring traceability/auditability and alignment to resiliency and security expectations. Support AI and machine learning initiatives by preparing and engineering data for model development and deployment. Monitor, troubleshoot, and optimize data workflows for performance and reliability. Stay current with industry best practices and emerging technologies in data engineering and AI. Required qualifications, capabilities, and skills Formal training or certification on data engineering concepts and 3+ years applied experience Proven experience in the full lifecycle of data engineering, from ingestion to production. Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity. Ability to review and validate AI-assisted outputs (e.g., query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements. Strong hands-on expertise with Databricks, Apache Spark, AWS (S3, Redshift, Lambda, etc.), Airflow, and Kafka. Proficient in Python programming and SQL for data manipulation and analysis. Experience with data modeling, ETL development, and data warehousing. Familiarity with AI/ML workflows and supporting data pipelines for machine learning. Certifications in relevant technologies (AWS, Databricks, Spark, etc.) are highly desirable. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities. Preferred qualifications, capabilities, and skills Experience with containerization (Docker, Kubernetes). Knowledge of data governance and compliance standards. Exposure to big data tools and frameworks. Ability to work in a fast-paced, agile environment.