Data Engineer – Data Pipelines

**About Us: ** BDIPlus, a US-based leading transformation Consulting & Customer Data Platform (CDP) company, is dedicated to delivering cutting-edge capabilities and solutions that foster the development of enduring competitive advantages. Our innovative solutions showcase our unparalleled proficiency in technology and our profound domain expertise within the Financial Services and Insurance sectors. By synergizing our unmatched technical skills with a comprehensive grasp of each client’s institutional landscape and distinctive areas for improvement, we empower them to convert data into actionable and well-organized information. This facilitates precise decision making, increased efficiency, and rampant business growth. **About the Role** We are looking for a Data Engineer who can build scalable and reliable data pipelines supporting analytics, reporting, and AI/ML workloads. **Key Responsibilities** * Design and develop batch and real-time data pipelines. * Build ETL/ELT workflows using Spark and dbt. * Manage Avro schemas and Schema Registry implementations. * Design and maintain Medallion Architecture (Bronze, Silver, Gold layers). * Ensure data quality, reliability, and performance across platforms. * Collaborate with data architects, analysts, and product teams. * Support CI/CD and automation initiatives for data platforms. **Required Skills** * 3+ years of experience in Data Engineering. * Strong hands-on experience with Apache Spark. * Experience building transformations using dbt. * Knowledge of Avro serialization and Schema Registry. * Experience implementing Medallion Architecture. * Strong SQL and Python skills. **Our Purpose and Culture:** At BDIPlus, our mission is to help enterprises utilize their resources more efficiently, implement effective information management, and empower them by enabling richer insights and intelligence. We are driven by a single purpose: empower the technology transformation. We are passionate about creating foundational technology platforms for enterprise data and information management. Our employees are at the heart of the work we do at BDIPlus. We are committed to encouraging and celebrating innovation, creativity, and hard work among our team members. **Working at BDIPlus offers:** * A diverse, fun, highly intelligent, and innovative team. * Provident Fund * A competitive salary and an annual bonus. * Standard time off, sick leave, and holidays. * An environment where creative thinking is encouraged, and innovation drives everything we do.