Senior Engineer – Data Engineering (Databricks) - Contractor
Jobgether
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
7,661 open engineering roles across 771 companies are on ApplySarthi right now, most of them in Bengaluru (377), Hyderabad (140), Chennai (78).
- Software Engineering Manager - SecurityThought Machine
- Senior Safety Engineer, Systems Safety & Automation EngineeringAmazon
- Software/Firmware Engineering InternMarvell
- Product Design (Mechanical Engineering) Co-OpSamsara
- Director of Solution Engineering, EMEAJFrog
What engineering roles keep asking for: Python (21%), AWS (20%), Observability (14%), System design (14%), CI/CD (12%) — counted across their open postings here.
Airflow jobs · BigQuery jobs · CI/CD jobs · Data warehousing jobs
Jobgether has 4,042 open roles listed here.
- Accounts Payable Executive
- Accounts Receivable Specialist
- Acquisition Analyst
- AI Engineer
- AI/ML Engineer, Internal Platforms
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for engineering roles keep coming back to Python, AWS, Observability, System design. Practise those questions before you sit with Jobgether.
Questions you are likely to be asked
- Why do you want to join Jobgether?
- What is your experience with Databricks? Tell me one thing you learned the hard way.
- Tell me about a time the data was messy or wrong. What did you do?
- How would you explain your model's result to someone who is not technical?
- What would you check first if a model's accuracy dropped after going live?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Senior Engineer – Data Engineering (Databricks) - Contractor at Jobgether interview free →Accountabilities:: Design, develop, and implement scalable data engineering solutions using the Databricks platform and modern cloud-based data lakehouse architectures. Build and maintain advanced data pipelines leveraging Databricks technologies, including Delta Lake, Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, and Delta Uniform (Iceberg). Design and optimize robust, YAML configuration-driven data pipelines supporting batch, micro-batch, and real-time streaming ingestion and processing. Implement efficient data ingestion and transformation workflows using tools and technologies such as Databricks Auto Loader and Apache Spark. Develop complex job scheduling and workflow orchestration solutions using Databricks Jobs and Workflows or external orchestration platforms such as Apache Airflow and dbt. Collaborate with solution architects to design and implement components of enterprise data platform architectures aligned with client requirements. Participate in technical design sessions, break down complex development requirements into manageable tasks, and deliver high-quality solutions within agreed timelines. Develop and implement data quality, pipeline auditing, monitoring, and observability frameworks using native Databricks capabilities and complementary tools. Optimize data processing performance, pipeline reliability, scalability, and resource utilization across distributed computing environments. Work with big data technologies and cloud data warehouses to integrate and manage large-scale enterprise datasets. Implement DevOps and CI/CD practices using Databricks Asset Bundles, including automated testing, validation, and deployment processes. Contribute to infrastructure automation and platform management initiatives using Infrastructure as Code (IaC) tools. Explore and integrate emerging technologies in data engineering, AI, and machine learning to improve platform capabilities and operational efficiency. Participate in Databricks Center of Excellence (CoE) initiatives, contributing reusable frameworks, solution accelerators, technical standards, and engineering best practices. Stay up to date with new Databricks platform features, emerging industry trends, and modern data engineering methodologies. Share technical knowledge, collaborate with fellow engineers, and contribute to a culture of innovation and continuous learning. Requirements: At least 5 years of professional experience in data engineering, including a minimum of 2 years of hands-on experience designing and developing data pipelines using Databricks. Strong practical expertise with Databricks platform capabilities, particularly Delta Lake, Delta Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog. Proven experience designing and implementing scalable, YAML configuration-driven data pipelines for batch, micro-batch, and streaming data processing. Strong understanding of modern data ingestion patterns and practical experience with tools such as Databricks Auto Loader. Experience developing complex data orchestration and workflow management solutions using Databricks Jobs and Workflows, Apache Airflow, dbt, or comparable tools. Knowledge of data quality management, pipeline auditing, monitoring, and observability frameworks, with exposure to tools such as Great Expectations, Collibra, and dbt. Strong experience with big data processing technologies, particularly Apache Spark, Presto, and Amazon EMR. Familiarity with cloud data warehousing platforms such as Amazon Redshift, Snowflake, and Google BigQuery. Advanced SQL skills, including stored procedures, query optimization, and complex data transformations. Strong programming skills in Python, PySpark, Java, or other object-oriented programming languages. Experience implementing DevOps and CI/CD pipelines, particularly using Databricks Asset Bundles, automated testing, and deployment validation. Familiarity with Infrastructure as Code (IaC) practices and tools such as Terraform is a strong advantage. Exposure to NoSQL databases and container management technologies. Understanding of AI and machine learning technologies, including MLflow, prompt engineering, and modern AI agentic workflows. Databricks Data Engineer Associate and/or Professional certifications are highly desirable. Demonstrated experience delivering multiple Databricks-based data engineering projects in enterprise environments. Strong analytical and problem-solving abilities, with the capacity to break down complex technical challenges into effective solutions. Excellent communication and collaboration skills, with the ability to work effectively with solution architects, developers, and cross-functional stakeholders. Self-motivated and proactive, with the ability to work independently while contributing to broader engineering initiatives. Curious mindset and enthusiasm for exploring new technologies, sharing knowledge, and continuously improving technical expertise. Ability to manage multiple development priorities and deliver reliable, high-quality solutions with minimal supervision. Benefits: Competitive contractor compensation aligned with technical expertise and experience. Fully remote working arrangement within India. Initial contract duration of 6 months or longer. Opportunity to work on large-scale enterprise data engineering and cloud transformation projects. Exposure to advanced Databricks technologies and modern lakehouse architectures. Opportunity to collaborate with experienced solution architects and multidisciplinary engineering teams. Participation in a dedicated Databricks Center of Excellence. Opportunities to develop reusable data engineering frameworks and innovative technical solutions. Exposure to leading cloud platforms, distributed processing technologies, and modern AI/ML tools. Continuous professional development through hands-on experience with emerging technologies and complex technical challenges. Opportunity to contribute to impactful data and analytics initiatives for leading global organizations.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- AI Trainers Network - MalteseJobgether
- AI Video EditorJobgether
- AI Trainers Network - GreekJobgether
- AI Architect / AI engineering leadJobgether
- AI Trainers Network - EnglishJobgether
- Artificial Intelligence (AI) TechnicianJobgether
- Analytical Chemistry Specialist - Freelance AI Trainer ProjectJobgether
- AI Trainers Network - ArabicJobgether
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on lever · posted 2026-11-16. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.