Discover your dream Career
For Recruiters

Senior Data Engineer - Databricks & Data Modeling/Architecture

Metlife Pune, India
Posted 1 hour ago Permanent Competitive

Senior Data Engineer - Databricks & Data Modeling/Architecture

Metlife Pune, India
Senior Data Engineer - Databricks & Data Modeling/Architecture
Description and Requirements

Key Responsibilities

• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.

• Build data models - logical, physical, dimensional, and integration - and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.

• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files.

• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.

• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.

• Produce production-ready documentation - technical designs, runbooks, data dictionaries, and support handoffs - for maintainable, observable, cost-aware solutions.

• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.

• Azure Databricks & Apache Spark: 3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.

• Data modeling & integration: Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.

• AI-assisted engineering: Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.

• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.

• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.

Preferred Qualifications

• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.

• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.

• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.

• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.

• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.

As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.

Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
Job ID  21475
More jobs From Metlife
Metlife
Junior Data Engineer - Databricks & Data Modeling
Metlife
Pune, India
1 hour ago Full time Competitive
Metlife
Big Data Engineer II
Metlife
Pune, India
2 days ago Full time Competitive
Metlife
Senior Big Data Engineer - I
Metlife
Pune, India
2 days ago Full time Competitive
Metlife
Oracle HCM and Analytics Techno-Functional Analyst
Metlife
Pune, India
1 hour ago Full time Competitive
Metlife
Software Platform Engineer II
Metlife
Pune, India
1 hour ago Full time Competitive
Metlife
Oracle Benefits and HR Analytics Functional Analyst
Metlife
Pune, India
1 hour ago Full time Competitive
Metlife
Lead Big Data Engineer
Metlife
Pune, India
2 days ago Full time Competitive
Metlife
Sr. Software Dev Engineer Test I
Metlife
Pune, India
3 days ago Full time Competitive
Metlife
Software Platform Engineer II
Metlife
Pune, India
9 days ago Full time Competitive
Metlife
Assistant Manager - Technology Services
Metlife
Pune, India
10 days ago Full time Competitive

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
More Jobs Like This