CareerScanCareerScan
JobsCompanies
BlogContact
For Employers
Sign InRegister Free
CareerScanCareerScan

India's verified job platform connecting candidates directly with employers. 100% free applications with instant ATS resume scoring.

Chennai, Bengaluru & Hyderabad
Jobs by location
Jobs in ChennaiJobs in BengaluruJobs in HyderabadJobs in PuneJobs in Mumbai
Popular roles
AR Caller JobsHealthcare Medical CodingReact / Full Stack DeveloperData & Power BI AnalystCustomer Support Executive
Top companies
TCS CareersCognizant JobsInfosys OpeningsApollo HospitalsOmega Healthcare
Career services
Free ATS Resume CheckerAI Resume Builder (Free)AI Job MatcherSalary Guide & BenchmarksJob Alerts on WhatsApp
© 2026 CareerScan India. All rights reserved.256-bit SSL encrypted & verified
Back to all jobs
  1. Home
  2. Jobs
  3. Data Engineering Consultant - PySpark, ADF
UnitedHealth Group
UnitedHealth Group

Data Engineering Consultant - PySpark, ADF

Hyderabad, Telangana, India
3+ years exp
Contract
Posted 5d ago
0 views
Actively Hiring Urgent Opening Direct 1-Click Apply

Check Your Resume Match Score

Scan your resume against ATS criteria for this Data Engineering Consultant - PySpark, ADF role at UnitedHealth Group.

Apply for this position

Apply on Company Website
Notice a broken link or wrong info?

Job Description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start

Caring. Connecting. Growing together.

As a Data Engineering Consultant within our technology organization, you will lead the design, development, and modernization of legacy applications using PySpark and Databricks. You will drive the migration of legacy processes to cloud-native data engineering frameworks and define technical architecture, standards, and best practices for scalable data solutions. In this role, you will collaborate with architects, product owners, and business stakeholders to translate business requirements into technical solutions while mentoring data engineers and ensuring robust data governance, security, and quality across data platforms.

  • Primary Responsibilities:
  • Lead the design, development, and modernization of legacy applications using PySpark and Databricks
  • Define technical architecture, standards, and best practices for scalable data solutions
  • Mentor and guide data engineers, ensuring high-quality delivery and technical excellence
  • Drive migration of legacy processes to cloud-native data engineering frameworks
  • Design and optimize large-scale data pipelines for performance, reliability, and scalability
  • Collaborate with architects, product owners, and business stakeholders to translate requirements into technical solutions
  • Ensure data governance, security, quality, and compliance across data platforms
  • Lead code reviews, technical design discussions, and production support activities
  • Implement CI/CD, automation, and monitoring to improve operational efficiency
  • Evaluate emerging technologies and drive continuous improvement in data engineering capabilities
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
  • Required Qualifications:
  • Undergraduate degree or equivalent practical experience
  • 5+ years of data engineering and ETL/ELT pipeline development experience
  • 4+ years of hands-on experience with PySpark, Apache Spark, and Databricks
  • 4+ years of experience with Advanced SQL, data modeling, and performance tuning
  • 3+ years of experience with Cloud Data Platform Architecture, including Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF)
  • 3+ years of experience working with Delta Lake and Lakehouse Architecture
  • 3+ years of experience with CI/CD, Git, and DevOps practices in a data engineering environment
  • Technical leadership experience, including leading code reviews and technical design discussions
  • Preferred Qualifications:
  • Experience with Apache Kafka or streaming technologies
  • Experience with Azure Synapse Analytics
  • Experience with Infrastructure as Code (IaC) using Terraform
  • Experience with Machine Learning Pipeline Integration
  • Experience with Kubernetes and Containerization
  • Experience delivering projects in an Agile/Scrum environment
  • Healthcare data domain knowledge
  • Familiarity with Data Governance and Data Quality Frameworks
  • Solid Python programming skills

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Key Requirements & Skills

  • Undergraduate degree or equivalent practical experience
  • 5+ years of data engineering and ETL/ELT pipeline development experience
  • 4+ years of hands-on experience with PySpark, Apache Spark, and Databricks
  • 4+ years of experience with Advanced SQL, data modeling, and performance tuning
  • 3+ years of experience with Cloud Data Platform Architecture, including Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF)
  • 3+ years of experience working with Delta Lake and Lakehouse Architecture
  • 3+ years of experience with CI/CD, Git, and DevOps practices in a data engineering environment
  • Technical leadership experience, including leading code reviews and technical design discussions
  • Experience with Apache Kafka or streaming technologies
  • Experience with Azure Synapse Analytics
  • Experience with Infrastructure as Code (IaC) using Terraform
  • Experience with Machine Learning Pipeline Integration
  • Experience with Kubernetes and Containerization
  • Experience delivering projects in an Agile/Scrum environment
  • Healthcare data domain knowledge
  • Familiarity with Data Governance and Data Quality Frameworks
  • Solid Python programming skills

Frequently Asked Questions

How to apply for Data Engineering Consultant - PySpark, ADF at UnitedHealth Group?

Click the "Apply on Company Website" button on this page to submit your application directly on the employer's official portal.

What is the salary for this role?

Salary details will be discussed during the interview.

What experience is required?

3+ years of experience is required.

Is this position still open?

Yes, currently active and accepting applications.

ApplicationActively Hiring
Apply on Company Website
Broken link or expired?
UnitedHealth Group

UnitedHealth Group

About Optum | Our Mission, Values & Team Skip to Data Use Notice Skip to main content Personal Business Language English English Set my location Update your location to get information specific to your area. Enter a ZIP code or city and state Error Please enter valid city or state Update Location Use my current location Site Logo Customer service Sign in Patients, members & account holders Providers & organizations Employers Brokers & consultants Search Health care Financial Pharmacy Main menu Health care We provide affordable and personalized care How can we help? Find care Fi

Visit Company Website

More jobs at UnitedHealth Group

Consultant Business Systems (Hardware Asset Management (HAM), ServiceNow)

Gurgaon, Haryana, India

AI/ML Engineer

Bangalore, Karnataka, India

Senior Full Stack Engineer - Fullstack, Phthon,UI, Devops

Bangalore, Karnataka, India

Share this Opening

Job Alerts for data_engineering

Receive email alerts whenever new data_engineering roles in Hyderabad are posted.

Set Free Alert →

Similar Openings

Explore related active roles in data_engineering

View all
UrgentActively Hiring
Momentum Financial Services Group
Lead Data Engineer
Momentum Financial Services Group Verified
10+ years
Salary not disclosed
Hyderabad (Remote)
data_engineeringFull-timeRemote
Posted 18h ago
Apply Now
UrgentActively Hiring
aecom2
Data Engineer
aecom2 Verified
0-2 Yrs
₹111/mo
Bristol, 3 RIVERGATE, gb
data_engineeringFull-time
Posted 18h ago
Apply Now
UrgentActively Hiring
Magnals
Lead Data Engineer
Magnals Verified
5+ years
₹10.7L – ₹12.1L/mo
Remote
data_engineeringFull-timeRemote
Posted 18h ago
Apply Now

Data Engineering Consultant - PySpark, ADF

UnitedHealth Group · Hyderabad

Apply on Company Website