Data Engineer

Data Engineer

• Location: Pune

• Experience: 5–9 Years

• Employment Type: Full-Time

Job Summary

We are looking for an experienced

Data Engineer

to join our team in Pune. The ideal candidate will have strong hands-on experience in building, deploying, and automating scalable data pipelines and data solutions. You will work on end-to-end data ingestion, processing, data modeling, visualization, and dashboarding solutions while collaborating with global customers and cross-functional teams.

The role requires strong expertise in

Databricks, Java, SQL, Spark/PySpark

, data modeling, and cloud technologies, preferably

Azure

.

Key Responsibilities

• Design, develop, and implement scalable

data pipelines and data solutions

.

• Build end-to-end

data ingestion, transformation, and processing pipelines

.

• Deploy and automate data pipelines and dashboards for customer implementations.
• Develop and maintain

data models, schemas, and data processing workflows

.

• Work with distributed data processing technologies such as

Apache Spark/PySpark

.

• Develop solutions using

Databricks

for large-scale data processing.

• Build and optimize dashboards and data visualizations using

Splunk, Grafana, Power BI, Tableau

, or similar tools.

• Develop and maintain data-driven services using

Java

and SQL.

• Work with structured and semi-structured data formats including

JSON, XML, and Avro

.

• Deploy applications and data services using

Docker and Kubernetes

.

• Work with cloud platforms, preferably

Microsoft Azure

.

• Design and implement batch and streaming data solutions using technologies such as

Kafka

.

• Ensure data quality, monitoring, reliability, and performance of data pipelines.
• Collaborate with international, cross-functional teams to understand requirements and deliver customer-focused solutions.
• Take ownership of projects from

solution design and development through deployment and client handover

.

• Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement.
• Communicate effectively with customers, stakeholders, and internal technical teams.

Required Skills & Experience

• Bachelor's or Master's degree in

Computer Science, Information Technology

, or a related field.

5–9 years of experience

in Data Engineering, data pipelines, or data solutions.

• Strong hands-on experience with

Databricks

.

• Strong programming experience in

Java

.

• Strong proficiency in

SQL

and data modeling.

• Hands-on experience with

Apache Spark / PySpark

.

• Experience with data visualization tools such as

Splunk, Grafana, Prometheus, Power BI, or Tableau

.

• Good knowledge of

Splunk SPL

is an advantage.

• Experience working with

JSON, XML, Avro

, or similar data schemas.

• Experience with

Docker and Kubernetes

.

• Experience with cloud services, preferably

Microsoft Azure

.

• Knowledge of

Kafka or other streaming platforms

is a plus.

• Understanding of

data quality, monitoring, and validation

.

• Strong analytical, problem-solving, and troubleshooting skills.
• Excellent communication skills in

English

.

Good to Have

• Experience working with real-time/streaming data pipelines.
• Knowledge of

Kafka and event-driven architectures

.

• Experience with data quality frameworks and monitoring solutions.
• Experience working in

Agile/Scrum

environments.

• Experience working with international customers or distributed teams.

Why Join Us?

• Work on innovative

data intelligence and analytics solutions

.

• Opportunity to work with

global customers and multidisciplinary teams

.

• Exposure to modern technologies including

Databricks, Spark, Azure, Kafka, Docker, Kubernetes, and Splunk

.

• Be part of an Agile environment focused on innovation, ownership, and continuous improvement.

Thanks,

Renuka

• Bachelor's or Master's degree in Computer Science, IT, or related field
• 5–9 years of experience in Data Engineering, data pipelines, or data solutions
• Strong hands-on experience with Databricks
• Strong programming experience in Java
• Strong proficiency in SQL and data modeling
• Hands-on experience with Apache Spark / PySpark
• Experience with data visualization tools (Splunk, Grafana, Prometheus, Power BI, Tableau)
• Experience with JSON, XML, Avro, or similar data schemas
• Experience with Docker and Kubernetes
• Experience with cloud services, preferably Microsoft Azure
• Understanding of data quality, monitoring, and validation
• Strong analytical, problem-solving, and troubleshooting skills
• Excellent communication skills in English
• Good knowledge of Splunk SPL
• Knowledge of Kafka or other streaming platforms
• Experience with real-time/streaming data pipelines
• Knowledge of Kafka and event-driven architectures
• Experience with data quality frameworks and monitoring solutions
• Experience working in Agile/Scrum environments
• Experience working with international customers or distributed teams