Data Engineer

Hyderabad, Noida/ Chennai, India

Full-time

Posted 5d ago

1 views

Actively Hiring Urgent Opening Direct 1-Click Apply

Check Your Resume Match Score

Scan your resume against ATS criteria for this Data Engineer role at Techcarrot.

Apply for this position

Apply on Company Website

Notice a broken link or wrong info?

Job Description

- Build data ingestion and transformation frameworks - Collaborate with architects analysts BI developers and engineering teams - Create reusable components and frameworks - Deploy and manage ADF Databricks and Azure data components across environments - Design batch and near real time processing solutions - Design develop test and deploy data pipelines on Azure - Develop data transformation logic using Python PySpark and SQL - Implement CI CD for data engineering components with Azure DevOps - Implement data quality checks error handling logging and monitoring - Optimize Databricks workloads using Apache Spark and Delta Lake - Optimize SQL queries Spark jobs and data pipelines - Own data pipeline projects with minimal supervision - Perform data analysis, profiling, and validation - Prepare technical design and operational documentation - Process structured semi structured and unstructured data - Support production deployments and troubleshoot post production issues - Translate business and technical requirements into data engineering solutions - Troubleshoot pipeline failures performance issues and data discrepancies

Key Requirements & Skills

Build data ingestion and transformation frameworks
Deploy and manage ADF, Databricks, and Azure data components
Design batch and near real-time processing solutions
Develop data pipelines on Azure
Data transformation logic using Python, PySpark, and SQL
Implement CI/CD with Azure DevOps
Data quality checks, error handling, logging, and monitoring
Optimize Databricks workloads using Apache Spark and Delta Lake
Optimize SQL queries, Spark jobs, and data pipelines
Process structured, semi-structured, and unstructured data
Own data pipeline projects with minimal supervision
Support production deployments and troubleshoot issues
Translate business and technical requirements into data engineering solutions

Benefits & Perks

vision - Perform data analysis, profiling, and validation - Prepare technical design and operational documentation - Process structured semi structured and unstructured data - Support production deployments and troubleshoot post production issues - Translate business and technical requirements into data engineering solutions - Troubleshoot pipeline failures performance issues and data discrepancies

Frequently Asked Questions

How to apply for Data Engineer at Techcarrot?

Click the "Apply on Company Website" button on this page to submit your application directly on the employer's official portal.

What is the salary for this role?

Salary details will be discussed during the interview.

What experience is required?

This position is open to freshers and experienced candidates.

Is this position still open?

Yes, currently active and accepting applications.