Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable

data pipelines and ETL workflows

.

• Build and optimize data integration processes using tools such as

SSIS and Apache Airflow

.

• Develop and maintain data workflows using

Azure Data Factory (ADF)

.

• Write optimized and complex

SQL queries

for data extraction, transformation, and analysis.

• Use

Python

for data processing, automation, and pipeline development.

• Design and maintain

data warehouse

solutions and data models.

• Develop efficient

data models

to support BI, reporting, and analytics requirements.

• Integrate data pipelines with

Power BI

and other business intelligence platforms.

• Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.
• Automate repetitive data engineering processes and improve overall pipeline efficiency.
• Work with cloud-based data infrastructure across

Microsoft Azure and/or AWS

.

• Ensure data quality, consistency, security, and availability across different systems.
• Collaborate with data analysts, BI developers, software engineers, and business stakeholders.

• Design, develop, and maintain scalable data pipelines and ETL workflows
• Build and optimize data integration using SSIS and Apache Airflow
• Develop and maintain data workflows using Azure Data Factory (ADF)
• Write optimized and complex SQL queries for extraction, transformation, and analysis
• Use Python for data processing, automation, and pipeline development
• Design and maintain data warehouse solutions and efficient data models
• Integrate data pipelines with Power BI and other BI platforms
• Work with cloud-based data infrastructure on Microsoft Azure and/or AWS
• Monitor, troubleshoot, and optimize pipelines for reliability and performance
• Ensure data quality, consistency, security, and availability
• Collaborate with data analysts, BI developers, engineers, and business stakeholders