CareerScanCareerScan
JobsCompanies
BlogContact
For Employers
Sign InRegister Free
CareerScanCareerScan

India's verified job platform connecting candidates directly with employers. 100% free applications with instant ATS resume scoring.

Chennai, Bengaluru & Hyderabad
Jobs by location
Jobs in ChennaiJobs in BengaluruJobs in HyderabadJobs in PuneJobs in Mumbai
Popular roles
AR Caller JobsHealthcare Medical CodingReact / Full Stack DeveloperData & Power BI AnalystCustomer Support Executive
Top companies
TCS CareersCognizant JobsInfosys OpeningsApollo HospitalsOmega Healthcare
Career services
Free ATS Resume CheckerAI Resume Builder (Free)AI Job MatcherSalary Guide & BenchmarksJob Alerts on WhatsApp
© 2026 CareerScan India. All rights reserved.256-bit SSL encrypted & verified
Back to all jobs
  1. Home
  2. Jobs
  3. Data Engineer (Mid Level)-Orbit
Irth Solutions
Irth Solutions

Data Engineer (Mid Level)-Orbit

India
3+ years exp
Full-time
Posted 5d ago
1 views
Actively Hiring Urgent Opening Direct 1-Click Apply

Check Your Resume Match Score

Scan your resume against ATS criteria for this Data Engineer (Mid Level)-Orbit role at Irth Solutions.

Apply for this position

Apply on Company Website
Notice a broken link or wrong info?

Job Description

About Irth Solutions

Irth Solutions is a leading provider of cloud-based SaaS software for damage prevention, asset integrity, stakeholder engagement and land management, helping energy, utility, telecom, and infrastructure companies protect their critical network infrastructure. With nearly three decades of industry experience, Irth serves customers across North America and continues to expand its platform with new data-driven and AI-powered capabilities.

Data Engineer – Insights (AI/ML)

  • Location: Remote – India

  • Department: Insights (AI/ML)

  • Reports to: Data Platform & Analytics Manager

About the Role

Irth is building a modern, multi-cloud, enterprise-grade data estate—a unified

Databricks-based data platform

that centralizes data across Irth’s products and cloud environments, including

AWS, Azure, and GCP

.

As a

Data Engineer

, you will play a hands-on implementation role, working closely with the

Senior Data Architect

to bring the enterprise data platform vision to life.

You will design and develop data pipelines based on established architectural patterns, implement data quality and governance controls, build

Delta Lake and medallion architecture

solutions, and help operationalize the new data platform.

This is an excellent opportunity for a

mid-level Data Engineer

looking to deepen their expertise in Databricks, Apache Spark, cloud data engineering, and modern lakehouse architecture while working in a multi-cloud enterprise environment.

Key Responsibilities

1. Data Pipeline Development – Primary Responsibility

  • Build, maintain, and enhance data ingestion pipelines across

AWS, Azure, and GCP

, following architecture and engineering patterns established by the Senior Data Architect.

  • Develop both

batch and streaming pipelines

using:

  • Databricks Workflows
  • Apache Spark / PySpark
  • SQL
  • Delta Live Tables
  • Databricks Lakeflow components
  • Implement

Bronze → Silver → Gold

medallion architecture patterns for ingestion, transformation, cleansing, and standardization.

  • Implement

Change Data Capture (CDC)

and Slowly Changing Dimensions (

SCD Type 1 and Type 2

).

  • Handle schema evolution and changing source-system structures.
  • Implement data validation, reconciliation, and quality rules as part of pipeline processing.
  • Build reusable and maintainable pipeline components following established engineering standards.

2. Platform & Storage Implementation

  • Configure and maintain

Delta Lake

storage structures, tables, schemas, partitions, and optimization routines.

  • Apply Delta Lake performance and maintenance practices, including:

    • OPTIMIZE
    • Z-ORDER
    • VACUUM
    • Appropriate partitioning and file-management strategies
  • Assist with implementation of metadata, cataloging, and lineage standards using

Unity Catalog

.

  • Support integration between cloud storage platforms and Databricks, including:

    • Amazon S3 → Databricks
    • Azure Storage → Databricks
    • Google Cloud Storage → Databricks
  • Assist with implementation of scalable storage and processing patterns defined by the Data Architect.

3. Data Governance, Quality & Compliance Enablement

  • Implement automated

data-quality checks, profiling, validation, and monitoring

in accordance with enterprise governance standards.

  • Apply data-quality rules at appropriate stages of the Bronze, Silver, and Gold layers.
  • Implement

RBAC policies, security controls, and data-classification tags

defined by the enterprise governance model.

  • Support implementation of metadata and lineage mapping across

Unity Catalog and Microsoft Purview

.

  • Help ensure datasets are properly documented, classified, governed, and discoverable.
  • Support remediation of data-quality and governance issues identified through monitoring or reviews.

4. Orchestration, Automation & Operational Support

  • Build, schedule, monitor, and maintain production workflows using:

    • Databricks Workflows
    • Delta Live Tables
    • Azure Data Factory (ADF)
    • Other approved orchestration tools
  • Contribute to

CI/CD pipelines

for data-engineering code, including source control, automated testing, deployment, and environment management.

  • Support DEV → QA → PROD promotion processes.
  • Monitor production pipelines and respond to failures and data-quality issues.
  • Troubleshoot failed jobs, investigate root causes, and support pipeline recovery.
  • Perform performance tuning across Spark jobs, SQL workloads, Delta tables, and data pipelines.
  • Participate in operational improvements that increase pipeline reliability, scalability, and cost efficiency.

5. Collaboration & Documentation

  • Work directly with the

Senior Data Architect

to translate architecture designs and technical standards into actionable implementation tasks.

  • Participate in architecture reviews, technical design discussions, coding reviews, and engineering standards meetings.

  • Collaborate with Data Scientists, ML Engineers, Analysts, Product teams, and other engineering stakeholders to understand data requirements.

  • Document:

    • Data pipelines
    • Data flows
    • Data dictionaries
    • Transformation logic
    • Data-quality rules
    • Test cases
    • Job schedules
    • Operational procedures
  • Maintain clear and accurate technical documentation to support platform adoption, troubleshooting, and future development.

  • Provide implementation feedback to the Data Architect and identify opportunities to improve platform patterns, tooling, and developer experience.

Role Scope

This is primarily an

implementation-focused Data Engineering role

. The Senior Data Architect will establish the overall platform architecture, standards, and design patterns; the Data Engineer will translate those patterns into reliable, production-ready pipelines and platform capabilities.

The role provides an opportunity to gain deeper hands-on experience with

Databricks, Spark, Delta Lake, Unity Catalog, cloud data platforms, data governance, and multi-cloud lakehouse engineering

while contributing to a strategic enterprise data platform.

Requirements

Qualifications

Required Qualifications

3–5 years of experience

in Data Engineering, ETL development, or cloud data platform engineering.

  • Hands-on experience with

Databricks, Apache Spark, PySpark

, or other distributed data-processing technologies.

  • Strong proficiency in

SQL

, including structured data transformation, joins, aggregations, and performance-aware query development.

  • Experience working with at least major cloud platform, with

Microsoft Azure preferred

; AWS and/or GCP experience is also valuable.

  • Understanding of core data-engineering concepts, including:

    • Data modeling
    • Data quality
    • Schema evolution
    • Data validation
    • Pipeline monitoring and troubleshooting
  • Basic understanding of data-security practices, including:

    • Role-Based Access Control (RBAC)
    • Encryption
    • Credential and secret management
    • Secure access to cloud and data-platform resources

Preferred Qualifications

  • Hands-on or working knowledge of

Delta Lake, medallion architecture, and modern lakehouse best practices

.

  • Experience with metadata, cataloging, and governance platforms such as:

    • Unity Catalog
    • Microsoft Purview
    • AWS Glue Data Catalog
    • Similar enterprise metadata and data-governance tools
  • Experience with workflow orchestration and scheduling technologies, such as:

    • Azure Data Factory (ADF)
    • Databricks Workflows
    • Apache Airflow
    • Databricks Jobs / DBX
    • Similar orchestration frameworks
  • Experience with

Git-based development, CI/CD, and DevOps practices

.

  • Knowledge or experience in or more of the following areas:

    • Geospatial/GIS data
    • BI semantic layers, particularly Power BI
    • Data preparation for AI/ML workloads
  • Relevant cloud or Databricks certifications, such as:

    • Databricks Data Engineer Associate
    • Microsoft Azure Data Engineer Associate (DP-203)
    • Equivalent cloud or data-engineering certifications

Nice-to-Have Qualifications

  • Understanding of

asset integrity management

concepts, including inspection data, risk scoring, corrosion tracking, defect management, and maintenance data as applied to pipeline or utility operations.

  • Previous experience working with or integrating

oil & gas, utility, infrastructure, or pipeline asset data

into enterprise data platforms.

  • Experience working with:

    • Pipeline and facility data
    • GIS/geospatial asset data
    • Inspection and maintenance records
    • Asset-risk datasets
  • Familiarity with

regulatory, compliance, and audit-reporting requirements

associated with pipeline, utility, or asset-integrity data.

Success Metrics

Success in this role will be measured by the engineer’s ability to reliably implement and operationalize the data-platform patterns established by the Data Architect

  • Key measures include: -

High-quality implementation

of ingestion, transformation, data-quality, and governance patterns defined by the Data Architect.

  • Reliable and maintainable pipelines supporting consistent

Bronze → Silver → Gold

data flows.

  • Strong adherence to

cataloging, metadata, lineage, security, and data-governance standards

.

  • Reduction in pipeline failures and production incidents through improved monitoring, testing, troubleshooting, and operational practices.
  • Continuous improvements in

pipeline performance, scalability, reliability, and maintainability

.

  • Clear and complete technical documentation covering pipelines, transformations, data-quality rules, and operational procedures.
  • Effective collaboration with the

Senior Data Architect, engineering teams, product teams, and business stakeholders

.

  • Demonstrated ability to take architecture guidance and translate it into

production-ready, scalable data-engineering solutions

.

Benefits

What We Offer

  • Be part of a

dynamic and growing company

that is well-respected in its industry.

Competitive compensation

based on experience and qualifications.

Health Insurance

coverage

Key Requirements & Skills

  • 3–5 years of experience in Data Engineering, ETL development, or cloud data platform engineering.
  • Hands-on experience with Databricks, Apache Spark, PySpark, or other distributed data-processing technologies.
  • Strong proficiency in SQL, including structured data transformation, joins, aggregations, and performance-aware query development.
  • Experience working with at least major cloud platform, with Microsoft Azure preferred; AWS and/or GCP experience is also valuable.
  • Understanding of core data-engineering concepts, including:
  • Basic understanding of data-security practices, including:
  • Hands-on or working knowledge of Delta Lake, medallion architecture, and modern lakehouse best practices.
  • Experience with metadata, cataloging, and governance platforms such as:
  • Experience with workflow orchestration and scheduling technologies, such as:
  • Experience with Git-based development, CI/CD, and DevOps practices.
  • Knowledge or experience in or more of the following areas:
  • Relevant cloud or Databricks certifications, such as:
  • Understanding of asset integrity management concepts, including inspection data, risk scoring, corrosion tracking, defect management, and maintenance data as applied to pipeline or utility operations.
  • Previous experience working with or integrating oil & gas, utility, infrastructure, or pipeline asset data into enterprise data platforms.
  • Experience working with:
  • Familiarity with regulatory, compliance, and audit-reporting requirements associated with pipeline, utility, or asset-integrity data.

Benefits & Perks

We Offer

  • Be part of a

dynamic and growing company

that is well-respected in its industry.

Competitive compensation

based on experience and qualifications.

Health Insurance

coverage

Frequently Asked Questions

How to apply for Data Engineer (Mid Level)-Orbit at Irth Solutions?

Click the "Apply on Company Website" button on this page to submit your application directly on the employer's official portal.

What is the salary for this role?

Salary details will be discussed during the interview.

What experience is required?

3+ years of experience is required.

Is this position still open?

Yes, currently active and accepting applications.

ApplicationActively Hiring
Apply on Company Website
Broken link or expired?
Irth Solutions

Irth Solutions

About Irth | Enhancing Resilience with Data-Driven Insights User Summit Is Now Irthbound! Join Us in New Orleans. Learn More > Industries Industries Electric Utilities Oil and Gas Telecommunication Government Construction Gas Utilities Renewables Transportation Contract Locators Mining Irth has consistently helped our company save millions of dollars a year by vastly reducing the numbers of crews we need to dispatch to our 811 locates. VP OPERATIONS Fortune 500 Telecommunications Damage Prevention Damage Prevention 811 Ticket Management Enhance safety, reliability, and resilience with the m

Visit Company Website

More jobs at Irth Solutions

Cloud Infrastructure & Platform Specialist (Databricks + AWS + Azure) (Mid-Level

India

Data Architect (Mid-Level)

United States

Data Engineer

Quebec, Canada

Share this Opening

Job Alerts for data_engineering

Receive email alerts whenever new data_engineering roles in India are posted.

Set Free Alert →

Similar Openings

Explore related active roles in data_engineering

View all
UrgentActively Hiring
Momentum Financial Services Group
Lead Data Engineer
Momentum Financial Services Group Verified
10+ years
Salary not disclosed
Hyderabad (Remote)
data_engineeringFull-timeRemote
Posted 1d ago
Apply Now
UrgentActively Hiring
aecom2
Data Engineer
aecom2 Verified
0-2 Yrs
₹111/mo
Bristol, 3 RIVERGATE, gb
data_engineeringFull-time
Posted 1d ago
Apply Now
UrgentActively Hiring
Magnals
Lead Data Engineer
Magnals Verified
5+ years
₹10.7L – ₹12.1L/mo
Remote
data_engineeringFull-timeRemote
Posted 1d ago
Apply Now

Data Engineer (Mid Level)-Orbit

Irth Solutions · India

Apply on Company Website