Data Engineer - Spark

Role Overview Chargebee is looking for a skilled Data Engineer to join its Data Platform team in Chennai. In this role, you will design and maintain robust data pipelines that power internal analytics, business intelligence, and customer-facing data capabilities. You will work closely with product engineers, data analysts, and platform teams to ensure data is ingested, processed, and served efficiently at scale. Key Responsibilities - Design, build, and maintain data ingestion and processing pipelines across multiple layers of the data platform - Develop and optimize ETL and ELT workflows to enable scalable and reliable data processing - Build and maintain distributed data processing jobs using Apache Spark and similar frameworks - Work with streaming and queue-based systems such as Apache Kafka to handle event-driven data - Design efficient data models and transformations to support analytics and product use cases - Ensure high standards of data reliability, integrity, and performance across the platform - Troubleshoot and resolve issues in production data pipelines and distributed systems - Collaborate with data analysts, product teams, and engineers to address evolving data requirements - Participate in code reviews, design discussions, and agile development ceremonies - Document data pipelines, architecture decisions, and platform workflows Required Qualifications - Bachelor's degree in Computer Science, Mathematics, Engineering, or a related technical field, or equivalent practical experience - 1 to 2 years of experience working with data processing workflows and pipelines - Hands-on experience with distributed computing systems such as Apache Spark - Strong knowledge of SQL and relational database concepts - Proficiency in at least one programming language such as Python, Java, or Scala - Experience with relational databases such as PostgreSQL or MySQL - Familiarity with Git workflows in collaborative development environments - Experience working in an Agile development environment Why Join Us At Chargebee, you will be part of a fast-growing fintech and SaaS company solving real-world data challenges at scale using modern data technologies. This is an exciting opportunity to build foundational data infrastructure that directly impacts both internal teams and customer-facing products.

- 1-2 years of experience in data engineering or data pipeline development - Hands-on experience with Apache Spark for distributed data processing - Strong SQL skills and knowledge of relational database systems - Proficiency in Python, Java, or Scala - Experience with Apache Kafka or similar streaming and queue-based systems - Familiarity with ETL and ELT workflow design and optimization - Experience with relational databases such as PostgreSQL or MySQL - Working knowledge of Git and collaborative development practices - Experience working in Agile development environments - Good-to-have: Experience with AWS cloud ecosystem - Good-to-have: Knowledge of open table formats such as Delta Lake, Apache Iceberg, or Apache Hudi - Good-to-have: Understanding of data warehouse and data lake architectures

- Opportunity to work on large-scale distributed data systems - Exposure to modern data technologies including Spark, Kafka, and cloud-based infrastructure - Collaborative and fast-paced work environment - On-site role at Chargebee's Chennai office - Work with a high-growth global SaaS and fintech company