Data Engineer - Spark

Role Overview Chargebee is looking for a skilled Data Engineer to join the Data Platform team in Chennai. In this role, you will design, develop, and maintain scalable data pipelines that power internal analytics, business intelligence, and customer-facing data features. You will work closely with product engineers, analysts, and platform teams to ensure data is ingested, processed, and served efficiently at scale. Key Responsibilities - Design, build, and maintain data ingestion and processing pipelines across multiple layers of the data platform - Develop and optimize ETL and ELT workflows to enable scalable and reliable data processing - Build and maintain distributed data processing jobs using Apache Spark and similar frameworks - Integrate with streaming and queue-based systems such as Apache Kafka for event-driven data processing - Design efficient data models and transformations to support analytics and product use cases - Ensure high standards of data reliability, integrity, and performance across the platform - Troubleshoot and debug production data pipelines and distributed systems - Collaborate with analysts, product teams, and engineers to address evolving data requirements - Participate in code reviews, design discussions, and agile development processes - Document data pipelines, architecture decisions, and platform workflows Required Qualifications - Bachelor's degree in Computer Science, Mathematics, Engineering, or a related technical field, or equivalent practical experience - 1 to 2 years of experience working with data processing workflows and pipelines - Hands-on experience with distributed computing systems such as Apache Spark - Strong knowledge of SQL and proficiency in at least one programming language such as Python, Java, or Scala - Experience with relational databases such as PostgreSQL or MySQL - Familiarity with Git workflows in collaborative development environments - Good understanding of data structures, data models, and relational database concepts - Experience working in an Agile development environment Why Join Us Chargebee offers a collaborative, fast-paced environment where you will work on real-world data challenges at scale using modern distributed systems and cloud-based infrastructure. This is a great opportunity to grow your career while contributing to a data platform that directly supports both internal teams and customer-facing products.

- Apache Spark and distributed data processing - Strong SQL skills - Python, Java, or Scala programming - ETL and ELT pipeline development - Apache Kafka or queue-based streaming systems - Relational databases such as PostgreSQL or MySQL - Git version control and collaborative workflows - Data modelling and transformation design - AWS ecosystem experience (preferred) - Knowledge of open table formats such as Delta Lake, Iceberg, or Hudi (preferred) - Data warehouse and data lake architecture understanding (preferred)

- Opportunity to work on large-scale distributed data systems - Exposure to modern cloud-based data infrastructure on AWS - Collaborative and agile team environment - Work on both internal analytics and customer-facing data products