Data Scientist

# Data Engineer ## Company Overview Zap (a Finance Buddha group company) is a fintech data platform at the intersection of credit intelligence and lending distribution. We operate a hybrid B2C/B2B/agent-channel lending model, process hundreds of millions of records across a Snowflake data warehouse, and power the lending journeys of 160M+ unique financial profiles. Our tech stack runs on AWS, GitHub, Snowflake, and a Salesforce-anchored CRM. ## Job Summary The Data Engineer will be responsible for managing end-to-end data pipelines that enable the organization to harness its data efficiently. This role involves ingesting raw data from various sources, transforming it into a clean format within our Snowflake data warehouse, and ensuring data governance and quality. The Data Engineer will work closely with the CTO, backend engineers, and business analysts to improve current data processes and architecture. ## Responsibilities - Design, build, and operate inbound data pipelines that ingest data from various sources, including AWS RDS, DynamoDB, SFTP, and Excel sheets. - Implement a Bronze-Silver-Gold Medallion architecture in Snowflake, ensuring schema design, DDL, and lineage documentation are clear and managed. - Build reverse ETL flows to push datasets from Snowflake back to operational databases and app-layer stores. - Author and maintain dbt models for data transformation and implement data quality tests and schema contracts. - Manage DAG-based orchestration for pipeline runs and instrument pipelines for proper logging and anomaly detection. - Handle data governance processes, ensuring compliance with regulatory requirements regarding PII data. ## Qualifications - **Education**: B.Tech / B.E. / M.Tech in Computer Science, Information Systems, or equivalent. - **Experience**: 3-5 years in data engineering or analytics engineering roles. - **Technical Skills**: - Proficiency in Python (including libraries such as pandas, PySpark, or Polars). - Strong SQL skills with Snowflake-specific knowledge, including complex queries and optimization. - Experience with dbt for data transformations and lineage documentation. - Understanding of data structures and algorithms, especially in cloud data warehousing (Snowflake preferred). - Familiarity with source systems like RDS/PostgreSQL and DynamoDB. ## Preferred Skills - Backend fundamentals including REST API design and understanding microservice data flows. - Experience with orchestration tools like Apache Airflow or Prefect. - Knowledge of reverse ETL tools (Census, Hightouch). - Familiarity with MongoDB and its aggregation pipelines. - Understanding of streaming and Change Data Capture (CDC) tools like Debezium or Kafka. - Basic Infrastructure-as-Code skills with AWS or Azure. - Experience with BI tools, especially PowerBI. ## Experience Total experience of 3-4 years in data engineering or analytics engineering roles is required. ## Environment This position is based in Bengaluru, India, and follows a hybrid work model. ## Salary Estimated salary range is not specified. ## Growth Opportunities As a foundational role within the data engineering team, this position offers the opportunity to advance career prospects as the company evolves and scales. ## Benefits - Zap is dedicated to creating an inclusive environment for all employees as an equal opportunity employer. For inquiries, please contact: [email protected] | [zapdata.in](http://zapdata.in).