Data Warehouse and ETL Developer
Role Summary
The Data Warehouse and ETL Developer is responsible for the architecture, development, and maintenance of the enterprise data warehouse. This role focuses on building high-performance data pipelines using Talend, optimizing MS SQL Server environments, and ensuring seamless data flow between QAD (ERP) and Salesforce (CRM) using Open Query and API-driven integrations.
Key Technical Responsibilities
Data Warehousing & Modeling
- Warehouse Architecture: Design and maintain scalable data warehouse structures (Star and Snowflake schemas) to support company-wide analytics.
- SQL Development: Write and optimize advanced T-SQL, including complex window functions and CTEs, to transform raw ERP data into actionable insights.
- Database Optimization: Manage indexing, partitioning, and execution plan analysis to ensure the data warehouse performs efficiently as data volume grows.
- Legacy Connectivity: Expertly utilize Open Query to extract data from Progress-based QAD/Mfg./Pro environments into SQL Server
.
ETL & Integration Development
- Talend Pipelines: Design, develop, and deploy Talend ETL jobs to automate the extraction, transformation, and loading of data from disparate sources.
- System Synchronization: Build and monitor critical integrations between QAD and Salesforce, ensuring customer, order, and inventory data remains synchronized.
- API Integration: Develop Talend workflows that utilize REST/SOAP APIs to push and pull data from cloud-based platforms like Salesforce.
- Error Handling: Implement robust logging and alerting frameworks within Talend to proactively identify and resolve data discrepancies.
Data Governance & Quality
- Data Cleansing: Develop automated scripts to identify and correct "dirty" data, ensuring high-quality inputs for Power BI dashboards.
- Documentation: Maintain detailed data lineage documentation, mapping source-to-target transformations for compliance and audit purposes.
Expertise and Attributes
- Core Stack: 5–7 years of experience with MS SQL Server and Talend (Open Studio or Data Management Platform).
- ERP/CRM Expertise: Strong functional understanding of QAD (Mfg /Pro) and Salesforce objects/tables.
- Technical: High proficiency in T-SQL, Open Query, Linked Servers, and JSON/XML data parsing.
- Environment: Experience working in a Medical Device or manufacturing environment is highly preferred.
- Problem Solving: Ability to troubleshoot complex data bottlenecks in a fast-paced, production-critical environment.
Education and Experience
- Bachelor’s degree in computer science, Data Science, or Information Technology.
- 5–7 years of dedicated experience in ETL development and Data Warehousing.
