Apache Spark Scala Data Engineer Architect

Role Overview HCLTech is hiring experienced Data Engineers and Architects specializing in Apache Spark and Scala for large-scale data processing and analytics solutions. This leadership role involves designing and optimizing big data architectures while managing technical teams on complex projects. You will drive innovation in data engineering practices and contribute to enterprise-level big data solutions across multiple domains. Key Responsibilities - Lead and manage technical teams on complex big data projects involving Apache Spark, Scala, and Python - Design, develop, and optimize large-scale data processing pipelines and analytics solutions - Perform performance tuning, optimization, and debugging within big data environments - Apply Agile software development lifecycle methodologies to project execution - Analyze technical challenges critically and implement effective solutions - Collaborate with cross-functional teams to deliver high-quality big data solutions - Mentor junior engineers and drive best practices in data engineering - Work with big data frameworks and tools such as Hadoop, Kafka, and related technologies Required Qualifications - Bachelor's or Master's degree in Computer Science, Information Technology, or related field - 8 to 13 years of professional experience in data engineering and big data technologies - Strong proficiency in Apache Spark, Scala, and Python for large-scale data processing - Proven experience with big data concepts, frameworks, and tools like Hadoop and Kafka - Demonstrated leadership and team management capabilities - Expertise in performance tuning and optimization techniques - Solid understanding of Agile software development lifecycle - Excellent problem-solving and communication skills - Relevant certifications in Apache Spark, Scala, or Python are advantageous Why Join Us Join HCLTech and work on cutting-edge big data solutions that impact global enterprises. Grow your career with industry leaders while contributing to innovative data engineering projects across diverse sectors.

- Apache Spark proficiency - Scala programming expertise - Python programming skills - Big Data technologies and frameworks - Hadoop and Kafka knowledge - SQL and database optimization - Leadership and team management experience - Agile methodology experience - Performance tuning expertise - Problem-solving abilities - Communication and interpersonal skills

- Permanent full-time employment - Competitive salary package - Leadership opportunities - Professional development - Work on enterprise-scale projects - Cross-functional collaboration - Flexible work arrangements