Apache Spark Scala Data Engineer Architect

Role Overview HCLTech is seeking experienced Data Engineers and Architects with strong expertise in Apache Spark and Scala to join their engineering team. You will lead technical teams in developing and optimizing large-scale big data solutions while applying modern Agile methodologies. This is a full-time permanent position for professionals with 8 to 13 years of experience in data engineering and big data technologies. Key Responsibilities - Lead and manage technical teams on complex big data projects involving Apache Spark and Scala - Develop, optimize, and maintain large-scale data processing and analytics solutions - Perform performance tuning, optimization, and debugging within big data environments - Apply Agile software development lifecycle methodologies to project execution - Collaborate with cross-functional teams to design and implement data architecture solutions - Analyze and resolve complex technical challenges with critical problem-solving skills Required Qualifications - Bachelor's or Master's degree in Computer Science, Information Technology, or related field - 8 to 13 years of professional experience in data engineering or related roles - Strong proficiency in Apache Spark, Scala, and Python for large-scale data processing - Proven experience with big data concepts, frameworks, and tools such as Hadoop and Kafka - Demonstrated leadership and team management capabilities on complex projects - Solid understanding of Agile methodologies and software development lifecycle - Excellent communication and interpersonal skills for cross-functional collaboration - Experience in performance tuning and optimization of big data systems Why Join Us Join HCLTech, a leading IT services and consulting organization where you can work with cutting-edge big data technologies and lead talented technical teams. Enjoy the opportunity to work on complex, large-scale data projects that drive business impact while advancing your career in a collaborative and innovative environment.

- Apache Spark proficiency - Scala programming expertise - Python programming skills - SQL knowledge - Leadership and team management experience - Big data frameworks experience (Hadoop, Kafka) - Performance tuning and optimization skills - Agile methodology experience - Problem-solving abilities - Communication and interpersonal skills - Bachelor's or Master's in Computer Science or IT - Relevant certifications in Apache Spark, Scala, or Python are advantageous