Job Description
This is a software engineering role focused on building production-grade data platform components.
You will design and operate services, APIs, and data pipelines in a CI/CD-driven environment.
This is NOT a notebook-driven or analytics-focused role
- Job Description: - Design, implement, and maintain secure, scalable and fault-tolerant data ingestion pipelines from a wide variety of source systems, including SAP, Salesforce, SharePoint, APIs, and (legacy) manufacturing platforms.
- Build and enhance production-grade metadata-driven data handling components and inbound-/outbound-interfaces.
- Own production data interfaces end-to-end.
- Develop reusable, version-controlled platform components, APIs, or data interfaces, following software engineering best practices (CI/CD, automated testing, version control, monitoring).
- Contributes to a global data engineering team delivering to all major business domains.
- Establish and maintain holistic data quality management, monitoring and reporting.
- Collaborates across business IT, cybersecurity, infrastructure, and architecture teams to ensure secure and sustainable delivery
- Main Tasks: - Design and implement fault-tolerant, observable data pipelines, including logging, alerting, and failure handling strategies.
- Build and maintain Python- or Scala-based extraction services (e.g., Debezium Server, custom APIs, rclone)
- Implement CDC, delta, and event-based patterns.
- Build and enhance push-based HTTP, Kerberos-authenticated custom data lake transfer delivery component.
- Integrate with systems such as Salesforce, SharePoint, and other API- or file-based endpoints.
- Establish, operate and troubleshoot extraction from SAP using tools like Theobald Extract Universal.
- Establish and maintain a web-accessible data catalog application as part of the data platform, focusing on backend services, metadata management, and integration with platform components.
- Integrate dataset discoverability, preview/exploration options, and lineage information using Unity Catalog as a backend metadata system.
- Design and implement structured access request workflows including request submission, approval chains, audit trail, and enablement triggers.
- Perform design reviews with Cybersecurity.
- Ensure documentation and compliance for all interfaces and data ingress points.
- Manage audit and traceability requirements.
- Collaborate closely with IT and business users to translate requirements into scalable technical patterns.
- Serve as technical escalation point for complex source integration.
- Define and implement a multi-layered data quality framework, including unit-level, integration-level, and cross-pipeline validation rules.
- Establish centralized and version-controlled storage of DQ rules, with integration into orchestration and CI/CD pipelines.
- Implement automatic DQ monitoring with severity levels (Critical, High, Medium, Low) and enable flagging, filtering, and quarantining logic at relevant stages of the pipeline.
- Collaborate with source system owners and business stakeholders to define meaningful and actionable DQ thresholds.
- Degree in Computer Science, Data Engineering, or a related field.
- 5–8 years in software development, with hands-on experience with inbound- and outbound data exchange interfaces, using a variety of technologies, such as APIs, CDC, managing endpoints.
- Hands-on experience with Scala / Java, Python, and advanced SQL, using Git for collaborative development and CI/CD methodologies.
- Experience building robust ingestion pipelines and ETL-jobs in a software engineering context.
- Track record with Azure or other hyperscaler resource management.
- Familiarity with data lake housing and data warehousing, Databricks and Azure knowledge is a plus.
- Comfortable working across geographies and time zones; collaborates effectively with global teams and enterprise stakeholders.
- Candidates with a strong backend/software engineering background (e.g. Java, Scala, distributed systems) who want to move into data platform engineering are highly encouraged to apply.
- NOT a fit if your experience is primarily:
- Notebook-based data processing (e.g. Jupyter, ad-hoc PySpark) without production deployment
- Dashboarding / analytics / BI tools
- SQL-only roles without software engineering experience
The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:
- Training opportunities
- Mobile and flexible working models
- Sabbaticals
and much more...
Sounds interesting for you? Click here to find out more.
Diversity, Inclusion & Belonging are important to us and make our company strong and successful. We offer equal opportunities to everyone - regardless of age, gender, nationality, cultural background, disability, religion, ideology or sexual orientation.
Ready to drive with Continental? Take the first step and fill in the application.
