- Own, maintain, and improve production data pipelines across the Coffee Platform.
- Build and maintain ingestion pipelines for internal data sources, including business-generated Excel/CSV files, reports, and other internal datasets.
- Maintain integrations with external data sources, including exchanges, APIs, web-scraped data, and weather providers.
- Proactively monitor pipeline execution, investigate failures, perform root-cause analysis, and implement corrective actions.
- Own pipeline health and observability reporting through platform centralized monitoring, including data freshness, failures, ownership, dependencies, and data quality.
- Design and maintain robust database structures, SQL workflows, schemas, indexes, and data models.
- Maintain orchestration and scheduling of production workflows with appropriate logging and alerting.
- Support data scientists and researchers with reliable, production-ready datasets and pipelines.
- Maintain clear data lineage and documentation and contribute to overall data governance standards.
- Support database administration and production incident investigation where required.
- 3+ years of professional Data Engineering experience.
- Strong Python development skills, particularly for ETL/data pipelines, APIs, data processing, automation, and production workflows.
- Strong SQL skills, including database/data-model design and optimization.
- Experience with workflow orchestration and scheduling tools such as Jenkins, Airflow, Azure Data Factory, or equivalent.
- Experience implementing pipeline monitoring, logging, alerting, and data-quality controls.
- Strong experience with Git-based version control and collaborative development workflows, including branching, pull requests, and code reviews.
- Databricks experience.
- MongoDB / NoSQL experience, particularly MongoDB Atlas.
- MongoDB administration and operational troubleshooting experience, including the ability to interpret Atlas/database logs, investigate incidents, understand database operations, and identify root causes of unexpected data changes or failures.
- Experience managing weather-data pipelines, including APIs, gridded/geospatial data, historical datasets, and scheduled ingestion.
- Experience with Azure/cloud-based data infrastructure.
Diversity & Inclusion
LDC is driven by a set of shared values and high ethical standards, with diversity and inclusion being part of our DNA. LDC is an equal opportunity employer committed to providing a working environment that embraces and values diversity, equity and inclusion.
LDC encourages diversity, supports local communities and environmental initiatives. We encourage people of all backgrounds to apply.
Sustainability
Sustainable value is at the heart of our purpose as a company.
We are passionate about creating fair and sustainable value, both for our business and for other value chain stakeholders: our people, our business partners, the communities we touch and the environment around us
What We Offer
We provide a dynamic and stimulating international environment, which will stretch and develop your abilities and channel your skills and expertise with outstanding career development opportunities in of the largest and most solid private companies in the world.
We offer
- A workplace culture that embraces diversity and inclusivity
- Opportunities for Professional Growth and Development
- Employee Recognition Program
- Employee Wellness Programs - Confidential access to certified counselors for employee and eligible family members, along with monthly wellness awareness sessions.
- Certified Great Place to Work
