Sr Devops Engineer

ROLE OVERVIEW

We are seeking an experienced DevOps Engineer with strong data platform and SRE expertise to drive the design, implementation, and operational excellence of a modern client Data Platform. In this high-impact position, you will bridge the gap between infrastructure automation and modern data architecture. You will lead technical initiatives covering automated provisioning on Microsoft Azure, orchestrating scalable enterprise data workflows via Astronomer and dbt, and establishing robust continuous integration/continuous delivery (CI/CD) practices for all data engineering workloads.

PRIMARY RESPONSIBILITIES

Infrastructure as Code: Design, implement, and deploy ARM templates for automated Azure infrastructure provisioning and environment lifecycle management

• Azure Service Provisioning: Configure and maintain scalable Azure services, including Azure Functions, Event Bus, and Event Grid for event-driven data flows
• Snowflake Architecture & Security: Create and manage enterprise Snowflake accounts. Maintain role-based access control (RBAC), virtual warehouses, security policies, and performance tuning
• Workflow Orchestration: Deploy, configure, and operate Astronomer (Apache Airflow) for production-grade orchestration and scheduling of data pipelines.

dbt Pipeline Automation: Automate deployment pipelines for dbt projects, ensuring strict code quality standards, modularity, test coverage, and continuous delivery

• Secrets & Security Governance: Centralize and secure credential management using Azure Key Vault (AKV) for safe DevOps automation and runtime access across environments
• Secure File Transport: Architect and set up SFTP ingestion workflows utilizing a Bastion Host, ensuring secure landing into Azure Blob Storage containers.

CI/CD Engineering: Build, maintain, and optimize robust CI/CD deployment pipelines (e.g., Azure Repos / Pipelines) tailored for data engineering workloads

• Platform Observability: Monitor overall system health, data pipeline reliability, and platform performance using enterprise observability tooling (e.g., Prometheus, Grafana)
• Integration Management: Establish seamlessly integrated ecosystems connecting Snowflake with upstream and downstream systems, specifically dbt and Astronomer
• Architectural Collaboration: Partner closely with Data Engineers, Data Architects, and enterprise stakeholders to define infrastructure deployment standards, operational SLAs, and reliability targets
• Technical Documentation: Author and maintain comprehensive technical documentation covering infrastructure designs, CI/CD procedures, runbooks, and DevOps best practices.

Requirements

• 8+ years in a DevOps, SRE, or Data Infrastructure role within a data-centric enterprise environment.
• Azure Expertise: Strong practical experience with ARM templates, Azure Resource Manager, Azure Functions, Event Bus, and Event Grid.
• Airflow / Astronomer: Hands-on experience deploying and operating Astronomer or Apache Airflow in production.
• Data CI/CD: Proven track record building CI/CD pipelines specifically for data workloads (dbt, Airflow, schema migrations).
• Snowflake Mastery: Deep understanding of Snowflake RBAC, performance tuning, warehouse management, and ecosystem integrations.
• Containerization: Solid hands-on experience with Docker and managing containerized services in production environments.
• Secrets Security: Demonstrated experience managing secrets, keys, and certificates securely via Azure Key Vault (AKV).
• Data Ingestion Architecture: Practical exposure to secure SFTP-to-Blob integrations using Bastion host routing.
• Observability: Proficiency with monitoring and alerting tools such as Prometheus, Grafana, or cloud-native telemetry.

Nice to Have

• Exposure to dbt Cloud or advanced dbt Core deployment patterns.
• Familiarity with GitOps workflows and declarative infrastructure tools.
• Experience working in agile, cross-functional engineering teams.
• In-depth understanding of enterprise data governance and security frameworks.

• 8+ years in a DevOps, SRE, or Data Infrastructure role in a data-centric enterprise environment
• Strong practical experience with ARM templates, Azure Resource Manager, Azure Functions, Event Bus, and Event Grid
• Hands-on experience deploying and operating Astronomer or Apache Airflow in production
• Proven track record building CI/CD pipelines for data workloads (dbt, Airflow, schema migrations)
• Deep understanding of Snowflake RBAC, performance tuning, warehouse management, and ecosystem integrations
• Solid hands-on experience with Docker and managing containerized services in production
• Demonstrated experience managing secrets, keys, and certificates securely via Azure Key Vault (AKV)
• Practical exposure to secure SFTP-to-Blob integrations using Bastion host routing
• Proficiency with monitoring and alerting tools such as Prometheus, Grafana, or cloud-native telemetry
• Exposure to dbt Cloud or advanced dbt Core deployment patterns
• Familiarity with GitOps workflows and declarative infrastructure tools
• Experience working in agile, cross-functional engineering teams
• In-depth understanding of enterprise data governance and security frameworks