Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)
Check Your Resume Match Score
Scan your resume against ATS criteria for this Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure) role at Annova Solutions.
Apply for this position
Job Description
About the Role
We are looking for a highly skilled Senior DevOps / Cloud Platform Engineer with 5–8 years of
experience
in designing, deploying, and managing secure, scalable, and highly available cloud infrastructure on AWS. The ideal candidate will have extensive hands-on
experience
with AWS, Amazon EKS, Kubernetes, CI/CD automation, infrastructure as code, and cloud security. This role also requires
experience
supporting AI workloads, including deploying and optimizing Large Language Models (LLMs) on CPU and GPU infrastructure. You will work closely with software engineers, AI/ML engineers, architects, and security teams to build and maintain cloud platforms that are secure, resilient, cost-efficient, and compliant with SOC 2 and HITRUST requirements.
Key Responsibilities
Cloud Infrastructure Design, deploy, and manage scalable, highly available, and secure AWS infrastructure. Architect cloud environments capable of supporting enterprise-scale applications and AI workloads. Optimize infrastructure for performance, reliability, scalability, and cost. Implement high availability, disaster recovery, backup, and failover strategies. Design multi-environment infrastructure (Development, QA, UAT, Production). Kubernetes & Container Platform Design, deploy, and manage production-grade Kubernetes clusters using Amazon EKS. Optimize Kubernetes workloads for high availability and resource utilization. Configure namespaces, RBAC, network policies, autoscaling, ingress controllers, and service meshes where applicable. Troubleshoot Kubernetes networking, scheduling, storage, and performance issues. Manage rolling deployments, blue-green deployments, and canary releases. AWS Services Strong hands-on
experience
with: Amazon EKS Amazon EC2 Auto Scaling Groups Elastic Load Balancer (ALB/NLB) Amazon S3 Amazon RDS AWS Lambda Amazon ECR Amazon CloudWatch IAM Route 53 VPC NAT Gateway Security Groups AWS WAF AWS Secrets Manager Systems Manager (SSM) CloudFront EventBridge SNS SQS CI/CD & DevOps Automation Design and implement end-to-end CI/CD pipelines. Automate application deployments across multiple environments. Implement infrastructure automation and GitOps practices. Build deployment strategies with minimal downtime. Integrate automated testing, security scanning, and quality gates into CI/CD pipelines.
Experience
with: GitHub Actions Jenkins GitLab CI ArgoCD Infrastructure as Code Develop and manage infrastructure using: Terraform AWS CloudFormation Kubernetes YAML AI & LLM Infrastructure Deploy and manage Small Language Models (SLMs) and Large Language Models (LLMs) in production environments. Build scalable inference infrastructure for AI workloads. Configure GPU-enabled Kubernetes nodes for model serving. Optimize CPU and GPU utilization for AI inference. Manage model deployments, scaling, versioning, and monitoring. Support vector databases and AI inference services. Work closely with AI/ML engineers to optimize model performance and infrastructure costs. Database Infrastructure & Performance Deploy and manage Amazon RDS databases. Monitor and optimize database performance. Implement backup, recovery, and replication strategies. Tune database configurations for high-throughput applications. Monitor slow queries, indexing strategies, and connection pooling. Collaborate with engineering teams on database performance optimization. Monitoring & Observability Implement monitoring and observability using: CloudWatch Prometheus Grafana ELK / OpenSearch Loki
Responsibilities
include: Infrastructure monitoring Application monitoring Log aggregation Alerting Capacity planning Incident response Security & Compliance Implement AWS security best practices. Design secure IAM policies and access controls. Manage secrets and encryption. Perform infrastructure hardening. Ensure compliance with: SOC 2 HITRUST HIPAA Participate in security audits and vulnerability remediation. Maintain audit logs and infrastructure documentation. Cost Optimization Continuously optimize AWS infrastructure costs. Right-size EC2 instances and EKS node groups. Optimize storage and networking costs. Implement Savings Plans and Reserved Instances where appropriate. Optimize GPU utilization for AI workloads. Monitor cloud spending and recommend cost-saving initiatives.
Requirements
Required
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. 5–8 years of hands-on
experience
in DevOps, Cloud Engineering, or Platform Engineering. Strong
experience
designing and managing production AWS environments. Extensive
Key Responsibilities Cloud Infrastructure Design, deploy, and manage scalable, highly available, and secure AWS infrastructure. Architect cloud environments capable of supporting enterprise-scale applications and AI workloads. Optimize infrastructure for performance, reliability, scalability, and cost. Implement high availability, disaster recovery, backup, and failover strategies. Design multi-environment infrastructure (Development, QA, UAT, Production). Kubernetes & Container Platform Design, deploy, and manage production-grade Kubernetes clusters using Amazon EKS. Optimize Kubernetes workloads for high availability and resource utilization. Configure namespaces, RBAC, network policies, autoscaling, ingress controllers, and service meshes where applicable. Troubleshoot Kubernetes networking, scheduling, storage, and performance issues. Manage rolling deployments, blue-green deployments, and canary releases. AWS Services Strong hands-on experience with: Amazon EKS Amazon EC2 Auto Scaling Groups Elastic Load Balancer (ALB/NLB) Amazon S3 Amazon RDS AWS Lambda Amazon ECR Amazon CloudWatch IAM Route 53 VPC NAT Gateway Security Groups AWS WAF AWS Secrets Manager Systems Manager (SSM) CloudFront EventBridge SNS SQS CI/CD & DevOps Automation Design and implement end-to-end CI/CD pipelines. Automate application deployments across multiple environments. Implement infrastructure automation and GitOps practices. Build deployment strategies with minimal downtime. Integrate automated testing, security scanning, and quality gates into CI/CD pipelines. Experience with: GitHub Actions Jenkins GitLab CI ArgoCD Infrastructure as Code Develop and manage infrastructure using: Terraform AWS CloudFormation Kubernetes YAML AI & LLM Infrastructure Deploy and manage Small Language Models (SLMs) and Large Language Models (LLMs) in production environments. Build scalable inference infrastr How to apply for Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure) at Annova Solutions? Click the "Apply via CareerScan" button on this page. What is the salary for this role? Salary details will be discussed during the interview. What experience is required? 6–8 years of experience is required. Is this position still open? Yes, currently active and accepting applications.Key Requirements & Skills
Frequently Asked Questions
Similar Openings
Explore related active roles in Customer Support
Senior DevOps/Cloud Platform Engineer (AWS| Kubernetes|AI Infrastructure)
Annova Solutions · Indore