Lead DevOps Engineer (Kafka nodes, Apache Spark, Java/Python)

Company: Tech Mahindra
Location: Sunnyvale
Posted on: May 9, 2025

Job Description:

Scam Alert : To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers. Learn More..
Job Description
Lead DevOps Engineer (Kafka nodes, Apache Spark, Java/Python)

• 
  
• Skill Set : Kafka, DevOps, microservices, Java/Python, Apache Spark
  
  Job Title: Lead DevOps Engineer
  Location: Sunnyvale/Austin
  Salary Range: $110,000 to 130,000/Annual & for Vendors: $70-75/hr CTC Max
  The DevOps engineer for this role must be experienced in a development environment, coordinating builds, deployment of applications, and resolving incidents. Use Python/Bash etc., to automate build scripts. Should have deployed Kafka Nodes, Apache Spark, Java/Python-based applications along with MongoDB/Cassandra/Snowflake on distributed cloud environments, utilizing microservices to scale applications based on load.
  Hiring Manager comments: Should have some Program and Release Management experience, in addition to being a CI/CD DevOps engineer. Must coordinate well with the team. Good exposure to deploying in distributed Cloud/Cluster environments with technologies such as Kafka Nodes, AWS, Kubernetes, Apache Spark, Snowflake, Java/Python, React, and Bare Metal Cube Continuous Deployment. Experience in load management for scaling microservices and servers is essential.
  Job Summary
  As a DevOps Engineer, you will build and maintain infrastructure and deployment pipelines, ensuring reliability, scalability, and performance of distributed data and microservices systems. Leverage deployment expertise in AWS, Kubernetes, Bare Metal Cube, Apache Kafka, Apache Spark, Snowflake, Java/Python, React to automate and optimize workflows. Focus on scalable microservices, servers, and alert systems based on real-time load.
  Responsibilities
  
  
• Design, build, and maintain scalable infrastructure on AWS using Kubernetes (EKS) & Bare Metal Cube.
  
• Implement and manage CI/CD pipelines.
  
• Deploy and manage Apache Kafka, Apache Spark, and Snowflake clusters.
  
• Monitor systems using tools like Prometheus, Grafana, and ELK stack.
  
• Troubleshoot infrastructure and deployment issues.
  
• Collaborate with development teams for smooth deployments.
  
• Optimize system performance and reliability.
  
• Implement alert systems for scaling microservices and servers based on load.
  
• Manage deployment of microservices in Java or Python, including React front-ends.
  
• Ensure security best practices are followed.
  
• Manage Bare Metal Cube deployment environment.
  
  Qualifications
  
  • 
    
  • Bachelor's or Master's in Computer Science, Engineering, or related field.
    
  • Extensive DevOps experience.
    
  • Strong expertise in AWS services, especially Kubernetes (EKS).
    
  • Proven experience with Kafka, Spark, Snowflake.
    
  • Experience with CI/CD tools, especially Bare Metal Cube.
    
  • Scripting skills in Python or Bash.
    
  • Experience with containerization (Docker, Kubernetes).
    
  • Monitoring and logging tools expertise (Prometheus, Grafana, ELK).
    
  • Deployment experience with Java/Python and React.
    
    Regards, Tech Mahindra.
    "Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions."
    #J-18808-Ljbffr

Keywords: Tech Mahindra, Santa Rosa , Lead DevOps Engineer (Kafka nodes, Apache Spark, Java/Python), IT / Software / Systems , Sunnyvale, California