Job Description

Senior DevOps Engineer/Architect Azure Synapse and Databricks CI/CD Architect

Location: Preferably located near Nashville, TN or East Coast. US Candidates only

We are seeking an experienced Senior DevOps Engineer/Architect with 8 10 years of hands-on expertise in DevOps practices and CI/CD pipeline automation , specifically in Azure and Databricks environments . This role is critical to accelerating our transition to Databricks 2.0 , enabling seamless integration, reducing deployment cycle times, and establishing scalable, reliable DevOps pipelines for our data and AI platforms.

You will act as a technical leader and hands-on contributor , advising on best practices, identifying bottlenecks, and implementing robust CI/CD solutions that work efficiently in an Azure Databricks ecosystem.

Key Responsibilities:

1. Architect, design, and implement CI/CD pipelines for Azure Synapse, Databricks (including Databricks 2.0) on Azure, aligned with enterprise DevOps best practices.
2. Work closely with data engineering, data science, and infrastructure teams to streamline development, testing, and deployment workflows across Databricks environments.
3. Automate build, deploy, and release processes for Databricks notebooks, jobs, clusters, and other assets using tools like Azure DevOps, GitHub Actions, or equivalent.
4. Identify existing process bottlenecks and inefficiencies and proactively recommend improvements to reduce deployment and operational cycle times.
5. Serve as a trusted advisor on what works, what doesn't, and where to optimize in the DevOps lifecycle within a Databricks ecosystem.
6. Support cutover activities and production readiness validation for the Azure environment.
7. Establish monitoring, alerting, and logging practices for CI/CD pipelines and Databricks operations.
8. Provide mentorship and guidance to junior DevOps engineers or cross-functional team members.

Required Skills & Qualifications:

1. 8 10 years of professional experience in DevOps, automation engineering, or infrastructure as code roles.
2. Strong hands-on expertise in Azure DevOps, GitHub Actions, Jenkins, or equivalent CI/CD tools , with a track record of implementing DevOps pipelines in Azure cloud environments .

Job Tags

Similar Jobs