Job Summary
A company is looking for an Azure Databricks DevOps Lead to join their internal projects team in a full-time, remote role.
Key Responsibilities
- Architect and optimize Databricks Pipelines for large-scale data processing
- Manage Azure infrastructure components including Databricks, AKS/ACI, Storage, and Networking
- Implement monitoring and observability frameworks using Azure Monitor, Prometheus, and Grafana
Required Qualifications
- 9+ years in Data & Analytics
- 5+ years of DevOps experience with Azure & Databricks
- Strong expertise in Apache Spark, Delta Lake, and Azure Services
- Hands-on experience with Infrastructure-as-Code and scripting (Python, Bash)
- Familiarity with Data Governance, Security, and Cost Optimization