Title: Azure Databricks Platform Engineer
Job Description
Role Purpose
The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists.
͏
Azure Platform Engineer (Databricks):
Platform Infra:
Create new databricks workspaces (premium, standard, serverless) and clusters including right sizing
Drop unused workspaces
Delta Sharing: Work with enterprise teams on connected data (data sharing)
User Management
Create new security groups and add/delete users
Assign Unity Catalog permissions to respective groups/teams
Manage Quantum Collaboration platform – sandbox for enterprise teams for ideation and innovation.
Troubleshooting Issues in Databricks
Investigate and diagnose performance issues or errors within Databricks.
Review and analyze Databricks logs and error messages.
Identify and address problems related to cluster configuration or job failures.
Optimize Databricks notebooks and jobs for performance.
Coordinate with Databricks support for unresolved or complex issues.
Document common troubleshooting steps and solutions.
Develop and test Databricks clusters to ensure stability and scalability.