Job Description

Job Description

The Databricks & Data Science Platform Administrator will play a crucial role in the design, implementation, and management of enterprise-level data science and analytics platforms. This position requires expertise in platform administration, security, and operational continuity to support a diverse data ecosystem that accelerates business insights and innovation.

Your primary responsibility will be to ensure the Databricks environment is optimized for performance, security, and compliance in collaboration with data scientists, engineering teams, and information technology stakeholders. You will oversee the full lifecycle of platform operations, from provisioning and configuration to monitoring and troubleshooting, guaranteeing a seamless experience for end-users across the organization.

In addition to ongoing platform management, you will lead initiatives on data governance, enforcing access controls, regulatory standards, and auditing procedures to protect organizational data assets. Your role is vital in fostering a secure, reliable, and scalable environment that enables data-driven decision-making and supports advanced analytics and machine learning workloads.

Key functions include configuring workspaces, managing clusters and jobs, implementing security controls such as role-based access control (RBAC) and identity management integration (IAM), and maintaining comprehensive documentation of all procedures and system changes. Continuous collaboration with cross-functional teams will ensure alignment with enterprise data strategy and facilitate adoption of new data technologies and governance frameworks.

͏

Role Summary

The Databricks & Data Science Platform Administrator is charged with the end-to-end stewardship of the organization's premiere data analytics platform. This responsibility encompasses ensuring that the platform is robust, secure, scalable, and aligned with corporate data initiatives and compliance requirements.

This role acts as a vital liaison between data science divisions, development teams, and IT infrastructure groups, enabling smooth operation of data pipelines, machine learning model lifecycle management, and self-service analytics capabilities. Your work will directly influence the speed and quality of insights delivered across multiple business units.

Primary Areas of Responsibility:

• Platform Administration & Operations: Hands-on administration of Databricks workspaces, including management of clusters, jobs, and configurations to ensure consistent operational excellence.
• User and Access Management: Handling user provisioning, group management, and enforcing access controls through RBAC and integration with corporate IAM solutions to uphold security best practices.
• Platform Performance & Monitoring: Proactively monitoring system health, managing platform upgrades, and swiftly addressing incidents or user issues to maintain high availability and performance.
• Governance, Compliance & Security: Implementing data governance frameworks such as Unity Catalog, ensuring strict adherence to data security policies, audit trails, regulatory compliance, and meticulous management of metadata and data lineage.

This is a strategic role requiring technical depth, communication skills, and a continuous improvement mindset to support evolving business needs and technology landscapes.

͏

Requirements Gathering and Analysis

Collaborate with clients and internal stakeholders through workshops and detailed discussions to elicit and refine business process requirements. Translate these into technical specifications that drive software development priorities and ensure alignment with desired outcomes.

Development and Configuration

Design, develop, and deliver high-quality code for the assigned modules, integrating seamlessly with existing systems and platforms. Apply best practices in coding, version control, and documentation to facilitate maintainability and scalability.

Testing and Quality Assurance

Lead comprehensive unit testing and participate in user acceptance testing (UAT) to validate that modules meet functional and performance criteria. Address defects and continuously refine deliverables in coordination with quality assurance teams.

Implementation Support

Assist in deploying new software applications and integrating platforms within enterprise environments, ensuring system stability and minimal disruption to end users.

Extensive Documentation

Maintain detailed and clear documentation of project specifications, code annotations, design diagrams, workflows, and status reports. Utilize visual tools like flowcharts and UML diagrams to enhance communication and knowledge sharing within teams.

͏

Stakeholder Engagement and Cross-Functional Collaboration

Work closely with diverse teams spanning data science, software engineering, security, and IT operations to understand evolving requirements and provide technical guidance. Facilitate open communication and transparency to ensure project milestones are achieved and standards are upheld.

Provide proactive support for solution integration, compatibility validation, and performance optimization. Drive collaborative problem-solving sessions to resolve issues and identify opportunities for platform enhancements.

Champion continuous learning and knowledge transfer across teams, fostering a collaborative environment that thrives on shared expertise and innovation.

͏

Core Competencies and Skills

• Client Centricity: Dedicated to understanding and meeting the needs of internal and external clients, providing responsive and effective solutions.
• Passion for Results: Committed to achieving high-quality outcomes that support organizational goals and customer satisfaction.
• Execution Excellence: Demonstrates meticulous attention to detail and follows through rigorously on tasks and projects.
• Collaborative Working: Thrives in team environments, valuing diverse perspectives and contributing actively to group success.
• Learning Agility: Adapts quickly to new technologies and methods, constantly enhancing personal and team capabilities.
• Problem Solving and Decision Making: Employs analytical thinking to identify root causes and implement effective solutions.
• Effective Communication: Articulates complex technical information clearly and persuasively to a broad range of audiences.

Mandatory Technical Skills:

• Proficient in Databricks platform administration and data engineering practices.
• Experience with data governance tools such as Unity Catalog.
• Competence in identity and access management integration (e.g., IAM, RBAC).
• Strong scripting and coding ability to support automation and platform configuration.
• Knowledge of data lineage, metadata management, and compliance requirements.

Join Wipro Technologies in our Data Analytics & AI Service Line as a Developer L3 (DataBricks Admin) within the Technology Services division focused on Data Transformation. We foster an environment of constant reinvention where your professional growth and contributions shape the future of digital transformation.