Job Description
Role Purpose
The purpose of this role is to facilitate application solutions by developing and reviewing module-level codes, creating replication patterns, performing root cause analysis to identify recurring issues and collaborating with internal and external stakeholders to ensure stable, well-documented deliverables that meet business objectives.
͏
Key Responsibilities
- Design, develop, test, and maintain scalable ETL/ELT pipelines using Azure Databricks, Apache Spark, PySpark, and SQL.
- Build and manage lakehouse architectures using Delta Lake, including data ingestion, transformation, validation, and optimization.
- Integrate data from relational databases, cloud storage, APIs, streaming platforms, and enterprise applications.
- Develop reusable notebooks, frameworks, and utilities aligned with coding and engineering standards.
- Optimize Spark workloads, cluster configurations, queries, and storage for performance and cost efficiency.
- Implement data quality checks, monitoring, logging, error handling, and operational support processes.
- Apply security and governance controls, including Unity Catalog, access permissions, data lineage, and secrets management.
- Collaborate with architects and business teams to translate requirements into robust technical solutions.
- Support CI/CD, version control, automated testing, deployment, troubleshooting, and production releases.
- Create and maintain technical documentation, data mappings, runbooks, and solution design artifacts.
Required Skills and Qualifications
- Strong hands-on experience with Azure Databricks, Apache Spark, PySpark, and Spark SQL.
- Proficiency in Python and advanced SQL, including query tuning and data transformation.
- Experience with Delta Lake, medallion architecture, and large-scale batch or streaming data processing.
͏
͏
͏
Mandatory Skills: DataBricks - Data Engineering .
Experience: 5-8 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.