Pyspark Lead
Position Overview
We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.
Required Skills and Qualifications
- Experience: 7+ years of professional experience in PySpark development.
- Technical Skills:
- Strong proficiency in PySpark
- Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing.
- Proven experience in building and optimizing complex ETL pipeline using PySpark
- Experience with various spark components
- Expertise in Spark Batch for large-scale data processing and analytics.
- Experience with Spark Streaming for real-time data processing and streaming pipelines.
- Familiarity with distributed computing concepts and big data frameworks.
Experience: 5-8 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention. Come to Wipro. Realize your ambitions. Applications from people with disabilities are explicitly welcome.