Job Description
Role Purpose
TThis role requires deep technical expertise in Starburst, ETL processes, data warehousing, and big data frameworks, with a plus for candidates who bring AI/ML capabilities to the table. Should have a hands-on Data Engineer who can work in prime Data Engineering like Starburst, ETL, Databases, Python, Data Warehouse, Data Lake, Apache Spark etc
Required Skills & Experience:
6+ years of hands-on experience in Data Engineering within the IT industry.
Deep knowledge of Starburst and policy management tools like Apache Ranger.
Strong SQL skills and experience with data modeling (relational and dimensional).
Familiarity with platforms like Apache Spark, Databricks.
Strong proficiency in Python for data processing and scripting.
Expertise in ETL development, SQL, and working with relational and non-relational databases.
Solid understanding of Data Warehousing and Data Lake architectures.
Familiarity with cloud platforms and distributed computing environments.
Key Responsibilities:
Design, develop, and maintain scalable ETL pipelines and data workflows.
Work with structured and unstructured data across various databases and data lakes.
Implement and optimize data solutions using tools such as Apache Spark, Starburst, and Python.
Build and manage data warehouses and data lakes to support analytics and reporting.
Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.
Ensure data quality, integrity, and security across all data platforms.
Contribute to performance tuning and optimization of data processing systems.
Preferred Qualifications:
Experience with AI/ML workflows, particularly in LLMs, RAG (Retrieval-Augmented Generation), and Agent-based architectures.
Exposure to building intelligent data pipelines that support machine learning models.
Knowledge of modern data governance and data cataloging tools.
Soft Skills:
Strong problem-solving and analytical skills.
Excellent communication and collaboration abilities.
Ability to work independently in a remote setup and manage time effectively.
͏
Deliver
| No. | Performance Parameter | Measure |
| 1. | Continuous Integration, Deployment & Monitoring of Software | 100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan |
| 2. | Quality & CSAT | On-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation |
| 3. | MIS & Reporting | 100% on time MIS & report generation |
Experience: 5-8 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.