Title: Technical Lead - L1
Title: Data Engineer with Feature Engineering
Duration:6+ months of Contract with possible extension of hire
Location: Remote
Brief Summary of Role:
As a Feature Engineering Specialist with expertise in Databricks, you will be pivotal in enhancing data quality and extracting meaningful features from raw data to boost the performance of predictive models on the Databricks platform. Collaborating closely with data scientists and machine learning engineers, you will leverage your deep understanding of Databricks’ unified analytics platform to streamline workflows and implement advanced feature engineering techniques.
Key Responsibilities:
- Data Analysis and Preprocessing on Databricks:
- Utilize Databricks for analyzing large datasets, identifying patterns, and correlations.
- Employ Databricks’ data handling capabilities to clean, normalize, and preprocess data efficiently.
- Address missing data, outliers, and anomalies using Databricks’ robust data processing tools.
- Feature Development in Databricks Environment:
- Design and engineer new features using Databricks’ collaborative notebooks and MLflow for tracking experiments.
- Innovate feature engineering strategies by leveraging Databricks’ Delta Lake for high-quality data storage.
- Apply feature selection and dimensionality reduction directly within the Databricks ecosystem to optimize model training.
- Collaboration and Strategy Implementation:
- Integrate feature engineering processes with Databricks’ collaborative and interactive workspace.
- Work closely with stakeholders to understand business objectives and leverage Databricks for scalable data solutions.
- Ensure seamless integration of feature engineering outputs with machine learning pipelines on Databricks.
- Testing and Optimization on Databricks:
- Leverage Databricks for setting up scalable testing frameworks to validate new features.
- Use Databricks’ capabilities to continuously refine features and optimize data pipelines for performance and efficiency.
- Documentation and Reporting:
- Document feature engineering processes and methodologies specifically tailored for Databricks.
- Utilize Databricks’ collaborative notebooks to share findings and reports with stakeholders effectively.
Minimum Requirements:
- Education:
- Bachelor’s degree in Computer Science, Statistics, Mathematics, or related field. Master’s degree preferred.
- Experience:
- Minimum of 3 years of experience in data-centric roles with a strong focus on analytics, data science, or machine learning.
- Proven experience with feature engineering, particularly within the Databricks platform.
- Technical Skills:
- Proficiency in Python, SQL, and Scala, with strong programming skills in at least one of these languages.
- Understanding of the Databricks platform, including Delta Lake, Databricks SQL, and MLflow.
- Familiarity with Apache Spark and its integration within Databricks.
- Analytical Skills:
- Robust analytical and problem-solving skills with a solid foundation in statistical methods.
- Expertise in translating business issues into data-driven solutions using Databricks.
- Communication Skills:
- Excellent verbal and written communication abilities.
- Proficient in explaining complex technical details and insights, leveraging Databricks’ collaborative features.
- Teamwork and Leadership:
- Proven ability to work in and lead cross-functional teams.
Experience in mentoring and guiding teams in a Databricks-centric environment
“Expected annual pay for this role ranges from [$120,000] to [$150,000]. Based on the position, the role is also eligible for Wipro’s standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.”
Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicates including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis.. Wipro provides equal opportunities to all and values diversity
Nearest Major Market: Atlanta