Title: Data Engineer
Job Description
Role Purpose
The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists.
͏
Key skills – Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL)
Must-have skills• Cloud certified in one of these categories
• Azure Data Engineer
• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation
. Semantic Modelling/ Optimization of data model to work within Rahona
• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.
• Experience in Sqoop / Hadoop
• Microsoft Excel (for metadata files with requirements for ingestion)
• Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud
• Strong Programming skills with at least one of Python, Scala or Java
• Strong SQL skills ( T-SQL or PL-SQL)
• Data files movement via mailbox
• Source-code versioning/promotion tools, e.g. Git/Jenkins
• Orchestration tools, e.g. Autosys, Oozie
• Source-code versioning with Git
Nice-to-have skills
• Experience working with mainframe files
• Experience in Agile environment, JIRA/Confluence tool
Key skills – Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL)
Experience - 5 to 10 Years
Must-have skills
• Cloud certified in one of these categories
• Azure Data Engineer
• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation
. Semantic Modelling/ Optimization of data model to work within Rahona
• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.
• Experience in Sqoop / Hadoop
• Microsoft Excel (for metadata files with requirements for ingestion)
• Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud
• Strong Programming skills with at least one of Python, Scala or Java
• Strong SQL skills ( T-SQL or PL-SQL)
• Data files movement via mailbox
• Source-code versioning/promotion tools, e.g. Git/Jenkins
• Orchestration tools, e.g. Autosys, Oozie
• Source-code versioning with Git.
Nice-to-have skills
• Experience working with mainframe files
• Experience in Agile environment, JIRA/Confluence to