Vacancy expired!
- Responsible for data engineering, data analysis, and end user support
- Experience working with Azure Databricks and Cloudera Hadoop
- Deep understanding of Python and Scala languages
- Able to design, develop, and maintain highly scalable cloud based processing
- Experience writing efficient, reusable and well documented code
- Deliver big data projects using Databricks, Data Factory and other Azure services
- 7+ years experience of software development and design
- 2+ years experience leading a team of software developers
- Experience developing and tuning Spark applications using Databricks
- Deep understanding of Spark architecture, Spark SQL, data frames and tuning big data spark applications
- Strong Python, Scala, SQL and Shell scripting
- Hands-on experience working with Microsoft Azure
- Strong understanding of Database Design and Data Modelling
- Any experience in Synapse, Snowflake or Google BigQuery is a plus
Vacancy expired!