Vacancy expired!
- Senior data engineering with hands on experience working with cloud and Big data platforms.
- A BIG PLUS for a lead level: Manage and mentor a team of 3-5 data engineers
- Responsible for data engineering, data analysis and user support primarily focused on Azure Databricks and Cloudera Hadoop.
- Strong hands-on technical skills and mentor and train other Engineers with programming languages such as Python and Scala, including tuning complex big data spark applications.
- Design, develop, and maintain highly scalable cloud-based data processing applications
- Write efficient, reusable and well documented code
- Deliver highly complex big data projects using Databricks, Data Factory and other Azure services
- Maintain and tune existing Hadoop/Hbase applications and migrate to Azure cloud
- 5+ years of software development and design
- A BIG PLUS: 2+ years of leading a team of 3-5 software developers
- Experience in developing and tuning SPARK applications using Databricks
- Excellent understanding of spark architecture, spark SQL, data frames and tuning big data spark applications
- Excellent with Python, Scala, SQL and shell scripting
- Hands-on experience with cloud platforms like Azure and AWS
- Experience in Database Design and Data Modeling
- Excellent problem solving and analytical skills
- Strong diagramming skills – flowcharts and data flows
- Solid written and verbal communication skills
- Experience with Synapse, Snowflake or Google BigQuery is a plus
Vacancy expired!