Vacancy expired!
UST Global® is is looking for to build Data pipelines to work with one of the leading Retail providers in the US. The ideal candidate must possess strong background on Data Engineering development technologies & extensive experience in Azure. The candidate must possess excellent written and verbal communication skills with the ability to collaborate effectively with domain experts and technical experts in the team. .
Location :This position is based in Pleasanton, CAResponsibilities .,- As a Senior Azure Data Engineer you will:
- Maintain active relationships with Product Owner to understand business requirements, lead requirement gathering meetings and review designs with the product owner
- Own the data engineering backlog and coordinate with other team members to develop the features planned for each sprint
- Perform technical design reviews and code reviews
- Need to have deep knowledge of Shell scripting with SQL
- Have strong hands on background in building Data pipelines
- Need hands-on experience with Azure
- Proficient in data warehousing concepts.
- Strong exposure in Agile, Scaled Agile based development models
- Over 10 years of overall experience of IT experience & over 8 years of hands-on Big Data & Cloud technologies experience
- Strong experience in Azure Cloud technologies - ADF V2, ADLS Gen 1/2, Azure Databricks, Delta lake, Spark SQL,SQL DW
- Experience in Dataflows/Pipelines & other ETL tools - Developing ETL program for supporting Data Extraction, transformations and loading
- Proven experience in SQL development preferably SQL Server but other DBMS may be fine
- Ability to collaborate with client Solution Architect, Software Architects, Developers and applications SMEs in developing complex end-to-end Data warehouse solutions
- Strong experience in Big Data technologies - Hadoop and Spark architecture and it’s different components of Hadoop clusters
- Strong understanding of security concepts including but not limited to firewalls & encryption
- Good experience in programing languages like Python or PySpark
- Good communication (verbal & written) & documentation skills
- Self-starter, motivated and able to work independently while being a good team player
- Maintain active relationships with project stakeholders to understand business requirements, leads requirements gathering meetings and reviews designs with the product owner
- Identify and implement best practices and coach business and IT users
- Create technical documentation and maintain the knowledge repositories
- Ability to mentor and work with a group of engineers onshore & offshore
Vacancy expired!