Vacancy expired!
- Azure DataBricks
- Synapse Pipelines (ADF)
- Synapse DW (Dedicated SQL Pool) – this definitely needs to be standardized to one Analytics/Reporting application across Grocery and FS
- As a Azure Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Databricks, SQL Server and other Big Data related technologies).
- In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations.
- Note: This is a data engineer from the application side.
- Must be able to analyze data and develop strategies for populating data lakes (Databrick – Delta Lake).
- This person may be called upon to do complex coding using T-SQL, Scala or Python, using PySpark.
- Design ingestion pipelines using ADF including Integration runtimes, triggers, activities, etc.
- Data modeling, database design and complex query building
- Ingest data from various sources to data lake using Azure Data Factory.
- Perform transformations using Databricks Spark.
- Constantly learn and work on new technologies
Vacancy expired!