Vacancy expired!
We are looking for Azure Data Engineer – Raleigh, NC. This is a fulltime permanent position.
Required:Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks and Apache Spark Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks). Microsoft Azure Big Data Architecture certification (preferred) Hands on experience designing and delivering solutions using the Azure Data Analytics platform including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics Delivering and presenting proofs of concept to of key technology components to project stakeholders. Developing scalable and re-usable frameworks for ingesting of data sets Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Working with event based / streaming technologies to ingest and process data Working with other members of the project team to support delivery of additional project components (API interfaces, Search) Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Strong knowledge of Data Management principles Experience using geospatial frameworks on Apache Spark and associated design and development patternsVacancy expired!