Vacancy expired!
Remote Now. Data Engineer (ADF/Pyspark) We are looking for a Data engineer with developer skills who will be working in a Devops environment and is going to support applications, provide enhancements to existing code base, triage production problems. This will be done primarily in Azure Data Factory, copy pipelines and using Pyspark. Other skills needed: Notebook, Data Bricks, Python. PRINCIPAL DUTIES AND RESPONSIBILITIES:
- Develop production-grade data engineering code through vision, definition, development, deployment and sustainment.
- Partner with Product Management to ensure data design, engineering and implementation is in accordance with design intention and meets business needs.
- Work with technology leadership to identify new technologies and techniques that can improve our overall platform performance and ultimate customer experience.
- Analyze product tradeoffs and deliver simple and intuitive products that just work.
- This person will open ADF, open pipelines, dig into code, find what caused the issue , escalate if necessary.
- A big part of this role is data provisioning.
- Bachelor's degree in Computer Science, Engineering or a related technical field.
- Two (2) years of experience min on delivering data integration, data engineering services and data platform solutions.
- Strong experience with ADF and copy pipelines
- Experience with Python, Pyspark, Data Bricks and Notebook.
- Previous experience with data warehouse integration and data engineering using real-time messaging, batch ETL/ELT, etc. in data management discipline.
- Previous working experience using cloud environments and various cloud services.
- Previous experience using various scripting tools and programing languages and experience working in a DevOps culture.
- Previous experience working in the hospitality industry.
Vacancy expired!