Vacancy expired!
We're seeking strong Data Engineers with expertise in Apache Airflow to focus on expanding and optimizing our data, data pipeline architecture, data flow and collection for multi-functional teams. The Data Engineer will be an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. You will support our software developers, data analysts and data scientists on data initiatives and will ensure efficient data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. You will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.This team is a group of innovators and technologists that love to learn and collaborate!- Technologies:
Apache Airflow, Kubernetes or Dockers - Languages: Python, T-SQL or other SQL language- Databases: MSSQL Server, Oacle, PostgreSQL - Platforms: Azure or AWS or Google Cloud Platform - Skills: Build, test, and improve/maintain ETL data pipelines - Data Modeling: Documentation: Creating/Maintaining Data Dictionary and ERDs - Design: Implementation/Maintenance of Data Warehouse (familiar with modeling facts/dimensions and understands tradeoffs between star/snowflake schemas) - Database Management: Deploy/Rollback DB schema changes Create/Alter tables, views, stored procedures, functions, indexes - Data Governance: Improve data availability, usability, integrity and securityRole: Enjoys data wrangling. Eager to understand internal/external business reporting needs. Ability to communicate effectively and work with business stakeholders to arrive at the appropriate solution. Comfortable working across departments to gather/spread necessary knowledge to complete a project. Willingness to learn new languages/technologies as needed for the job. Familiarity with Agile/SCRUM methodologies and practice.Responsibilities for Data Engineer:- Build and maintain optimal data pipeline architecture- Assemble large, sophisticated data sets that meet functional / non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.- Build the infrastructure required for efficient extraction, transformation, and loading of data from a wide variety of data sources- Assist with data-related technical issues and support their data infrastructure needs.- Build data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.Work with data and analytics specialists to strive for greater functionality in our data systems.We look forward to reviewing your profile.Thank you, Talent Team @ SIAL TPVacancy expired!