Vacancy expired!
- Good verbal and Written communication skills.
- Experience working with multiple disparate systems.
- Experience in Cloud Technologies (AWS / Azure / Google). AWS is preferred.
- Proficiency with Python, Java, shell scripting (Bash and PowerShell) & SQL
- Experience working with streaming data and data extraction from different databases (Oracle, DB2, MySQL etc)
- Experienced with deploying and managing infrastructures based on Docker, Kubernetes, or OpenShift
- Experience with scalable data extraction tools is a plus
- Experience working with Kafka, Aurora, AWS Glue, Redshift is a plus
- Understanding of data engineering, real time streaming and/or eventing, and json parsing
- Experience with automating application deployment, continuous delivery, and continuous integration (Jenkins, Ansible etc.)
- Experience building micro services and API architecture
- Debugging & troubleshooting skills
- Must be flexible and have a passion to learn and collaborate with colleagues
- Must have strong oral and written communication skills
- Business Intelligence/Analytics experience a plus
- Embraces diverse people, thinking and styles.
- Consistently makes safety and security, of self and others, the priority.
- Develop solid and supportable modular designs for data streaming, Cloud transformation/migration, and API product development in support of critical applications.
- Develop data APIs and data delivery services that support operational and analytical applications for Delta’s internal business operations, customers, and partners.
- Creation and support of data-centric products that encompass multiple specializations, platforms, and technologies.
- Analyse technical information and produce quality software.
- Initiate collaboration with teammates.
- Offer creative solutions to overcome obstacles.
- Work within automated testing and CICD processes.
- Be an expert on the products we built.
- Document solutions in written and diagram form and communicate across teams.
- Leverage developer coding standards to ensure it meets design goals and business needs.
- Identify technical issues, articulate impact, and need for prioritization.
- Proactive communication to both team and leadership.
- Work collaboratively with vendor(s).
- Bachelor of Science degree in Computer Science or equivalent
- At least 7 years of post-degree professional experience
- At least 5+ years of Airline industry experience
- 4+ years development experience building and maintaining ETL pipelines
- 3+ years of experience working with database technologies and data development such as Python, PLSQL, etc.
- Experience in mentoring junior team members through code reviews and recommend adherence to best practices
- Deep understanding of writing test cases to ensure data quality, reliability and high level of confidence
- Track record of advancing new technologies to improve data quality and reliability
- Continuously improve quality, efficiency, and scalability of data pipelines
- Expert skills working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance
- Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.)
- Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment
- Familiar with best practices for data ingestion and data design
- The Senior Data Engineer will play a leading role on the Enterprise Data Services team, responsible for transforming data from disparate systems to provide insights and analytics for business stakeholders.
- You’ll leverage cloud-based infrastructure to implement technology solutions that are scalable, resilient, and efficient. You will collaborate with Data Engineers, Data Analysts, DBAs, cross-functional teams, and business leaders. You will architect, design, implement and operate data engineering solutions, using Agile methodology, that empower users to make informed business decisions.
- Candidate You are self-motivated, work independently, and have direct experience with all aspects of the software development lifecycle, from design to deployment.
- You have a deep understanding of the full life data lifecycle and the role that high-quality data plays across applications, machine learning, business analytics, and reporting.
- Strong candidates will exhibit solid critical thinking skills, the ability to synthesize complex problems, and a talent for transforming data to create solutions that add value to a myriad of business requirements.
- You have the demonstrated ability to lead and take ownership of assigned technical projects in a fast-paced environment.
- Excellent written and speaking communication skills are required as we work in a collaborative cross-functional environment and interact with the full spectrum of business divisions.
- You demonstrate unsatiated curiosity and outstanding interpersonal “soft” skills. Ideal candidates have more than just knowledge or skill set, as they also have a “can do” mindset to find solutions.
- You have demonstrated ability to serve as a liaison with business users and walk with them through their problems to identify the best path forward.
- You are also expected to provide technical counsel to other Data Engineers on the team and may be requested to review and guide their work to ensure all the work comes together successfully to meet the business need.
Vacancy expired!