Job Details

ID #45685921
State Texas
City Dallas / fort worth
Job type Contract
Salary USD Depends on Experience Depends on Experience
Source Novateur Technologies Inc.
Showed 2022-09-14
Date 2022-09-13
Deadline 2022-11-11
Category Et cetera
Create resume

Sr Data Engineer

Texas, Dallas / fort worth, 75201 Dallas / fort worth USA

Vacancy expired!

Job Title Sr. Data EngineerLocation: Dallas, TX (Onsite)Duration: 12 Months.

Job Description:Sr. Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses on research on the development and delivery of analytical solutions using various tools including Confluent Kafka, Kinesis, Glue, Lambda, Snowflake, and SQL Server.Sr. Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value. .

Position Responsibilities• Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore) clear="none" • Highly proficient in the architecture and development of an event-driven data warehouse; streaming, batch, data modeling, and storage clear="none" • Advanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans clear="none" • Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption clear="none" • Expert level of understanding and implementation of ETL architecture; data profiling, process flow, metric logging, and error handling clear="none" • Support continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review board clear="none" • Develop and ensure adherence to published system architectural decisions and development standards • Lead and foster data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code review clear="none" • Multi-task across several ongoing projects and daily duties of varying priorities as required clear="none" • May require some interaction with offshore counterparts to communicate business requirements in a technical design document The duties listed above are the essential functions, or fundamental duties within the job classification. The essential functions of individual positions within the classification may differ. May assign reasonably related additional duties to individual employees consistent with standard departmental policy. clear="none" . clear="none"

Requirements clear="none" • 10+ years of development experience clear="none" • Bachelor’s degree in Computer Science, MIS, or related field (industry experience substitutable) clear="none" • Expert level in data warehouse design/architecture, dimensional data modeling, and ETL process development clear="none" • Advanced level development in SQL/NoSQL scripting and complex stored procedures (Snowflake, SQL Server, DynomoDB, NEO4J a plus) clear="none" • Extremely proficient in Python, PySpark, and Java clear="none" • AWS Expertise – Kinesis, Glue (Spark), EMR, S3, Lambda, and Athena clear="none" • Streaming Services – Confluent Kafka and Kinesis (or equivalent) clear="none" • Working experience with global teams is a MUST.Thanks & Regards.RaviNovateur Technologies209 346 7027 ravi (at) novateurtechnologies com;

Vacancy expired!

Subscribe Report job