Vacancy expired!
Job Description:
Mandatory Skills: (Snowflake, SQL Server, DynomoDB, NEO4J a plus) Python, PySpark, and Java AWS Expertise Kinesis, Glue (Spark), EMR, S3, Lambda, and AthenaSr. Data Engineer PositionOverview A Sr. Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses research on development and delivery of analytical solutions using various tools including Confluent Kafka, Kinesis, Glue, Lambda, Snowflake and SQL Server. A Sr. Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value.Position ResponsibilitiesPartner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore)Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storageAdvanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plansSkilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumptionExpert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging and error handlingSupport continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review boardDevelop and ensure adherence to published system architectural decisions and development standardsLead and foster junior data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code reviewMulti-task across several ongoing projects and daily duties of varying priorities as requiredInteract with global technical teams to communicate business requirements and collaboratively build data solutionsThe duties listed above are the essential functions, or fundamental duties within the job classification. The essential functions of individual positions within the classification may differ. May assign reasonably related additional duties to individual employees consistent with standard departmental policy.Requirements10+ years of development experienceBachelor's degree in Computer Science, MIS or related field (industry experience substitutable)Expert level in data warehouse design/architecture, dimensional data modeling and ETL process developmentAdvanced level development in SQL/NoSQL scripting and complex stored procedures (Snowflake, SQL Server, DynomoDB, NEO4J a plus)Extremely proficient in Python, PySpark, and JavaAWS Expertise Kinesis, Glue (Spark), EMR, S3, Lambda, and AthenaStreaming Services Confluent Kafka and Kinesis (or equivalent)Hands on experience in designing and developing applications using Java Spring Framework (Spring Boot, Spring Cloud, Spring Data etc)Experience with onsite-offshore model is a MUSTVacancy expired!