Job Details

ID #45061049
State Virginia
City Mclean
Job type Contract
Salary USD Depends on Experience Depends on Experience
Source Technology Ventures
Showed 2022-08-21
Date 2022-08-19
Deadline 2022-10-18
Category Et cetera
Create resume

AWS Data Engineer - Onsite (McLean, VA, Atlanta, Dallas or NY. Hybrid 2 days)

Virginia, Mclean, 22102 Mclean USA

Vacancy expired!

Location: Must be onsite 2+ days per week out of either Mclean, Atlanta, Dallas, or NY offices.This is a 6-month contract position Open to C2C

Must Haves: Must have experience building data pipelines using Spark, Scala, and Python. Must have experience with S3, EC2, Docker, EKS, EMR.

Schedule: Some on-call work may be required. Additional info TBD.

Job Responsibilities:Design and develop reusable data pipelines to support batch and stream processing of large volumes of structured, semi-structured and unstructured dataCreate and maintain optimal data pipeline architectureIdentify, design and implement internal process improvements including manual process automation, optimizing data delivery, infrastructure redesign with a focus on scalabilityDevelop data integration/ engineering workflows using Scala and/or Python leveraging AWS, Snowflake and other cloud data storesLeverage best practices, design and architecture that align with Enterprise Data and Application architecture standardsLeverage Microservices for aggregating data streams/ pipelines where neededMaintain and enhance data engineering architecture, design principles, CI/CD deployment proceduresDesign, develop and unit test new or existing data integration solutions to meet business requirements

QualificationsBachelor’s Degree in computer science or IT, Advanced degree preferred8+ years of overall experience3+ years of relevant large-scale enterprise transformation experience as relates to data engineering is preferred3+ years of experience developing RESTful APIs, microservices, containers, frameworks3+ years of database technologies Oracle, DB2, Mongo DB, NoSQL DBs, PostgreSQL, SnowflakeExperience with any of Cloud technologies like AWS S3, EC2, Docker, OpenShift, Kubernetes/Amazon EKS, EMR, HadoopExperience with Attunity, Kafka, AMQ or similar streaming tools is a plusStrong programming skills in one or more modern languages such as Python, Java, SparkPrior experience in the primary or secondary mortgage industry is desirableDeep knowledge of various enterprise level Platforms widely used in the industry is desirable

Vacancy expired!

Subscribe Report job