Data Engineer job vacancy in Nyc, New York Advent Global Solutions, Inc.

Vacancy expired!

Job Title: Data Engineer with Pyspark and AWS

Location: NYC, NY

Duration: 12 months extendable

Responsibilities: Assist in migration of our feature pipelines from Teradata to pyspark /Sagemaker feature storeOne skill that is an absolute must is pyspark and ability to troubleshoot scaling issues.Duties and Responsibilities:• Architectural planning/ Development for Features as a Service (FaaS) that migrates the Legacy Dynamic SQL to an API Based Service that can be leveraged to create data feeds for Model training.• Creation of data /ML pipelines that use the services above foro Model Inferenceo Reinforcement Learning• Support for existing code base while it is being migrated from SQL to cloud based services• Documentation of all work on confluence pages in a business-friendly language along with technical design where needed.Technical Skills:10+ years of experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools and, scripting.Expert knowledge on various Data modeling techniques: OLTP (normalized), ODS, EDW (dimensional).SQL-based and NoSQL-based technologies.Python/PySpark - Expert userAWS Certification – Associate or Professional (Preferred) level

Vacancy expired!

ID	#19906188
State	New York
City	Nyc
Job type	Permanent
Salary	USD $60 - $70 60 - 70
Source	Advent Global Solutions, Inc.
Showed	2021-09-19
Date	2021-09-17
Deadline	2021-11-15
Category	Et cetera
Create resume

Job Details

Data Engineer