Job Details

ID #19558238
State New York
City Nyc
Job type Contract
Salary USD Depends on Experience Depends on Experience
Source Marlabs, Inc
Showed 2021-09-13
Date 2021-09-10
Deadline 2021-11-08
Category Et cetera
Create resume

Python / Pyspark Developer with AWS

New York, Nyc, 10001 Nyc USA

Vacancy expired!

Please email me your resumes @

(harjeet.singh(AT)marlabs.com)or call me on my cell .

Job Title: Python / Pyspark Developer with AWSLocation: NYC, NY

Duration: 12 months extendable

Responsibilities:Assist in migration of our feature pipelines from Teradata to pyspark /Sagemaker feature store One skill that is an

absolute must is pyspark and ability to troubleshoot scaling issues.

Duties and Responsibilities:

  • Architectural planning/ Development for Features as a Service (FaaS) that migrates the Legacy Dynamic SQL to an API Based Service that can be leveraged to create data feeds for Model training.
  • Creation of data /ML pipelines that use the services above for
    • Model Inference
    • Reinforcement Learning
  • Support for existing code base while it is being migrated from SQL to cloud based services
  • Documentation of all work on confluence pages in a business-friendly language along with technical design where needed.

Technical Skills:
  • 10+ years of experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools and, scripting.
  • Expert knowledge on various Data modeling techniques: OLTP (normalized), ODS, EDW (dimensional).
  • SQL-based and NoSQL-based technologies.
  • Python/PySpark - Expert user
  • AWS Certification – Associate or Professional (Preferred) level
Regards,

Harjeet Singh

Marlabs

Inc. | One Corporate Place South | Piscataway, NJ 08854Tel: X1496 | Mobile: | Fax: 732.783.0375 |

Vacancy expired!

Subscribe Report job