Job Details

ID #17314059
State New York
City Newyorkcity
Job type Permanent
Salary USD Depends on Experience Depends on Experience
Source Cynet Systems
Showed 2021-07-26
Date 2021-07-23
Deadline 2021-09-21
Category Et cetera
Create resume

ETL / Pyspark Developer

New York, Newyorkcity, 10001 Newyorkcity USA

Vacancy expired!

Job Title: ETL / Pyspark Developer

Job Location: New York City, NY

Job Type: Full Time / Perm / Direct Hire

Job Description:
  • Preparing HLD and LLD documents with ETL methodology transformation rules for data pipelines.
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Knowledge on Sqoop and Impala.
  • Involves in build and unit test of data pipeline ETL's.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same.
  • SIT and UAT support.
  • Conduct code reviews and provide improvement guidelines.
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Coding and development, unit test the ETL code changed/developed.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same.
  • Involves peer review of ETL code artifacts.
  • Support for Production Deployment.
  • Participate in Unit and System Testing and approve deliverable.

Vacancy expired!

Subscribe Report job