Job Details

ID #45767830
State North Carolina
City Cary
Job type Permanent
Salary USD Depends on Experience Depends on Experience
Source Amiga Informatics
Showed 2022-09-17
Date 2022-09-06
Deadline 2022-11-05
Category Et cetera
Create resume

ETL PYSPARK(Data/Bigdata Engineer)

North Carolina, Cary, 27511 Cary USA

Vacancy expired!

Location: NYC, NY and Cary, NC and Jacksonville, FL

  • Preparing HLD and LLD document with ETL methodology transformation rules for data pipelines.
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Knowledge on Sqoop and Impala
  • Involves in build and unit test of data pipeline ETL's.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same
  • SIT and UAT support.
  • Conduct code reviews and provide improvement guidelines
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Coding and development, unit test the ETL code changed/developed.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same.
  • Involves peer review of ETL code artifacts.
  • Support for Production Deployment
  • Participate in Unit and System Testing and approve deliverable

Vacancy expired!

Subscribe Report job