Job Details

ID #41159842
State Virginia
City Richmond
Job type Permanent
Salary USD Depends on Experience Depends on Experience
Source SPECTRAFORCE TECHNOLOGIES Inc.
Showed 2022-05-19
Date 2022-05-18
Deadline 2022-07-17
Category Et cetera
Create resume

Data Engineer/ ETL Developer

Virginia, Richmond, 23173 Richmond USA

Vacancy expired!

Title: Data Engineer

Location: Richmond, VA

Duration: 1 year

Hybrid Role: 1 week on-site, 1 week remote

Responsibilities: As a core member of team of Data Engineers/ETL Developers, responsibilities include but not limited to:
  • Design, Develop and maintain secure, consistent and reliable ETL solutions supporting critical business processes across the various Business Units.
  • Ensure data solutions are compliant with enterprise security standards
  • Work in complex multi-platform environments on multiple project assignments.
  • Develop and perform tests and validate data flows and prepare ETL processes to meet complex business requirements, including designing and implementing of complex end-to-end solutions using BI platforms.
  • Coordinate with analysts and developers to ensure jobs designed and developed meet minimum support standards and best practices before migration into the production environment.
  • Partner with various infrastructure teams, application teams, and architects to generate process designs and complex transformations to various data elements to provide the Business with insights into their business processes.
  • Uses strategies such as Indexing and partitioning to fine tune the data warehouse and big data environments to improve the query response time and scalability.
  • Define and capture metadata and rules associated with ETL processes.
  • Assist production support team in providing resolutions to production job failures, data issues and performance tuning

Qualifications:
  • Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts
  • Minimum 5 years working experience with ETL tools such as Talend, Informatica, Data Stage etc
  • Minimum 5 years working experience in SQL, Stored Procedures and Table Design
  • Minimum 5 years working experience in SQL Query optimization and ETL Data loading Performance
  • Minimum 2 years working experience as Data Engineer in Hadoop Platforms on components like HIVE, KAFKA, NiFi, Spark etc.
  • Minimum 2 years working experience in shell scripting
  • Experience in Snowflake cloud technologies is preferred
  • Experience in real time streaming technologies is preferred
  • Experience deploying machine learning models and automating processes in production is a plus
  • Experience with cloud technologies (AWS, Azure, Google Cloud Platform) is big plus
ETL Development and Process Support, may require weekend/off business hours work.

Vacancy expired!

Subscribe Report job