Job Details

ID #45971013
State North Carolina
City Charlotte
Job type Permanent
Salary USD $80,000 - $130,000 80000 - 130000
Source Capgemini America, Inc.
Showed 2022-09-25
Date 2022-09-21
Deadline 2022-11-19
Category Et cetera
Create resume

Sr Data Engineer

North Carolina, Charlotte, 28201 Charlotte USA

Vacancy expired!

Required Qualifications:
  • 10 Years of Data Engineering professional with Strong proven track record of implementation in a variety of data platforms
  • Extensive experience working on spark in performing ETL using Spark SQL Spark Core and Real time data processing using Spark Streaming from Kafka
  • Analysis Design Development with technologies like Spark Hive Kafka and HDFS including programming languages such as Python Scala and Java
  • Sound RDBMS and NoSQL concepts
  • Experience with build automation tools and experience in CI CD pipelines with tools such as Jenkins UDeploy and Artifactory

Responsibilities
  • Design and implement dynamic metadata driven data pipelines that ingest a variety of data from multiple data providers
  • Create and manage unit and integration test catalogue in a test driven development environment
  • Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
  • Excellent analytic skills associated with working on unstructured datasets
  • Ability to build processes that support data transformation workload management data structures dependency and metadata
  • Interact with CI CD pipelines and related tools

Vacancy expired!

Subscribe Report job