Vacancy expired!
- 10 Years of Data Engineering professional with Strong proven track record of implementation in a variety of data platforms
- Extensive experience working on spark in performing ETL using Spark SQL Spark Core and Real time data processing using Spark Streaming from Kafka
- Analysis Design Development with technologies like Spark Hive Kafka and HDFS including programming languages such as Python Scala and Java
- Sound RDBMS and NoSQL concepts
- Experience with build automation tools and experience in CI CD pipelines with tools such as Jenkins UDeploy and Artifactory
- Design and implement dynamic metadata driven data pipelines that ingest a variety of data from multiple data providers
- Create and manage unit and integration test catalogue in a test driven development environment
- Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
- Excellent analytic skills associated with working on unstructured datasets
- Ability to build processes that support data transformation workload management data structures dependency and metadata
- Interact with CI CD pipelines and related tools
Vacancy expired!