Job Details

ID #11174884
State Illinois
City Chicago
Job type Permanent
Salary USD TBD TBD
Source The Judge Group, Inc.
Showed 2021-03-18
Date 2021-03-17
Deadline 2021-05-16
Category Architect/engineer/CAD
Create resume

Lead Data Engineer (Cloud)

Illinois, Chicago, 60601 Chicago USA

Vacancy expired!

Location: Chicago, IL Description: Our client is currently seeking a Lead Data Engineer

Role: Lead Data Engineer

Location: REMOTE

Job Type: Contract to Hire on W2

Key skills are Kafka, cloud streaming, serverless, golang.

This role is for a Lead Data Engineer that will join and lead a team responsible for managing a growing cloud-based data ecosystem consisting of a metadata driven data lake and databases that support real time analytics, extracts, and reporting. The right candidate will have a solid background in data engineering and should have a few years of experience on a major cloud platform such as Azure.

What are the top 5-10 responsibilities for this position?

o Building and maintaining a data processing framework on Azure using Databricks

o Writing code in Apache Spark/Scala

o Working with existing Databricks Delta Lake tables to optimize for CDC performance using techniques

o Working with existing Databricks Notebooks to optimize or address performance concerns

o Create new Databricks Notebooks or stand-alone Apache Spark/Scala code as needed

o Willingness to learn existing on-premise data management tools as required, such as Ab Initio

Contact:

This job and many more are available through The Judge Group. Find us on the web at www.judge.com

Vacancy expired!

Subscribe Report job