Job Details

ID #40986960
State California
City Fremont
Job type Contract
Salary USD $80 - $100 80 - 100
Source HCL America Inc.
Showed 2022-05-16
Date 2022-04-26
Deadline 2022-06-25
Category Et cetera
Create resume

Lead Data Engineer

California, Fremont, 94536 Fremont USA

Vacancy expired!

For better understanding here is the job description

Role: Lead Data Engineer

Location: Bay Area CA

Duration: Long term Contract

Job Description: Looking for Lead Data Engineer to be part of the largest social media organization , working for their data center business group under data science team. Team has mandate to move data centers to autonomous – self running /self-healing data centers. All projects are aligned towards the above mandate. All projects handles Peta bytes of data coming from different sensors & help in creating business value out of it. Team consist of industry leaders in data science space , PHD/scholars from schools like MIT.

Job Description: We are looking for Lead Data Engineer to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on partner needs.

Responsibilities
  • Partner with leadership, engineers, program managers and data scientists to understand data needs.
  • Design, build and launch extremely efficient and reliable data pipelines to move data across several platforms including Data Warehouse, online caches and real-time systems.
  • Build data expertise and own data quality for your areas.

Qualifications
  • 2+ years Data Engineering experience
  • Advanced SQL coding - Expert in SQL with good understanding of how relational databases work
  • Experience querying massive datasets using Presto, Hive etc.
  • Good Python Programming Experience
  • Experience with Data Warehousing Architecture
  • Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.
  • 2+ years experience in custom ETL design, implementation and maintenance
  • Experience with data quality and validation.
  • Experience with SQL performance tuning and e2e process optimization

Vacancy expired!

Subscribe Report job