Job Details

ID #44513998
State California
City Pleasanton
Job type Contract
Salary USD $80 - $100 80 - 100
Source BayOne Solutions
Showed 2022-08-01
Date 2022-07-27
Deadline 2022-09-25
Category Et cetera
Create resume

Lead Data Engineer

California, Pleasanton, 94566 Pleasanton USA

Vacancy expired!

Dear Candidate,Hope you are doing great! I have an urgent requirement with one of my direct clients. Please go through the below job description, if you are interested kindly send me your updated resume to proceed further.

Job Title:

Lead Data EngineerLocation: Pleasanton, CA ( Hybrid model ) Type: 12 months+ or 6 months C2H

Job Description:The candidate will be responsible for designing, developing, testing and managing large scale, high-performance data processing systems (batch and/or streaming) in a Multi Cloud environment to provide a robust data/analytical pipeline in Loyalty area. You will have a background in computer science or a related technical field with experiences working with high volume, message-based data integration technologies. A successful candidate will be both technically strong and business savvy, with a passion to make an impact through creative storytelling and timely actions. You are a self-starter, smart yet humble, with a bias for action.

Key Responsibilities Include, But Are Not Limited To:• Lead, architect, design and develop secure, scalable, high-performance and reliable and cost-effective Big Data platform software and services in a Multi-Cloud environment• Provide technical leadership in Data Engineering practices. Partner with architecture, Infosec, and development teams across the entire enterprise to establish a strong relationship and trust for prioritizing and delivering projects on time and with a high degree of quality.• Establish patterns for re-use, standards and best practices for Data Engineering & Analytics such that data timeliness and quality are maximized.• Partner with the Audit, Compliance and Governance leaders to ensure data is secured and conforms to the guidelines laid out by the organization and the industry.• Partner with cross-functional teams to deliver large scale strategic projects as well as ongoing operational activities related to Big Data Platform. Interface with cross functional leaders and represent point of views to drive measurable success.• Drive meetings and lead discussions. Prioritize projects across the team and allocate resources to meet business and team goals.• Participate in code reviews and mentor junior level developers at onsite/offshore to make sure code/deployment standards are met

Qualifications:• Bachelor’s or Master’s in computer engineering, computer science or related area.

• 7+ years proven experience in developing and deploying data pipelines, preferably in the Cloud; Azure and Snowflake experience is a plus• 5+ years proven experience in building data warehouse platforms in dealing with star & snowflake schemas as well as slowly changing dimensions.• 4+ years of strong experience with SQL and stored procedures

• 2+ years of proven expertise in creating pipelines for real time and near real time integration working with different data sources - flat files, XML, JSON, Avro files and databases• 1+ years of experience with at least one programming language like Python, Java or Scala• Knowledge on Big Data platforms and applications is a plus.• Databricks and Delta table knowledge is a plus• Extensive experience in data transformations for Merchandising business use cases will be a plus• Knowledge for handling exceptions and automated re-processing and reconciling• Passion for Data Quality with an ability to integrate these capabilities into the deliverables• Prior use of Big Data components and the ability to rationalize and align their fit for a business case• Proficiency in techniques for slowly changing dimensions• Knowledge of Jenkins/Github for continuous integration and End-to-End automation for application build and deployments• Ability to integrate into a project team environment and contribute to project planning activities• Experience in developing implementation plans and schedules and preparing documentation for the jobs according to the business requirements• Lead ambiguous and complex situations to clear measurable plans• Proven experience and ability to work with people across the organization and skilled at managing cross-functional relationships and communicating with leadership across multiple organizations.• Proven capabilities for strong written and oral communication skill with the ability to synthesize, simplify and explain complex problems to different audiences.

Top 3-5 skills in an ideal candidate:

Snowflake, SQL, Cloud (Azure), Python, Linux scripting, communication skills, leading/mentoring and working in team environment.

Years of experience required: 10 years+

ASHA BARVEEN |

SR RECRUITERMobile: Email: abarveen(@)bayonesolutions(.)comAddress: 4637 Chabot Dr #250, Pleasanton, CA 94588

Vacancy expired!

Subscribe Report job