Job Details

ID #49538190
State California
City Oakland
Job type Permanent
Salary USD $100,000 - $120,000 100000 - 120000
Source BayOne Solutions
Showed 2023-03-25
Date 2023-03-21
Deadline 2023-05-20
Category Et cetera
Create resume

Data Engineer

California, Oakland, 94601 Oakland USA

Vacancy expired!

Job Title : Data Engineer

Location: Oakland, CA (Hybrid)Duration : FTE

Position Summary:We are looking for a savvy and driven Data Engineer to join our growing team of analytics experts. In this role you will work as part of cross functional teams, including data scientists, other data engineers, technology experts, and subject matter experts to develop data driven solutions. Successful candidates will be responsible for building, expanding, and optimizing our data, data storage, and data pipeline. This individual will support team members (data scientists, software developers, etc.) and decision products to ensure that data delivery is reliable and optimized. They will be supporting the data needs of multiple teams, systems, and products. This role will help the team continue its history of success. Qualified candidates will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nation’s most advanced smart grid. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&E’s sustainability goals.

Responsibilities:Enhance and maintain our current data pipelines and associated infrastructureAssemble large, moderately complex data sets that meet functional / non-functional business requirements.Engage with different stakeholder teams to troubleshoot various database systemsBuild and maintain tools that monitor data and system healthIdentify, design, and implement internal process improvements to optimize production of results and enable cost savings.Performance tune and optimize data pipeline on SparkCreate and maintain documentation describing data catalog and data objects

Minimum Requirements:Bachelor’s degree in computer science, an engineering field, or equivalent work experience in an engineering field3 years of experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE

Required Skills:Experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEEDatabase design fundamentalsExperience with Python, Pandas and APIsKnowledge of Time Series data set development.Demonstrated commitment to teamwork and enabling othersProven ability to translate business desires into technical requirementsAbility to communicate with various stakeholders and leadershipAbility to breakdown an ambiguous problems

Desired Skills:Experience with Scikit Learn, PySpark or equivalent big data processing framework, CI/CD toolExperience with an infrastructure as code tool, writing production-level code, writing health checks, unit tests, integration tests, schema validationsFamiliarity with cloud computing security fundamentalsExperience with the Palantir Foundry platformExperience working with data scientists and machine learning engineersFamiliarity with model deploymentFront end tools: PowerBi, Tableau

Vacancy expired!

Subscribe Report job