Job Details

ID #8654388
State California
City Mountainview
Job type Contract
Salary USD Depends on Experience Depends on Experience
Source Ab Ovo Inc
Showed 2021-01-27
Date 2021-01-25
Deadline 2021-03-26
Category Et cetera
Create resume

Sr. Data Engineer

California, Mountainview, 94035 Mountainview USA

Vacancy expired!

THIS IS REMOTE JOB DUE TO COVID Duties : Work with Data Engineers and Data Analysts to identify datasets needed for deep customer and business insights. •Work with ingestion developers to bring required source datasets into the data lake. Design a data model appropriate for customer business use cases. Design and develop ETL code to populate the data model. Define SLAs for data availability and correctness. Use best practices for unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response. Respond to alerts when SLAs are not being met. Work with BI developers to ensure that the data mart is providing the required data and the required performance. Serve as technical “go-to” person for our core technologies – AWS, EMR, Spark, Hadoop, Hive, Vertica, Qlikview, Tableau and others. Demonstrate strong implementation aptitude to translate objectives into a scalable solution to meet the needs of the end customer while meeting deadlines. Proficiency in SQL database design, proficiency in creating process documentation, strong written and verbal communication skills, and the ability to work independently and on teams. Familiarity with the computer coding languages python, java, kafka, hive, or storm may be required in order to oversee real-time business metric aggregation, data warehousing and querying, schema and data management, and related duties. Should have knowledge of algorithms, data structures, and performance optimism and experience with processing and interpreting data sets. Develop technical solutions to improve access to data and data usage.

Required Skills : Excellent interpersonal and communication skills, including business writing and presentations. Ability to clearly communicate objectives, plans, status and results, focusing on a few critical key points. 5+ years of experience integrating technical processes and business outcomes – specifically: data and process analysis, data quality metrics/monitoring, data architecture, developing policies/standards & supporting processes. 5+ years of experience building data warehouse solutions using MPP technology. 3+ years of experience developing solutions using Big Data technologies like Hadoop, Hive, EMR, Spark. Design and develop data preparation components and processes that extract and transform data across disparate database tables by creating aggregates tables for reporting and analytics, ensuring integrity of analysis data by developing the requirement specifications and assisting the development and testing of data tables. Database experience with advanced SQL or SQL-like skills (Hadoop-Hive); experience researching and manipulating complex and large data sets Strong object-oriented programming experience in

Java, Python, Ruby or similar. Experience with various offerings from

AWS, including S3, EMR, Redshift, Data Pipeline, Athena and Kinesis. Experience working with business leadership to design data solutions that meet business needs. Experience gathering requirements, designing solutions, creating JIRA stories, managing the backlog, giving product demos, and reporting status to senior management. Experience operating a mission critical data warehouse. This includes monitoring ETL, data availability, and data quality, and coordinating a response (using PagerDuty) when SLAs are not being met. Experience working with large, complex source systems, and working with developers of those systems to dig in and understand the complexities of the dataEducation (if required) : B/A or BS - preferred

Vacancy expired!

Subscribe Report job