Vacancy expired!
Location: Sunnyvale, CA Description: Role: Software Engineer ILocation: Sunnyvale, CA - REMOTE till July 2021Duration: 9+ months (Extendable)
Overall responsibilities:- For this project, we will need to create a new big data pipeline using Flume to generate all the fields for the network heartbeat table and other SHAG tables.
- This pipeline will be built using the team's new architecture to build these data pipelines that provides better testability and reusability.
- The new architecture is well documented and validated. In the process of building the Flume pipeline, the SWE will also need to create well tested interfaces that encapsulate the business logic from the existing MapReduce pipeline.
- The new pipeline will need to be integrated with the team's quick data rollback and data validation mechanisms to ensure reliability of the data.
- The data generated by the new Flume pipeline will replace the data generated by the existing MapReduce in production for all users of the chosen SHAG tables.
- Education: BS in computer science
- Proficient C Programming.
- One or more years of experience doing software development.
- YOE: 0-3 Years
- Distributed systems.
Vacancy expired!