Vacancy expired!
Data Engineer to support our client located in San Francisco, CA.
Location: RemoteDuration: 9+ monthsJob DescriptionOverview:This role will be supported the Data & Analytics Team for this customer. This person will not be building data pipelines themselves but will look at someone else’s pipeline or developed piece of work and will do triaging, troubleshooting, analysis, etc. to see where the problem might be happening.Top Required Skills:- Python
- PySpark
- AWS Technologies – Glue, S3, Redshift
- Database knowledge – Oracle, SQL, etc.
- Agile methodology
- 5+ years of experience as a Data Engineer dealing with large data sets and modern software delivery practices - - source control, testing, etc.
- Experience in data acquisition, data set process, improving data reliability, quality and efficiency
- Experience developing in Python using Spark and other data tools
- Familiar with AWS technologies like Glue, S3 and RedShift
- Experience with large data sets to address business issues and database products
- Experience with modern software delivery practices, including source control, testing, continuous delivery
- Experience delivering product with Agile methodologies
- Experience with data & analytics product development
- Collaborative, open to sharing and learning
- Respectful of other's skill and experience, self-aware
- Interested in finding better ways to get it done while honoring and respecting people
- Strong interpersonal skills; cares about and works well with others
- Be able to support after hours work and standby
- Frequency depends on weather conditions (i.e., if sever weather conditions, this is when on call might be required)
- Be able to respond quickly to urgent situations
- Review and analyze problems on pipelines and data source connections
- Work well with other SMEs to diagnose and resolve problems
- Communicate solutions and resolution of problems to various parties
- Build high-performance data pipelines (extracting, transforming, and loading).
- Understands business requirements and applies them to complex programming and analysis.
- Communicates (oral and written) recommendations and mentors/provides guidance to less experienced colleagues.
- Partners with various departments to understand and incorporate standards information and requirements into work procedures.
- Identifies, analyzes and provides feedback to departmental standards, norms, and new goals/objectives.
- Analyzes existing applications and systems and formulates logic for new systems, devises logic procedures, logical database design, performs coding and tests/debugs programs with an operational mindset.
- Works on complex data & analytics-centric problems having broad impact that require in depth analysis and judgment to obtain results or solutions.
- Designs and deploys new complex Enterprise systems and enhancements to existing systems ensuring compatibility and inter-operability.
- Resolves application programming analysis problems of broad scope within procedural guidelines. May seek assistance from the supervisor or more skilled programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas.
- Delivers best-in-class software as part of a software delivery team.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed
- Plans work to meet assigned general objectives; progress is reviewed upon completion and solutions may provide an opportunity for creative/non-standard approaches.
Vacancy expired!