Job Details

ID #20116063
State California
City Cupertino
Job type Permanent
Salary USD TBD TBD
Source Pinnacle Group
Showed 2021-09-23
Date 2021-09-22
Deadline 2021-11-20
Category Architect/engineer/CAD
Create resume

Data Engineer III

California, Cupertino, 95014 Cupertino USA

Vacancy expired!

Data Platform Engineer

Location: Seattle, WA

/ Remote - Must be able to work in office once open

Must have:
  • AWS experience with kubernetes operating knowledge.
  • Working with data pipelines and experience with Spark and Flink
  • Excellent communication skills

Nice to have: Programming experience in Scala, Java and Python Knowledge on Machine Learning (Client)

Job description:

AIML Data Platform seeks to improve products by using data as the voice of our customers. We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, Hadoop and others. You will be expected to effectively partner with upstream engineering teams and downstream analytical & product consumers.

Experience:

  • 10+ YOE, with 5+ years of experience designing and implementing batch or real-time data pipelines
  • Hands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)
  • Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.
  • Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelines
  • Proven ability to work in an agile environment, flexible to adapt to changes
  • Able to work independently, research on possible solutions to unblock customer
  • Programming experience in Scala, Java, or Python
  • Fast learner and experience with other common big data open source technologies is a big plus
  • Knowledge on machine learning (Client) is a nice-to-have

Vacancy expired!

Subscribe Report job