Vacancy expired!
A Data Engineer job with a leading Technology Company located in Milpitas is available courtesy of Modis Engineering. Will keep abreast of industry trends and implementing them as needed. Data Engineer job responsibilities include:
Strong Python development experience who has demonstrated track record of delivering complex projects on a large-scale Environment preferably size of TB of data daily Data Eng -I : Expertise in architecting messaging systems, distributed data stores and NoSQL technologies (Some of them we work on: Kafka, Spark, Hive, Google Pub Sub, Cloud composer, BigQuery, Google Cloud Storage) Data Eng -II: Hands on experience in some of bigdata tools such as Kafka, Spark, Hive, Google Pub Sub, Cloud composer, BigQuery, Google Cloud Storage Qualifications: Must have Big Data Technology professional experience of 2+ years or more with hands-on development experience in Hadoop eco-system, Kubernetes, and cloud technologies Must have solid of experience in building tools and application on a scalable environment Must have professional experience working with building ETL pipelines and data cleansing processes Hands-on experience with any cloud based infra, Preferred GCP. Experience must include Data Proc, Data flow, pub/Sub and BigQuery to name a few. (AWS experience is also accepted with similar to above listed cloud services and products) Must have 1+ experience on building terraform code and Airflow for orchestrating the ETL data pipeline Performance tuning - table partitioning and indexing and sharding, process threading Willing to work on a fast-paced environment and be adoptable to change Must be a team player and have experience working with cross functional and be willing to work in a collaborative environment Detail-oriented with strong analytical and problem-solving skills Good and effective Communications skills (both verbal & written) Strategic thinker with a strong technical aptitude and a passion for execution Qualifications - Good to have: Familiarity with Machine learning and deep learning algorithm. Candidate must have experience with working with data scientists to scale their models and deploy on Cloud based environment. Semiconductor industry experience Have experience in migrating on-premises Data Lake and Hadoop to GCP Experience with designing and scaling ML models on distributed system or cloud environment and who has worked closely with data scientist If you are interested in this Data Engineer job in Milpitas, then please click APPLY NOW. If you have questions about the position, please contact Chuck Oeland at (408) 472-8073 or at chuck.oeland@modis.com Equal Opportunity Employer Minorities/Women/Veterans/Disabled Equal Opportunity Employer/Veterans/DisabledTo read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.modis.com/en-us/candidate-privacyThe Company will consider qualified applicants with arrest and conviction records Vacancy expired!
