Vacancy expired!
Lead Data Engineer Location- Los angles,CAType- ContractKey Skills : AWS (S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc) Strong coding exp in Python and PySpark, Spark SQL. Job Description 5 - 10 years of recent experience in data engineering.Experience on AWS and its web serering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.
- Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.
- Hands on 3 years of experience with EMR Apache Spark Hadoop technologies
- Experience with must have Python and PySpark, Spark SQL.
- Experience in working with large volumes of data Tera-bytes, analyze the data structures
- Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology Spark, Python, Scala, PySpark,
- Expert in SQL, redshift, NoSQL database
- Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
- Experience in any BI technology Tableau, Power BI, etc.
- Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies.
Vacancy expired!