Data Engineer/ AWS Python Engineer

Position: Data Engineer/ AWS Python EngineerLocation: San Diego CADuration: Full-Time

• Required Skills:Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQLExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on 3 years of experience with EMR Apache Spark Hadoop technologiesExperience with must have Linux, Python and PySpark, Spark SQL.Experience in working with large volumes of data Tera-bytes, analyze the data structuresExperience in designing scalable data pipelines, complex event processing, analytics components using big data technology SparkPythonScalaPySpark,Expert in SQL, NoSQL databaseExperience in process orchestration tools Apache Airflow, Apache NiFi etc.Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies"