Vacancy expired!
Position: ETL Big Data DeveloperLocations: Sterling, VA, Silver Spring, MD, New York, NY, Seattle WA.Fulltime
Key Areas of Responsibility- Design processes to extract, transform and load the source data to the targets and Data marts.
- Develop complex code to load data in to Data marts using AWS/EMR Spark and Scala
- Perform unit and system testing on the processes and resulting data lake tables.
- Create test cases and test the data.
- Mentor others on the team with product functionality and provide guidelines and solutions on performance tuning techniques and industry best practices.
- Understanding the existing environment, translating into new environment requirements and planning tasks to meet those requirements.
- Bachelor's Degree or higher in Computer Sciences or similar
- Minimum of 5-6 years Software Industry experience
- 3+ years of development experience with AWS services Must have EC2, EMR , RedShift, Snowflake,Data Pipeline or Airflow, S3, Jenkins
- Experience creating and managing complex data architectures
- Experience with data warehousing databases Redshift, oracle and techniques
- 4+ years of extensive working knowledge in different programming Scala ( Must ), Shell and Python (Must).
- Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds
- Expert level usage with Jenkins, GitHub is preferred
- Spark developer certification is a plus
- Experience in the media industry is a plus
Vacancy expired!