Vacancy expired!
- AWS/Google Cloud Platform cloud certifications
- AWS/Google Cloud Platform Data Engineering certifications
- Bachelor’s degree in Information Systems, Computer Science, or related discipline or equivalent work experience
- Master’s degree in Computer Science or related discipline
- 4 years of demonstrated experience in developing Big data solutions that support business analytics and data science teams
- 7 or more years of proficient experience developing data platforms, data warehouses, ETL/ELT pipelines and programming in SQL, Python, Java, Scala-Spark, Bash, and other scripting languages
- Proven experience designing various batch & real-time streaming ingestion patterns with Sqoop, Kafka, Kinesis, Google Cloud Platform Pub/Sub.
- Strong knowledge and hands on experience in Big Data technologies in Cloud such as AWS EMR, Apache Spark, Databricks, AWS Redshift, Snowflake, S3, Google Cloud Platform Big Query, Google Cloud Storage and Google Data Proc
- Proven leadership in cloud administration with emphasis on infrastructure automation (Terraform, Cloud Formation) and provisioning Lambda, SNS, EC2, Airflow, Elastic Cache, Redis, RESTful APIs in AWS
- Knowledge of DevOps methodology and automation experience with Jenkins, Ansible, Chef, XL Release and XL Deploy
- Scala/Spark, Google Cloud Platform Big Query, Google Cloud Platform DataProc
- Design and develop high performing, scalable Big data solutions in AWS and Google Cloud Platform to support advanced analytical usecases
- Develop data pipelines for optimal extraction, transformation, and loading (ELT, ETL) from a wide variety of data sources using Big Data and Integration technologies
- Design & develop feature, and code reviews to drive excellence in engineering and ensure high quality & maintainability
- Implement effective solutions for Cleansing & Data Quality, Lineage
- Support improvement of platform features for high productivity and availability
Vacancy expired!