Vacancy expired!
- Design and implement a hybrid Big Data solution using Cloudera and AWS in a highly-regulated, secure environment.
- Develop a highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels with an emphasis on proper security and data governance best practices.
- Administer Hadoop and Spark cluster environments with Cloudera’s distribution on-premise is required as well as experience in administering a hybrid environment.
- Provide support to Data Engineering teams on deployment of Hadoop/Spark jobs, work with IT Operations and Information Security teams on monitoring and troubleshooting of incidents to maintain service levels and coordinate with Vendor teams on installation, bus fixes, upgrades and escalations.
- Benchmark systems and analyze system bottlenecks in a hybrid environment and propose solutions to eliminate them.
- Research and provide recommendations on automating administration tasks and contribute to the evolving systems architecture to meet changing requirements for scaling, reliability, performance and manageability.
- Primary focus is on Cloudera Administration, secondary AWS.
- Design and implement a hybrid Big Data solution using Cloudera in a highly-regulated, secure environment.
- Develop a highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels with an emphasis on proper security and data governance best practices.
- Extensive experience in administering Hadoop and Spark cluster environments with Cloudera’s distribution on-premise is required as well as experience in administering a hybrid environment.
- Extensive experience to setup Nifi and Kafka Clusters
- Good to have knowledge of all phases of AWS infrastructure and concepts such as VPC, subnets, security groups, S3, RDS, EC2, Glacier, Lambda, IAM, security, encryption, DevOps, replication and disaster recovery.
- Experience with AWS in production.
- Familiarity with DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira and Confluence.
- Provide support to Data Engineering teams on deployment of Hadoop/Spark jobs, work with IT Operations and Information Security teams on monitoring and troubleshooting of incidents to maintain service levels and coordinate with Vendor teams on installation, bus fixes, upgrades and escalations.
- You must be able to benchmark systems and analyze system bottlenecks in a hybrid environment and propose solutions to eliminate them.
- You will be responsible for researching and providing recommendations on automating administration tasks and contribute to the evolving systems architecture to meet changing requirements for scaling, reliability, performance and manageability.
Vacancy expired!