Sr. Hadoop Consultant

Job Description

• Title: Cloudera Hadoop Administrator

• Duration: Fulltime

• Location: The Woodlands, TX or New Orleans, LA

• Manage Cloudera and Spark cluster environments, including service allocation and configuration for the cluster, capacity planning, performance tuning, and ongoing monitoring
• Work with data engineering related groups in the support of deployment of Hadoop and Spark jobs
• Responsible for monitoring the Linux, Hadoop, and Spark communities and report on defects, feature changes, and or enhancements to the team
• Deploy and maintain Hadoop clusters, add and remove nodes using cluster monitoring tools, and keep track of all the running Hadoop jobs
• Implement, manage and administer overall Hadoop infrastructure
• Responsible for capacity planning and estimate the requirements for lowering or increasing the capacity of Hadoop cluster
• Size the Hadoop cluster based on the data to be stored in HDFS
• Performance tuning of Hadoop clusters and Hadoop MapReduce routines
• Monitor the cluster connectivity and performance
• Manage and review Hadoop log files
• Monitor and manage Backup and Disaster Recovery processes

• Requirements:

• 5-7 years of hands-on experience with supporting Linux/UNIX production environments
• 3-5 years of hands-on experience with administering Hadoop and/or Spark ecosystem technologies in production
• 3-5 years of hands-on experience with scripting with bash, Perl, ruby, or python
• 2-4 years of hands-on development/ administration experience on Kafka, HBase, Solr, and Hue
• Experience designing and implementing Hadoop clusters
• Advanced ability to analyze problems, correlate data from multiple sources and communicate pertinent information to the appropriate support teams
• Strong interpersonal, verbal and written skills

Qualifications

Additional Information

All your information will be kept confidential according to EEO guidelines.