Vacancy expired!
Position- Kafka Admin (With Linux Experience) Location: Fully Remote Job-Type- Contract Job Description- Client is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for Global 1000 companies. We are transforming corporations through deep domain expertise, knowledge-based ML platforms, as well as profound anthropological efforts to understand the end customer and design products and interactions that create delight. We are deeply committed to developing a comprehensive understanding of our clients' problems and to develop platforms to address them. Responsibilities:
- Manage large scale multi-nodes Kafka cluster environments residing on Linux.
- Experience with Linux environments/administration
- Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
- Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.
- Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
- Research and recommend innovative, and where possible, automated approaches for system administration tasks.
- Ability to closely calibrate with product managers and lead engineers.
- Provide guidance in the creation and modification of standards and procedures
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts
- Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka cluster
- Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Manage large scale multi-nodes cluster environments residing on AWS
- Provide technical expertise and guidance to production support staff.
- Partner with business units in order to improve the effectiveness of business decision
- 5+ years of solid Kafka Admin experience
- Design, build, assemble, and configure application or technical architecture components using business requirements.
- Hands-on experience with Kafka clusters hosted on Amazon cloud is a plus.
- Experience in Kafka build pipelines using Ansible, Cloud formation templates, shells etc.
- Experience in Jenkins, GitHub
- Experience in implementing security & authorization (permission based) on Kafka cluster.
- Experience in open source Kafka, zookeepers, Kafka connect, schema registry Avro schemas.
- High availability cluster setup, maintenance and ongoing support
- Has good knowledge of best practices
- Hands on experience in standing up and administrating Kafka platform which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management(ACL)
- Knowledge of Kafka API (development experience is a plus)
- Knowledge of best practices related to security, performance, and disaster recovery.
- Comfortable performing in a fast paced, dynamic and ambiguous business environment.
- Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.
- Demonstrate a product mindset with an ability to set forward thinking and direction.
- Excellent listening and communication skills.
- Must be able to communicate technical information clearly, able to 'translate' between diverse groups of technical and non-technical individuals.
- Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations to a vast array of individuals.
- Ability to structure documents to effectively communicate with senior leadership and drive alignment and decision making.
- Strong problem solving skills with the ability to offer why one technical solutions is more preferable than another.
- Ability to analyze and interpret complex concepts.
- Ability to work in a team environment in a collaborative manner.
- Proven track record of sound, effective decision making.
Vacancy expired!