Distributed Systems Optimization Consultant

Description Apache Zookeeper Optimization Consultant Role:We are seeking an experienced Apache Zookeeper Optimization Consultant to enhance the resiliency and performance of our distributed systems infrastructure. The ideal candidate will possess deep expertise in Zookeeper configuration, tuning, and troubleshooting, with a strong understanding of distributed systems, high-availability requirements, and related technologies such as RabbitMQ, Redis, and Kafka.Key Responsibilities:Performance Optimization:● Analyze the current Zookeeper setup and identify bottlenecks affecting performance.● Implement tuning measures for read/write latency, throughput, and leader election times.● Optimize JVM parameters and Zookeeper settings (e.g., tick time, heap size).Resiliency Enhancement:● Architect solutions for fault tolerance and disaster recovery.● Design and implement multi-region and multi-data center deployments.● Establish robust configurations for quorum consistency and failover mechanisms.Monitoring and Alerting:● Review monitoring tools (e.g., Prometheus, Grafana) to track Zookeeper health for resiliency.● Develop custom alerts for potential issues such as latency spikes, memory usage, and connection limits.Collaboration:● Work closely with engineering teams to ensure Zookeeper is optimized and resilient alongside other components like Kafka, RabbitMQ, Redis, and custom services.● Conduct capacity planning to ensure scalability for future workloads.Requirements Experience:● 10+ years of hands-on experience managing and optimizing Apache Zookeeper in production environments at large scale.● Proven track record of designing resilient distributed systems.● Experience with RabbitMQ, Redis, and Kafka in distributed architectures.Technical Expertise:● Deep understanding of distributed systems, including Zookeeper internals (leader election, session management, quorum design).● Expertise in associated technologies like RabbitMQ, Redis, and Kafka, with an understanding of their integration into distributed environments.● Proficiency in monitoring and troubleshooting tools such as Prometheus, Grafana, or similar.Skills:● Strong scripting skills (e.g., Bash, Python) for automation.● Excellent problem-solving and communication abilities.Certifications (optional):● Relevant certifications in distributed systems, messaging technologies, or DevOps practices are a plus.Technology Doesn't Change the World, People Do.® Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .