Vacancy expired!
THE JOB In the role of Lead Engineer Kafka Engineering, you will be responsible for leading technical direction and implementation of software pipeline and observability platform. This critical service powers all aspects of our business from the sale of tickets for the world s largest live events to providing access into those events and more.You will be responsible for the technical aspects of ensuring that our hybrid cloud Kafka infrastructure is highly available, sustainable, performant, cost effective, and usable by hundreds of developers. You will work closely with the Manager Kafka Engineering, software development leadership, technical operations leadership, architecture, PMO and vendors from around the globe to deliver these services.
WHAT YOU WILL BE DOINGWork with the Manager Kafka Engineering to assess the needs of Software Engineering within the Kafka ecosystemEstablish, communicate, and advocate best practices and design patterns related to Kafka consumptionParticipate in and occasionally lead the daily, weekly, sprint cycle team ceremonies and ensure efficient activities of the team aligned to goalsProvide mentoring to team membersAssess and size effort associated with work backlog and participate in groomingAdvise and inform a program of work to mature the streams processing service offeringCollaborate with other operations team to ensure highly available service and response respective to developer supportInterview and participate in building a team to establish a center of excellence and expertise in streams processingParticipate in regular planning cycles to align business priorities to programs of work within your organizationInform recommendations, including resourcing, of strategic projects to mature and improve the serviceLead proofs of concepts, engineering, and implementation projectsWHAT YOU NEED TO KNOW (or TECHNICAL SKILLS/COMPETENCIES)Strong operational background running Kafka clusters at scaleKnowledge of both physical/onprem systems and public cloud infrastructureStrong understanding of Kafka broker, connect, and topic tuning and architecturesStrong understanding of Linux fundamentals as related to Kafka performanceFilesystem tuning and related kernel tuning and troubleshootingStorage hardware and trade-offsNetwork TCP stack tuning and troubleshootingBackground in both Systems and Software EngineeringCompetent developing software in 1 or more of high level languageCompetent with configuration management in code/IaC including Ansible and TerraformCompetent operating Java Runtime Environment (JRE) in large scale environments - ( runtime settings, JMX, troubleshooting, garbage collection, etc )Passionate about data driven operations; building and leveraging observability with tools such as Prometheus and GrafanaKnowledge and experience of containers and Kubernetes clusterHands on experience delivering complex software in an enterprise environmentExperience working in a remote team across multiple regions and time zonesComfortable working with structured Change and Incident ManagementYOU (BEHAVIOURAL SKILLS/COMPETENCIES) Autonomous and proactive.Passionate about the value of broad scale streams processingPassionate about providing greater transparency to health and status of the systemsKeenly empathetic to the day to day experience of software development teamsA transparent communicatorDeeply concerned with the security and compliance implications of your services and solutionsCapable of delivering and accepting empathetic, constructive criticism with reports, peers, leadership and stakeholdersConscious of the developers need for speed of delivery and the enterprise need for governance and cost managementVacancy expired!