Vacancy expired!
Career Opportunity: Job Title: Hadoop Engineer About CodeForce 360 Making a career choice is amongst the most critical choices one can make, and it's important for the choice to be calculated with factors such as a company's run of success since its inception and more. But, when you come across a company that has reputation proven with nothing but an illustrious run of success since the day it began, you don't need to think of anything else. That's precisely what some of our employees and prospective employees think when they came across CodeForce 360. Position Overview Hadoop Engineer Requirements: Hadoop/Dataproc expertise:
- Cluster deployment
- Hive, Spark tuning
- Oozie for workflow orchestration; possible conversion to Airflow
- Experience with Hive, Spark required
- Experience with Storm, Oozie. Flink, Goblin a plus
- Test/Tune jobs and clusters, update configurations for sizing and cost optimization.
- Collaborate with Google PSO team (operating in advisory capacity) on updating playbooks. VZ is using Terraform and bash scripting to deploy clusters. Mixture of long-running and ephemeral clusters.
- Assistance with evaluation of Serverless Spark for spark workloads.
- Assistance with conversion of workflows from Oozie to Dataproc Workflow Templates or Airflow (Cloud Composer).
- Ability to engage with application owners to assist hands on with tuning and recommendations for deployment methodology (long running vs ephemeral clusters, CI/CD patterns).
Vacancy expired!