Vacancy expired!
- Conduct POCs (proof of concept) and pilots to try new solutions and provide summary of results
- Participate in detailed technical design, development, implementation and support of Big Data applications
- Maintain standards compliance and ensure development artifacts are in alignment with patterns/ frameworks designed by software engineering teams
- Familiarity with Spark programming paradigms (batch and stream-processing). Understanding of different data abstraction objects used in spark for different use cases, use of optimal data format and other optimization techniques.
- Strong programming skills in at least one of the following languages: Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells
- Strong knowledge of writing optimized Spark and Hive sql and experience to tune poor performing queries.
- Outstanding programming and debugging skills. Strong knowledge of common algorithms and data structures.
- Experience with Java and/or Scala, preferably with Spring framework. 3+ years preferred.
- Strong experience with SQL and relational databases like PostgreSQL, MySQL, SQL Server or Oracle.