Vacancy expired!
- Who should have strong experience in Pyspark/Big data and ETL testing
- Between 5–10 years of IT experience
- Have experience for Big Data technologies like Spark, Hadoop, MongoDB, etc.
- Have worked on multiple Databases and have knowledge regarding capacity and performance management
- Have good knowledge of data quality process and worked on data quality product like Informatica DQ
- Ability to take end to end ownership and be multi tasker
- Ability to work effectively within cross functional teams
- Strong understanding of technology concepts and best practices
- An innovative frame of mind – open to learning new technologies and techniques
- Verbal and Written communication skills - primarily the ability to communicate ideas, standards and technical details to the development partners
- Complete Understanding of spark architecture.
- Should have experience in Spark and python. M.
- Must have hands on experience in Object and functional testing in Scala
- Should have worked on Parallel processing, Tasks, Stages.
- Testing experience in data lake store strategy, while ensuring rapid delivery while taking responsibility for applying standards, principles, theories, and concepts.
- Designing and delivering of data models, which power BI initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases for client solutions.
- Working with data architects on the logical data models and physical database designs optimized for performance, availability and reliability.
- Responsible for tuning and optimization of backend and frontend data operations
- Designing and developing ETL and master data management processes.
- Scripting and automation to support development, QA and production database environments and deployments to production.
- Maturing the continuous integration and continuous deployment methodologies
- Mentoring development team members.
- Keeping management informed of work activities and schedules.
- Assessing new initiatives to determine the work effort and estimating the necessary time to completion.
Vacancy expired!