Vacancy expired!
In this role you will be responsible to move and processing large volume of data across on premise and cloud environments in a secure manner. The Data engineer will support software developers, data architects, data analysts and business users to get the most value out of the platform with minimal friction. The candidate must be self-directed with ability to own and execute the platform improvement activities while collaborating with other team members and stakeholders.
- 6-8 years of experience in building and maintaining data platforms, ETL processes and connected sources and targets required. Strong SQL knowledge is required for this role.
- 6-8 years of experience in architecture, designing and operationalizing including data lakes, data warehouses and data marts.
- 6-8 years of experience with Data management.
- 2-4 years of hands on experience on AWS S3, RDS, EMR, Step Functions, and Cloud Watch is preferred.
- 3-5 years of performance measurement and tuning experience is preferred.
- Candidate should have working experience on Shell scripting, and Bitbucket. Must know about tools like Service Now, JIRA etc.
- Candidate with Python knowledge would be preferred.
- Experience in the financial services or banking industry is required.
- Design, build, automate data pipeline, testing systems, event monitoring and notifications.
- Deep understanding of the design and development considerations around data partitioning, job scheduling, data versioning, data import/export, archival, and schema management.
- Strong understanding of data read and write performance and impact of data storage and movement patterns on the performance.
- Candidate should have knowledge about AWS Cloud Services: S3, CloudWatch, RDS, EMR (Hive), Redshift Spectrum, EC2, and Step Functions.
- Experience creating data warehouses that process large volume of data in a specific time window.
- Experience merging, separating, and sunsetting data warehouses.
- Study the current state implementation of the data lake, data warehouse, and data marts; recommend a future state and a path to migration that is least impactful to the business and the current production workloads.
- Implement the best practices and design patterns for the data lake, enterprise data warehouse, and domain specific data marts.
- Experience implementing enterprise systems with security best practices and site reliability engineering principles.
- Help implement encryption, obfuscation and other security best practices to meet all organizational data security policies and guidelines.
Vacancy expired!