Vacancy expired!
Cloud Data Engineer Location: Jersey City, NJ (Must be able to work onsite downstream) Duration: 6 month W2 ONLY Responsibilities: -
- Demonstrated ability to have successfully completed multiple, complex technical data engineering projects and create high-level design and architecture of the solution.
- Able to present the solution architecture strategy and define value proposition to key stake holders.
- Able to communicate the capabilities and improvements offered by solution architecture with both the development teams and business user teams.
- Develop POC's and conduct show and tell sessions.
- Mentor development teams from traditional Data architecture path to advanced cloud warehouse technology platforms with CICD framework.
- Design the Data replication systems and integration systems by evaluating various products and deciding on the better technology that meets the corporate objectives.
- Perform Data Analysis, Data Modeling, Data Management, and Data lineage.
- Design data security framework considering both internal and external sharing aspects.
- Build and Automate data pipelines using an AWS Glue.
- Query and Automate the data with AWS Athena using Python.
- Design Data pipes and automate data ingestion and cleansing, transformation activities using the DevOps methodologies.
- Must have total 8+ yrs. of experience in IT and working as a Data Engineer and 7+ years in Data warehouse, ETL, BI Projects.
- Must have experience at least 4 End to End implementation of cloud data warehouse (Redshift, Postgres, or Snowflake).
- Design and Develop ETL Processes in AWS Glue to migrate data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
- Hands-on experience with Postgres SQL, RedShift, Redshift spectrum, AWS Glue, Athena, Snowflake utilities, Snow SQL, Snow Pipe, AWS Lambda model techniques using Python.
- Experience in Data Migration from RDBMS to Redshift/Snowflake cloud data warehouse.
- Expertise in data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL/ELT concepts.
Vacancy expired!