Vacancy expired!
Senior Data EngineerMust have:
- Experience with one or few ETL tools and frameworks (MS SSIS, Pentaho, Talend, Informatica etc)
- Experience with any of the following DWH: AWS Redshift, Snowflake, BigQuery
- Experience with AWS/AzureP Cloud Platforms (Preferably with Analytical services)
- Proficiency in object-oriented/object function : Python (Preferred) or Java/Scala
- Strong analytic skills related to working with unstructured datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- Remote team leadership skills (for US-based positions)
- Experience with Github
- Snowflake experience
- Experience with BI tools (Tableau, Looker etc)
- Experience with NoSQL databases: Cassandra, MongoDB, DynamoDB, Neo4J
- Understanding CI/CD concepts
- Big Data concepts and experience with Hadoop, Spark, Kafka
- Experience in Media industry and its standards
- Good understanding of REST technologies (REST design, RESTful services)
- Knowledge of OOP, OOD and design patterns
- Assemble large, complex data sets that meet functional / non-functional business requirements
- Define architectural and implementation design of metadata and data pipelines
- Requirements analysis, communication with Product Managers and other stakeholders
- Prepare designs for database systems and recommend improvements for performance.
- Create data pipelines (ETL/ELTs) using SQL, Python and various AWS services
- Writing analytical SQL queries for end-user apps/services
- Evaluate all proposals requests and assist to improve structure of DWH.
- Perform troubleshoot on all ETL processes and resolve issues effectively.
- Code reviews and bug fixing.
Vacancy expired!