Vacancy expired!
Job Number: R0101031
Data Solutions Architect, SeniorKey Role:Architect and implement scalable data engineering solutions for processing structured and unstructured data to support mission critical projects in the ind us try us ing cloud native services. Develop data pipelines sourcing data from variety of data sources, perform data quality checks, ingest, aggregate, and publish data. Develop and implement standards and best practices for data engineering, data quality and metadata management. Work in a Scrum-based Agile environment with a multi-disciplinary team of analysts, data engineers, data scientists, developers, and data consumers in a collaborative, fast-paced environment.Basic Qualifications:- 6+ years of experience with developing data pipelines us ing commer cia l and open source te chn ologies
- Experience with Big data te chn ologies, including Apache Hadoop, Hive and Spark
- Experience with AWS cloud native services, including Amazon RedShift, EMR, Athena, and RDS
- Experience with data management concepts, ind us try best practices for data sourcing, data quality, metadata management, and advanced analytics
- Experience with scheduling and automation of data pipelines
- Secret clearance
- BA or BS degree
- Experience with Streamsets, Databricks and Apache Airflow
- Experience with a b us iness intelligence and dashboarding tool
- Experience creating solution architecture diagrams, project plans and roadmaps
- AWS Solution Architecture Certification preferred
Vacancy expired!