Principal Data Engineer - Platforms

Job Summary:The primary purpose of this role is to design cross-functional solutions for highly complex requirements while ensuring that applications work in concert across Lowe's. This includes leading the development, configuration, or modification of new solutions for the business and resolving architectural or design deficiencies. In addition, this role provides consultation to help ensure new and existing Data, BI or Platform solutions are developed with insight into industry best practices, strategies, and architectures.

• Architects data ingestion frameworks; builds proactive data lake roadmap based on future business needs and works with engineering managers to execute against the roadmap; pursues continuous evaluation of data ingestion tools (on-prem and cloud-based) and presents recommendations on future state; works with Operational systems architects to define future state data movements and methods for more real time data ingress and egress and API based access for downstream systems
• Understands business requirements and refines the data for solving business problems and user insights; reduces redundancy and delivers repeatable / reusable metrics for each business domain; ensures data consistency and data quality across multiple data applications by implementing data monitoring frameworks
• Defines architecture, frameworks, tools and technologies for Advanced Analytic Capabilities; Works with Data Science team to understand Advance Analytics Roadmap and influences solution and tools required to achieve business outcomes; pursues connected analytics by hosting models as API services and excels in performance engineering, algorithm and model re-engineering /scaling
• Acts as internal governing body for technical standards and maturity; improves analytic methods, techniques, standards, policies and procedures by identifying gaps in current execution methods; proposes updates to the internal data engineering competency framework; participates in continuous improvement activities including training opportunities; coordinates and leads training efforts; uses expert technical competence to contribute to policy and procedure updates
• Ensures the definition, design, manipulation and administration of data and systems are secure and in accordance with enterprise governance by staying compliant with industry best practices, enterprise standards, corporate policy and department procedure; collaborates with key stakeholders (IT, DACI Business Analytics and Data Science teams) to ensure compliance with governance and security standards; defines reusable design patterns and processes
• Provides guidance and frameworks for the health and monitoring of data engineering platforms; works with management for future platform roadmaps; demonstrates technical thought leadership on platform choices
• Coordinates with Management and vendors on data engineering data and product roadmaps that align to business roadmaps
• Supports, measures and maintains data engineering capabilities by collaborating with Technology shared services; actively recommends planning outages, upgrades and the decommissioning of analytic functions and capabilities

• Bachelor's Degree in Engineering, Computer Science, CIS, or related field
• 10 years of experience in Data or BI Engineering, Data Warehousing/ETL, or Software Engineering
• 8 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

• In most cases Lowe's will not be able to provide sponsorship for roles located in the Charlotte Tech Hub
• Master's Degree in Computer Science, CIS, or related field

• 7 years of IT experience developing and implementing systems within an organization
• 7 years of experience working with defect or incident tracking software
• 7 years of experience working with application and integration middleware
• 5 years of experience working with an IT Infrastructure Library (ITIL) framework
• 5 years of experience leading teams, with or without direct reports
• 7 years of experience working with source code control systems
• Experience working with Continuous Integration/Continuous Deployment tools
• 7 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions

• 6 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• 2 years of experience architecting and designing data projects (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)