Senior Data Engineer

Senior Data Engineer on the Data Authoring and Tools team is to own and lead our engineering efforts around building a forecasting and simulation platform for personalized authored content, and drive key decisions along the way that will influence our entire engineering and marketing organization. What You'll Do Lead critical efforts designing and building new capabilities for our authored content to run through forecasting and simulation to better personalize content for our members Influence the features and direction of our products with your own ideas Identify ways to improve our technology and process Lead by example and mentor team members by providing technical and design guidance Lead or participate in code and technical design reviews Take an active role in the technical growth of other team members and the processes that support overall team growth Scoping and planning work across multi-team efforts, working closely with business partners to define a product vision in technical terms, and plan implementation and delivery What's Great About It The autonomy, pace, and quick decisioning of a startup, with the stability of Client mature platform and business You will be using a variety of technologies such as Apache Beam, Apache Spark on large amounts of data Technologies for production serving and personalization also include Scala, GCP, BigTable, BigQuery, GRPC, Thrift, GKE, Splunk and Grafana Have the autonomy to achieve results without micromanagement Minimum basic requirements: 6+ years of professional experience developing large-scale, high-volume services 6+ years of significant professional experience in server-side development 5+ years of experience managing data pipelines and large scale data products. . Knowledge in microservice architectures, messaging patterns, deployment models, domain driven design, data pipelines and data warehouses. Professional experience across the entire software development process, from development environment, to CI & CD, to production deployment, product and application performance measurement Proven ability and interest in mentorship of junior engineers Preferred Qualifications : Enthusiasm for learning about data products, features, and strategies. Approaches problems with a pragmatic, analysis driven approach - understands trade-offs between perfection and time, with an eye towards iterative delivery of product features, and utilizes this capacity to plan and deliver on product requirements Confident in articulating complex technical content to peers and partners Scala experience is a plus DevOps experience is a plus, specifically using Google Cloud Reach me at bhavitha.b(at)mysbscorp(dot)com