Job Details

ID #15585634
State Texas
City Houston
Job type Permanent
Salary USD TBD TBD
Source Kelly
Showed 2021-06-18
Date 2021-06-17
Deadline 2021-08-16
Category Architect/engineer/CAD
Create resume

Data Engineer

Texas, Houston, 77002 Houston USA

Vacancy expired!

Kelly Technology has an opening for a Data Engineer to work with our client in Houston

On site required Duration: 6+ months

SUMMARY: The Data Engineer supports the implementation of Company's next generation digital platform. (S)he is responsible for building and delivering data models, executing data pipelines and ensuring accomplishment of business results. The Data Engineer works closely with company CTO, CISO, Chief Architect, Data Scientists and Partners to integrate the digital business priorities into a strategic and sustainable product roadmap.

Digital Platform is a next generation industry cloud focused on providing composite digital solutions for sub-surface, surface, corporate function, Private Equity and alternative energy. It combines and analyses data from portfolio companies, capital markets and industry sources to provide state of the art Data Driven insights.

JOB RESPONSIBILITIES:
  • Create and maintain optimal data pipeline architecture in cloud (Azure) that can be scalable.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Build the infrastructure (leveraging open source / vendor tools) required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build out new API integrations to support continuing increases in data volume and complexity
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data structures / tools for petro-technical and data scientist team members to assist them in building business intelligence applications, analytical solutions and predictive models.
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Lead development efforts using Agile / Scrum practices
  • Writes unit/integration tests, contributes to engineering wiki, and documents work.
  • Troubleshoots data related issues and assist in the resolution of data issues.
  • Works closely with a team of frontend and backend engineers, product managers, and analysts.
  • Maintain an awareness of emerging technologies, industry trends, and drives adoption of software engineering development best practices

REQUIRED:
  • 5+ years relevant experience as (big) data engineer
  • Experience of Big Data tools like Azure analysis services, Azure Synapse Analytics, Azure Databricks and Azure HDInsight
  • Experience with NoSQL databases like Cassandra, MongoDB and Cosmos DB
  • Experience with relations databases like Oracle, MS SQL SERVER and MySQL databases
  • Experience of data ingestion tools like Azure Data Factory
  • Experience with Spark Streaming, Apache NiFi, Kafka and Azure Stream Analytics for real-time data processing
  • Experience of job schedulers and runbook automation using Azure Automation
  • Experience with data pipeline workflow management tools using Azure data factory, Oozie and SSIS
  • Experience with programming languages: Python, Scala, Julia, Java, etc.
  • Experience in Azure DevOps
  • Experience with source code control environments like GIT
  • Strong analytic skills related to working with unstructured datasets
  • Detailed knowledge of data lifecycle activities such as data definitions, data lineage and implementation of a data quality management framework
  • Energy domain expertise in E&P is a plus.
  • Candidate must have completed at least undergraduate degree in physical sciences or engineering
  • Strong communication skills and the ability to effectively discuss with business partners at the appropriate level of technical detail

If you are interested, please email your resume to

Why Kelly ® ?

By partnering with Kelly® Technology, you'll have direct connections to top companies around the globe-giving you the chance to put your tech skills to work on some of today's most intriguing, innovative, and high-visibility projects. In a world where change is the only constant, our unparalleled connections and IT market expertise help you take your skills exactly where you want to go. We're here to help you gain experience, keep learning, and move your career forward.

About Kelly ®

At Kelly, we're always thinking about what's next and advising job seekers on new ways of working to reach their full potential. In fact, we're a leading advocate for temporary/nontraditional workstyles, because we believe they allow flexibility and tremendous growth opportunities that enable a better way to work and live (plus, did we mention we provide a ton of benefits ?). Connecting great people with great companies is what we do best, and our employment opportunities span a wide variety of workstyles, skill levels, and industries around the world. Kelly is an equal opportunity employer committed to employing a diverse workforce and providing accommodations for people with disabilities in all parts of the hiring process as required under its Employment Accommodation Policy. Kelly will work with applicants to meet accommodation needs that are made known to Kelly in advance.

Vacancy expired!

Subscribe Report job