Job Details

ID #16942153
State Texas
City Irving
Job type Permanent
Salary USD $90,000 - $140,000 90000 - 140000
Source Larsen & Toubro Infotech Limited
Showed 2021-07-18
Date 2021-07-08
Deadline 2021-09-06
Category Et cetera
Create resume

Big Data Developer

Texas, Irving, 33601 Irving USA

Vacancy expired!

Job Title:- Big Data DeveloperJob Location:- Irving, TX and Tampa, FL

Job Description:
  • 5+ years working experience in data integration and pipeline development.
  • 2+ years of experience with Cloud on data integration with Apache Spark, EMR, Glue or similar Data-lake technologies.
  • Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
  • Design, develop test, deploy, maintain and improve data integration pipeline.
  • Experience in Python and common python libraries.
  • Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
  • Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and integration tools.
  • Strong debugging skills required in Java Spark/Python/API Spark-Integration/Hadoop.
  • Databricks or Apache Spark using Scala Experience is appreciated. Knowledge of analytical data processing and basic statistics is desirable.
Programming Languages: Java, Python, Shell (Bash) script. Data-tools: Apache Spark, Impala, Hive, Hadoop. Responsibilities
  • Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform.
  • Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities.
  • Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts.
  • Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements.

Vacancy expired!

Subscribe Report job